2023-05-17T11:24:26.931 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-17T11:24:26.932 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7276583 --verbose --name rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7276583/orig.config.yaml 2023-05-17T11:24:26.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-17T11:24:27.073 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7276583 branch: wip-rishabh-2023May15-1524 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7276583' kernel: flavor: default kdb: true sha1: 2bcb179390319a07fc43480888bd707374860ab3 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023May15-1524 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023May15-1524 sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b owner: scheduled_rishabh@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023May15-1524 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi003.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIXs459KR1ImAEFVOz9pFYiSjtUzpZ4MLEbP1acyIZVo smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPgD96A7ibuTyVELWnAUYBTpXXKD3lnRM8JK/HeB0qfFlnPP7ZdJsx8h6FnHc2647C9ViBF04AoaLTpLyRmaH7Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-17_11:09:48 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-17T11:24:27.073 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa; will attempt to use it 2023-05-17T11:24:27.074 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa/tasks 2023-05-17T11:24:27.074 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-17T11:24:27.076 INFO:teuthology.task.internal:Checking packages... 2023-05-17T11:24:27.105 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b' 2023-05-17T11:24:27.106 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-17T11:24:27.106 INFO:teuthology.packaging:ref: None 2023-05-17T11:24:27.107 INFO:teuthology.packaging:tag: None 2023-05-17T11:24:27.107 INFO:teuthology.packaging:branch: wip-rishabh-2023May15-1524 2023-05-17T11:24:27.107 INFO:teuthology.packaging:sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-17T11:24:27.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023May15-1524 2023-05-17T11:24:27.244 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3926-g27be5126-1jammy 2023-05-17T11:24:27.244 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-17T11:24:27.251 INFO:teuthology.task.internal:no buildpackages task found 2023-05-17T11:24:27.251 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-17T11:24:27.272 INFO:teuthology.task.internal:Saving configuration 2023-05-17T11:24:27.288 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-17T11:24:27.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-17T11:24:27.322 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7276583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 11:10:32.999722', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIXs459KR1ImAEFVOz9pFYiSjtUzpZ4MLEbP1acyIZVo'} 2023-05-17T11:24:27.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7276583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 11:10:32.998263', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINteHur2SzaM5vbqa4QFyWhfm59ZnHiT+xqngosFdl3w'} 2023-05-17T11:24:27.347 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-17T11:24:27.353 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-17T11:24:27.353 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-17T11:24:27.354 INFO:teuthology.run_tasks:Running task console_log... 2023-05-17T11:24:27.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f18cc4a4040>, signals=[15]) 2023-05-17T11:24:27.445 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-17T11:24:27.455 INFO:teuthology.task.internal:Opening connections... 2023-05-17T11:24:27.456 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:24:27.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:24:27.537 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:24:27.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:24:27.614 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-17T11:24:27.620 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-05-17T11:24:27.626 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-05-17T11:24:27.626 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-05-17T11:24:27.675 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-17T11:24:27.675 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="22.04" 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=jammy 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-17T11:24:27.676 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-17T11:24:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-17T11:24:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-17T11:24:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=jammy 2023-05-17T11:24:27.677 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-05-17T11:24:27.705 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-05-17T11:24:27.711 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-05-17T11:24:27.711 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-05-17T11:24:27.758 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-17T11:24:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2023-05-17T11:24:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="22.04" 2023-05-17T11:24:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-17T11:24:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=jammy 2023-05-17T11:24:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2023-05-17T11:24:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2023-05-17T11:24:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-17T11:24:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-17T11:24:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-17T11:24:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-17T11:24:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=jammy 2023-05-17T11:24:27.760 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-05-17T11:24:27.797 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-17T11:24:27.809 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-17T11:24:27.863 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-17T11:24:27.864 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2023-05-17T11:24:27.866 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-05-17T11:24:27.871 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-17T11:24:27.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-17T11:24:27.889 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2023-05-17T11:24:27.913 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-05-17T11:24:27.928 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-17T11:24:27.987 INFO:teuthology.run_tasks:Running task kernel... 2023-05-17T11:24:28.002 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'} 2023-05-17T11:24:28.003 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}}, timeout 300 2023-05-17T11:24:28.003 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-17T11:24:28.004 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-17T11:24:28.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:24:28.009 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:24:28.009 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2bcb179390319a07fc43480888bd707374860ab3"... 2023-05-17T11:24:28.009 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-05-17T11:24:28.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:24:28.010 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:24:28.010 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2bcb179390319a07fc43480888bd707374860ab3"... 2023-05-17T11:24:28.011 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-05-17T11:24:28.056 INFO:teuthology.orchestra.run.smithi003.stdout:5.15.0-56-generic 2023-05-17T11:24:28.056 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:24:28.057 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-17T11:24:28.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:24:28.062 INFO:teuthology.orchestra.run.smithi060.stdout:5.15.0-56-generic 2023-05-17T11:24:28.063 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:24:28.063 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-17T11:24:28.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:24:28.204 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-05-17T11:24:28.204 DEBUG:teuthology.orchestra.run.smithi003:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-05-17T11:24:28.205 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-05-17T11:24:28.205 DEBUG:teuthology.orchestra.run.smithi060:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-05-17T11:24:28.216 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-05-17T11:24:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-05-17T11:24:28.357 INFO:teuthology.orchestra.run.smithi003.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-05-17T11:24:28.357 INFO:teuthology.orchestra.run.smithi003.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-05-17T11:24:28.357 INFO:teuthology.orchestra.run.smithi003.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: git config --global init.defaultBranch 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: 2023-05-17T11:24:28.358 INFO:teuthology.orchestra.run.smithi003.stderr:hint: git branch -m 2023-05-17T11:24:28.359 INFO:teuthology.orchestra.run.smithi003.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-05-17T11:24:28.360 DEBUG:teuthology.orchestra.run.smithi003:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-05-17T11:24:28.367 INFO:teuthology.orchestra.run.smithi060.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-05-17T11:24:28.367 INFO:teuthology.orchestra.run.smithi060.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-05-17T11:24:28.367 INFO:teuthology.orchestra.run.smithi060.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-05-17T11:24:28.368 INFO:teuthology.orchestra.run.smithi060.stderr:hint: 2023-05-17T11:24:28.368 INFO:teuthology.orchestra.run.smithi060.stderr:hint: git config --global init.defaultBranch 2023-05-17T11:24:28.368 INFO:teuthology.orchestra.run.smithi060.stderr:hint: 2023-05-17T11:24:28.368 INFO:teuthology.orchestra.run.smithi060.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-05-17T11:24:28.368 INFO:teuthology.orchestra.run.smithi060.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-05-17T11:24:28.369 INFO:teuthology.orchestra.run.smithi060.stderr:hint: 2023-05-17T11:24:28.369 INFO:teuthology.orchestra.run.smithi060.stderr:hint: git branch -m 2023-05-17T11:24:28.369 INFO:teuthology.orchestra.run.smithi060.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-05-17T11:24:28.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-05-17T11:24:28.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-05-17T11:24:28.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-05-17T11:24:28.485 DEBUG:teuthology.orchestra.run.smithi003:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-05-17T11:24:28.497 DEBUG:teuthology.orchestra.run.smithi060:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-05-17T11:27:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-05-17T11:27:24.302 INFO:teuthology.orchestra.run.smithi060.stderr: * [new branch] main -> origin/main 2023-05-17T11:27:24.303 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20230515 -> 20230515 2023-05-17T11:27:24.331 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190312 -> 20190312 2023-05-17T11:27:24.331 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190416 -> 20190416 2023-05-17T11:27:24.331 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190514 -> 20190514 2023-05-17T11:27:24.332 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190618 -> 20190618 2023-05-17T11:27:24.332 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190717 -> 20190717 2023-05-17T11:27:24.332 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190815 -> 20190815 2023-05-17T11:27:24.332 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20190923 -> 20190923 2023-05-17T11:27:24.332 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20191022 -> 20191022 2023-05-17T11:27:24.334 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20191215 -> 20191215 2023-05-17T11:27:24.334 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200122 -> 20200122 2023-05-17T11:27:24.334 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200316 -> 20200316 2023-05-17T11:27:24.334 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200421 -> 20200421 2023-05-17T11:27:24.334 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200519 -> 20200519 2023-05-17T11:27:24.334 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200619 -> 20200619 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200721 -> 20200721 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200817 -> 20200817 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20200918 -> 20200918 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20201022 -> 20201022 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20201118 -> 20201118 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20201218 -> 20201218 2023-05-17T11:27:24.335 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20210208 -> 20210208 2023-05-17T11:27:24.336 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20210315 -> 20210315 2023-05-17T11:27:24.336 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20210511 -> 20210511 2023-05-17T11:27:24.336 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20210716 -> 20210716 2023-05-17T11:27:24.336 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20210818 -> 20210818 2023-05-17T11:27:24.336 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20210919 -> 20210919 2023-05-17T11:27:24.336 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20211027 -> 20211027 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20211216 -> 20211216 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220209 -> 20220209 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220310 -> 20220310 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220411 -> 20220411 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220509 -> 20220509 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220610 -> 20220610 2023-05-17T11:27:24.338 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220708 -> 20220708 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220815 -> 20220815 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20220913 -> 20220913 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20221012 -> 20221012 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20221109 -> 20221109 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20221214 -> 20221214 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20230117 -> 20230117 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20230210 -> 20230210 2023-05-17T11:27:24.339 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20230310 -> 20230310 2023-05-17T11:27:24.340 INFO:teuthology.orchestra.run.smithi060.stderr: * [new tag] 20230404 -> 20230404 2023-05-17T11:27:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:Updating files: 47% (1381/2929) Updating files: 48% (1406/2929) Updating files: 49% (1436/2929) Updating files: 50% (1465/2929) Updating files: 51% (1494/2929) Updating files: 52% (1524/2929) Updating files: 53% (1553/2929) Updating files: 54% (1582/2929) Updating files: 55% (1611/2929) Updating files: 56% (1641/2929) Updating files: 57% (1670/2929) Updating files: 58% (1699/2929) Updating files: 59% (1729/2929) Updating files: 60% (1758/2929) Updating files: 61% (1787/2929) Updating files: 62% (1816/2929) Updating files: 63% (1846/2929) Updating files: 64% (1875/2929) Updating files: 65% (1904/2929) Updating files: 65% (1911/2929) Updating files: 66% (1934/2929) Updating files: 67% (1963/2929) Updating files: 68% (1992/2929) Updating files: 69% (2022/2929) Updating files: 70% (2051/2929) Updating files: 71% (2080/2929) Updating files: 72% (2109/2929) Updating files: 73% (2139/2929) Updating files: 74% (2168/2929) Updating files: 75% (2197/2929) Updating files: 76% (2227/2929) Updating files: 77% (2256/2929) Updating files: 78% (2285/2929) Updating files: 79% (2314/2929) Updating files: 80% (2344/2929) Updating files: 81% (2373/2929) Updating files: 81% (2383/2929) Updating files: 82% (2402/2929) Updating files: 83% (2432/2929) Updating files: 84% (2461/2929) Updating files: 85% (2490/2929) Updating files: 86% (2519/2929) Updating files: 87% (2549/2929) Updating files: 88% (2578/2929) Updating files: 89% (2607/2929) Updating files: 90% (2637/2929) Updating files: 91% (2666/2929) Updating files: 92% (2695/2929) Updating files: 93% (2724/2929) Updating files: 94% (2754/2929) Updating files: 95% (2783/2929) Updating files: 96% (2812/2929) Updating files: 97% (2842/2929) Updating files: 98% (2871/2929) Updating files: 99% (2900/2929) Updating files: 100% (2929/2929) Updating files: 100% (2929/2929), done. 2023-05-17T11:27:27.715 INFO:teuthology.orchestra.run.smithi060.stdout:HEAD is now at 51290942 Merge branch 'main' of https://github.com/CirrusLogic/linux-firmware 2023-05-17T11:27:27.736 INFO:teuthology.task.kernel:Downloading kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.b... 2023-05-17T11:27:27.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:27:27.877 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g2bcb17939031/ 2023-05-17T11:27:27.877 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-g2bcb17939031_6.3.0-g2bcb17939031-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g2bcb17939031/ --input-file=- 2023-05-17T11:27:27.885 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi060.front.sepia.ceph.com to complete... 2023-05-17T11:27:29.538 INFO:teuthology.orchestra.run.smithi003.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-05-17T11:27:29.539 INFO:teuthology.orchestra.run.smithi003.stderr: * [new branch] main -> origin/main 2023-05-17T11:27:29.539 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20230515 -> 20230515 2023-05-17T11:27:29.567 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190312 -> 20190312 2023-05-17T11:27:29.571 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190416 -> 20190416 2023-05-17T11:27:29.571 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190514 -> 20190514 2023-05-17T11:27:29.571 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190618 -> 20190618 2023-05-17T11:27:29.573 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190717 -> 20190717 2023-05-17T11:27:29.574 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190815 -> 20190815 2023-05-17T11:27:29.574 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20190923 -> 20190923 2023-05-17T11:27:29.574 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20191022 -> 20191022 2023-05-17T11:27:29.574 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20191215 -> 20191215 2023-05-17T11:27:29.575 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200122 -> 20200122 2023-05-17T11:27:29.575 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200316 -> 20200316 2023-05-17T11:27:29.575 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200421 -> 20200421 2023-05-17T11:27:29.576 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200519 -> 20200519 2023-05-17T11:27:29.576 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200619 -> 20200619 2023-05-17T11:27:29.580 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200721 -> 20200721 2023-05-17T11:27:29.580 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200817 -> 20200817 2023-05-17T11:27:29.580 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20200918 -> 20200918 2023-05-17T11:27:29.580 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20201022 -> 20201022 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20201118 -> 20201118 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20201218 -> 20201218 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20210208 -> 20210208 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20210315 -> 20210315 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20210511 -> 20210511 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20210716 -> 20210716 2023-05-17T11:27:29.581 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20210818 -> 20210818 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20210919 -> 20210919 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20211027 -> 20211027 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20211216 -> 20211216 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220209 -> 20220209 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220310 -> 20220310 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220411 -> 20220411 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220509 -> 20220509 2023-05-17T11:27:29.582 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220610 -> 20220610 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220708 -> 20220708 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220815 -> 20220815 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20220913 -> 20220913 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20221012 -> 20221012 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20221109 -> 20221109 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20221214 -> 20221214 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20230117 -> 20230117 2023-05-17T11:27:29.583 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20230210 -> 20230210 2023-05-17T11:27:29.584 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20230310 -> 20230310 2023-05-17T11:27:29.584 INFO:teuthology.orchestra.run.smithi003.stderr: * [new tag] 20230404 -> 20230404 2023-05-17T11:27:29.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17 11:27:29 URL:https://1.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g2bcb17939031/linux-image-6.3.0-g2bcb17939031_6.3.0-g2bcb17939031-1_amd64.deb [38562660/38562660] -> "/tmp/linux-image.deb" [1] 2023-05-17T11:27:29.718 INFO:teuthology.orchestra.run.smithi060.stderr:FINISHED --2023-05-17 11:27:29-- 2023-05-17T11:27:29.718 INFO:teuthology.orchestra.run.smithi060.stderr:Total wall clock time: 1.8s 2023-05-17T11:27:29.718 INFO:teuthology.orchestra.run.smithi060.stderr:Downloaded: 1 files, 37M in 1.6s (22.5 MB/s) 2023-05-17T11:27:29.721 INFO:teuthology.task.kernel:Installing kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.b... 2023-05-17T11:27:29.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo dpkg -i /tmp/linux-image.deb 2023-05-17T11:27:29.991 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package linux-image-6.3.0-g2bcb17939031. 2023-05-17T11:27:32.086 INFO:teuthology.orchestra.run.smithi060.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-05-17T11:27:32.090 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-05-17T11:27:32.283 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking linux-image-6.3.0-g2bcb17939031 (6.3.0-g2bcb17939031-1) ... 2023-05-17T11:27:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:Updating files: 47% (1381/2929) Updating files: 48% (1406/2929) Updating files: 49% (1436/2929) Updating files: 50% (1465/2929) Updating files: 51% (1494/2929) Updating files: 52% (1524/2929) Updating files: 53% (1553/2929) Updating files: 54% (1582/2929) Updating files: 55% (1611/2929) Updating files: 56% (1641/2929) Updating files: 57% (1670/2929) Updating files: 58% (1699/2929) Updating files: 59% (1729/2929) Updating files: 60% (1758/2929) Updating files: 61% (1787/2929) Updating files: 62% (1816/2929) Updating files: 63% (1846/2929) Updating files: 64% (1875/2929) Updating files: 65% (1904/2929) Updating files: 65% (1911/2929) Updating files: 66% (1934/2929) Updating files: 67% (1963/2929) Updating files: 68% (1992/2929) Updating files: 69% (2022/2929) Updating files: 70% (2051/2929) Updating files: 71% (2080/2929) Updating files: 72% (2109/2929) Updating files: 73% (2139/2929) Updating files: 74% (2168/2929) Updating files: 75% (2197/2929) Updating files: 76% (2227/2929) Updating files: 77% (2256/2929) Updating files: 78% (2285/2929) Updating files: 79% (2314/2929) Updating files: 80% (2344/2929) Updating files: 81% (2373/2929) Updating files: 81% (2383/2929) Updating files: 82% (2402/2929) Updating files: 83% (2432/2929) Updating files: 84% (2461/2929) Updating files: 85% (2490/2929) Updating files: 86% (2519/2929) Updating files: 87% (2549/2929) Updating files: 88% (2578/2929) Updating files: 89% (2607/2929) Updating files: 90% (2637/2929) Updating files: 91% (2666/2929) Updating files: 92% (2695/2929) Updating files: 93% (2724/2929) Updating files: 94% (2754/2929) Updating files: 95% (2783/2929) Updating files: 96% (2812/2929) Updating files: 97% (2842/2929) Updating files: 98% (2871/2929) Updating files: 99% (2900/2929) Updating files: 100% (2929/2929) Updating files: 100% (2929/2929), done. 2023-05-17T11:27:32.950 INFO:teuthology.orchestra.run.smithi003.stdout:HEAD is now at 51290942 Merge branch 'main' of https://github.com/CirrusLogic/linux-firmware 2023-05-17T11:27:32.969 INFO:teuthology.task.kernel:Downloading kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.a... 2023-05-17T11:27:32.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T11:27:33.113 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g2bcb17939031/ 2023-05-17T11:27:33.114 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-g2bcb17939031_6.3.0-g2bcb17939031-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g2bcb17939031/ --input-file=- 2023-05-17T11:27:33.116 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi003.front.sepia.ceph.com to complete... 2023-05-17T11:27:34.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17 11:27:34 URL:https://1.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g2bcb17939031/linux-image-6.3.0-g2bcb17939031_6.3.0-g2bcb17939031-1_amd64.deb [38562660/38562660] -> "/tmp/linux-image.deb" [1] 2023-05-17T11:27:34.607 INFO:teuthology.orchestra.run.smithi003.stderr:FINISHED --2023-05-17 11:27:34-- 2023-05-17T11:27:34.607 INFO:teuthology.orchestra.run.smithi003.stderr:Total wall clock time: 1.5s 2023-05-17T11:27:34.607 INFO:teuthology.orchestra.run.smithi003.stderr:Downloaded: 1 files, 37M in 1.3s (27.4 MB/s) 2023-05-17T11:27:34.610 INFO:teuthology.task.kernel:Installing kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.a... 2023-05-17T11:27:34.610 DEBUG:teuthology.orchestra.run.smithi003:> sudo dpkg -i /tmp/linux-image.deb 2023-05-17T11:27:34.865 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-image-6.3.0-g2bcb17939031. 2023-05-17T11:27:35.601 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up linux-image-6.3.0-g2bcb17939031 (6.3.0-g2bcb17939031-1) ... 2023-05-17T11:27:35.715 INFO:teuthology.orchestra.run.smithi060.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-g2bcb17939031 2023-05-17T11:27:36.838 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-05-17T11:27:36.843 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-05-17T11:27:36.938 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-image-6.3.0-g2bcb17939031 (6.3.0-g2bcb17939031-1) ... 2023-05-17T11:27:40.124 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-image-6.3.0-g2bcb17939031 (6.3.0-g2bcb17939031-1) ... 2023-05-17T11:27:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-g2bcb17939031 2023-05-17T11:27:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:Sourcing file `/etc/default/grub' 2023-05-17T11:27:55.579 INFO:teuthology.orchestra.run.smithi060.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-17T11:27:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2023-05-17T11:27:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:Found linux image: /boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T11:27:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:Found initrd image: /boot/initrd.img-6.3.0-g2bcb17939031 2023-05-17T11:27:56.291 INFO:teuthology.orchestra.run.smithi060.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-17T11:27:56.298 INFO:teuthology.orchestra.run.smithi060.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-17T11:27:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-17T11:27:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-17T11:27:56.517 INFO:teuthology.orchestra.run.smithi060.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-17T11:27:56.517 INFO:teuthology.orchestra.run.smithi060.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-17T11:27:56.518 INFO:teuthology.orchestra.run.smithi060.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-17T11:27:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:done 2023-05-17T11:27:56.793 DEBUG:teuthology.orchestra.run.smithi060:> dpkg-deb -c /tmp/linux-image.deb 2023-05-17T11:27:56.801 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./ 2023-05-17T11:27:56.802 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./boot/ 2023-05-17T11:27:56.802 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 4289818 2023-05-17 05:52 ./boot/System.map-6.3.0-g2bcb17939031 2023-05-17T11:27:56.813 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 166933 2023-05-17 05:52 ./boot/config-6.3.0-g2bcb17939031 2023-05-17T11:27:56.814 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11175936 2023-05-17 05:52 ./boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T11:27:56.832 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/ 2023-05-17T11:27:56.832 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/postinst.d/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/postrm.d/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/preinst.d/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/prerm.d/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/ 2023-05-17T11:27:56.833 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/ 2023-05-17T11:27:56.834 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/ 2023-05-17T11:27:56.834 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/ 2023-05-17T11:27:56.834 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/ 2023-05-17T11:27:56.834 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/ 2023-05-17T11:27:56.834 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 527241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/aesni-intel.ko 2023-05-17T11:27:56.836 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-17T11:27:56.836 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-17T11:27:56.836 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-17T11:27:56.836 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 88441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-17T11:27:56.836 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 100081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 142185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 78905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-17T11:27:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 58273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-17T11:27:56.838 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/ 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/ 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce/ 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpuid.ko 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/msr.ko 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/ 2023-05-17T11:27:56.839 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 342897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-17T11:27:56.840 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 971009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-17T11:27:56.840 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 2208345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm.ko 2023-05-17T11:27:56.894 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ 2023-05-17T11:27:56.894 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 55889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/af_alg.ko 2023-05-17T11:27:56.894 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/algif_hash.ko 2023-05-17T11:27:56.894 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/algif_skcipher.ko 2023-05-17T11:27:56.894 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ansi_cprng.ko 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/anubis.ko 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/arc4.ko 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/asymmetric_keys/ 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/ 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_memcpy.ko 2023-05-17T11:27:56.895 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_pq.ko 2023-05-17T11:27:56.896 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-17T11:27:56.896 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_tx.ko 2023-05-17T11:27:56.896 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_xor.ko 2023-05-17T11:27:56.896 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/raid6test.ko 2023-05-17T11:27:56.896 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authenc.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authencesn.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blake2b_generic.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_common.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_generic.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/camellia_generic.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast5_generic.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast6_generic.ko 2023-05-17T11:27:56.897 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast_common.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ccm.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cmac.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crc32_generic.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cryptd.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_engine.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_simd.ko 2023-05-17T11:27:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_user.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cts.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/des_generic.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/dh_generic.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/echainiv.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/essiv.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/fcrypt.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/khazad.ko 2023-05-17T11:27:56.899 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lrw.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4hc.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/md4.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/michael_mic.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcbc.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcrypt.ko 2023-05-17T11:27:56.900 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/rmd160.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/seed.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/serpent_generic.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 148761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tcrypt.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tea.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_common.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_generic.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/vmac.ko 2023-05-17T11:27:56.901 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/wp512.ko 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xcbc.ko 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xor.ko 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xts.ko 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xxhash_generic.ko 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/ 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_extlog.ko 2023-05-17T11:27:56.902 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_pad.ko 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/apei/ 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/apei/einj.ko 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/ec_sys.ko 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/platform_profile.ko 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbs.ko 2023-05-17T11:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbshc.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/video.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/acard-ahci.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 88185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ahci.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ahci_platform.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 84753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/libahci.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/libahci_platform.ko 2023-05-17T11:27:56.904 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_acpi.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ali.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_amd.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_artop.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atiixp.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atp867x.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd640.ko 2023-05-17T11:27:56.905 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd64x.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cypress.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_efar.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt366.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt37x.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it8213.ko 2023-05-17T11:27:56.906 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it821x.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_jmicron.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_legacy.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_marvell.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_mpiix.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_netcell.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ninja32.ko 2023-05-17T11:27:56.907 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87410.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87415.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_oldpiix.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_opti.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_optidma.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pcmcia.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-17T11:27:56.908 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_piccolo.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_radisys.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_rdc.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_rz1000.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sch.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_serverworks.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sil680.ko 2023-05-17T11:27:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sl82c105.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_triflex.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_via.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pdc_adma.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_inic162x.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 82793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_mv.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_nv.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_promise.ko 2023-05-17T11:27:56.910 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_qstor.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil24.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sis.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_svw.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sx4.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_uli.ko 2023-05-17T11:27:56.911 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_via.ko 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_vsc.ko 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay/ 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay/ks0108.ko 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma/ 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 121249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma/bcma.ko 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/ 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe/ 2023-05-17T11:27:56.912 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 113145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe/aoe.ko 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd/ 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 963089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd/drbd.ko 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 172809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/floppy.ko 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx/ 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 93865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 113657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/nbd.ko 2023-05-17T11:27:56.913 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk/ 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 110513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk/null_blk.ko 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 81753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/pktcdvd.ko 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 253977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/rbd.ko 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback/ 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 97705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram/ 2023-05-17T11:27:56.914 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram/zram.ko 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/applicom.ko 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hangcheck-timer.ko 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/ 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-17T11:27:56.915 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/via-rng.ko 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 147745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 138561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-17T11:27:56.916 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/lp.ko 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave/ 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave/mwave.ko 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/nvram.ko 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/ 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 102457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-17T11:27:56.917 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ppdev.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tlclk.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/ 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-05-17T11:27:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/ 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/xillybus_class.ko 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/xillybus_core.ko 2023-05-17T11:27:56.919 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/ 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-palmas.ko 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-si5351.ko 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-twl6040.ko 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-wm831x.ko 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/ 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-17T11:27:56.920 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 223113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp.ko 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-aes.ko 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-sha.ko 2023-05-17T11:27:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/ 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common/ 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 397793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio/ 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 68121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-17T11:27:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca/ 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca/dca.ko 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw/ 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat/ 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 122841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/ 2023-05-17T11:27:56.923 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 73761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/amd64_edac.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/e752x_edac.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/edac_mce_amd.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3000_edac.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3200_edac.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5100_edac.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5400_edac.ko 2023-05-17T11:27:56.924 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7300_edac.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7core_edac.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i82975x_edac.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/ie31200_edac.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 56369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/sb_edac.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/x38_edac.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/ 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-gpio.ko 2023-05-17T11:27:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-max14577.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-max77693.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-max8997.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-palmas.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-rt8973a.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-sm5502.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/ 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/dmi-sysfs.ko 2023-05-17T11:27:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/efi/ 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/efi/efi-pstore.ko 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/ 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-adp5520.ko 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-amd8111.ko 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-arizona.ko 2023-05-17T11:27:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-da9052.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-da9055.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-dln2.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-f7188x.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-generic.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-ich.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-kempld.ko 2023-05-17T11:27:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-lp3943.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-max7300.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-max730x.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-max732x.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-pca953x.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-pcf857x.ko 2023-05-17T11:27:56.929 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-rdc321x.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-sch.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-sch311x.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-tps65912.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-twl4030.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-twl6040.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-vx855.ko 2023-05-17T11:27:56.930 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-wm831x.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-wm8350.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-wm8994.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/ 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-a4tech.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-apple.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-appleir.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-aureal.ko 2023-05-17T11:27:56.931 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-axff.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-belkin.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-cherry.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-chicony.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 58641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-cp2112.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-cypress.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-dr.ko 2023-05-17T11:27:56.932 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elecom.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elo.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-emsff.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ezkey.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gaff.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-generic.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gt683r.ko 2023-05-17T11:27:56.933 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gyration.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtekff.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-hyperv.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-icade.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-kensington.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-keytouch.ko 2023-05-17T11:27:56.934 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-kye.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lcpower.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-led.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lenovo.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lg-g15.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 94481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 80569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech.ko 2023-05-17T11:27:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-magicmouse.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-microsoft.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-monterey.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-multitouch.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ntrig.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ortek.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-penmount.ko 2023-05-17T11:27:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-petalynx.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-picolcd.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-pl.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-plantronics.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-primax.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-rmi.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-common.ko 2023-05-17T11:27:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-17T11:27:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-saitek.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-samsung.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sjoy.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sony.ko 2023-05-17T11:27:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-speedlink.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-steelseries.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sunplus.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tivo.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tmff.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-topseed.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-twinhan.ko 2023-05-17T11:27:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 71017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-uclogic.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-waltop.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 143097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-wiimote.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-xinmo.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zpff.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zydacron.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 260737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid.ko 2023-05-17T11:27:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/uhid.ko 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/ 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 124897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/usbhid.ko 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/usbkbd.ko 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/usbmouse.ko 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 215033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/wacom.ko 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/ 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_balloon.ko 2023-05-17T11:27:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 89177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_utils.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 296369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_vmbus.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 66169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru3.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7414.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7418.ko 2023-05-17T11:27:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adc128d818.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1025.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 97537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1026.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1029.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1031.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm9240.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ads7828.ko 2023-05-17T11:27:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7410.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7411.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 74009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7462.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7470.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 64393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7475.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7x10.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/amc6821.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/applesmc.ko 2023-05-17T11:27:56.945 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asb100.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 58113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asc7621.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/atxp1.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/coretemp.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/da9052-hwmon.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/da9055-hwmon.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-17T11:27:56.946 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 99161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dme1737.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds1621.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds620.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc1403.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc2103.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc6w201.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 66481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71805f.ko 2023-05-17T11:27:56.947 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 94153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71882fg.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f75375s.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fam15h_power.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fschmd.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g760a.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g762.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl518sm.ko 2023-05-17T11:27:56.948 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl520sm.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/hih6130.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5500_temp.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5k_amb.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmaem.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmpex.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina209.ko 2023-05-17T11:27:56.949 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina2xx.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 125729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/it87.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/jc42.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k10temp.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k8temp.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lineage-pem.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm63.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm73.ko 2023-05-17T11:27:56.950 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm75.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm77.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm78.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm80.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm83.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm85.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm87.ko 2023-05-17T11:27:56.951 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm90.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm92.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 108401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm93.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95234.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95241.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95245.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc2945.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4151.ko 2023-05-17T11:27:56.952 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4215.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4222.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4245.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4260.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4261.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max16065.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1619.ko 2023-05-17T11:27:56.953 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1668.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max197.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6639.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6650.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6697.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/mc13783-adc.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/mcp3021.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-05-17T11:27:56.954 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6683.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 114257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775-core.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct7802.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 81849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87360.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87427.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pcf8591.ko 2023-05-17T11:27:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-17T11:27:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 71425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/powr1220.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5627.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5636.ko 2023-05-17T11:27:56.957 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht15.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht21.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/shtc1.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sis5595.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smm665.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47b397.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m1.ko 2023-05-17T11:27:56.958 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m192.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/thmc50.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp102.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp103.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp401.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp421.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via-cputemp.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via686a.ko 2023-05-17T11:27:56.959 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt1211.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt8231.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627ehf.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 78441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627hf.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83781d.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83791d.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83792d.ko 2023-05-17T11:27:56.960 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 100953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83793.ko 2023-05-17T11:27:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 119009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83795.ko 2023-05-17T11:27:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l785ts.ko 2023-05-17T11:27:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l786ng.ko 2023-05-17T11:27:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-05-17T11:27:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/ 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/ 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/ 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-05-17T11:27:56.962 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-17T11:27:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-17T11:27:56.964 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-17T11:27:56.965 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-17T11:27:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-mux.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-smbus.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-stub.ko 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/ 2023-05-17T11:27:56.967 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 264089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 848969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_core.ko 2023-05-17T11:27:56.968 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 68233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 321625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 96473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 271713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/ 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4/ 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 492057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-17T11:27:56.969 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4/ 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 418801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5/ 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 732713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca/ 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 296153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/ocrdma/ 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 153177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-05-17T11:27:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/usnic/ 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 168513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib/ 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 262729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser/ 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 99721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-17T11:27:56.971 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert/ 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 110705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp/ 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 128705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt/ 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 130009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/ 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/evbug.ko 2023-05-17T11:27:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/ff-memless.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/ 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/gameport.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/lightning.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/ns558.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/joydev.ko 2023-05-17T11:27:56.973 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/ 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/lkkbd.ko 2023-05-17T11:27:56.974 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/lm8323.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/lm8333.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/newtonkbd.ko 2023-05-17T11:27:56.975 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/qt1070.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/qt2160.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/stowaway.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/sunkbd.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-05-17T11:27:56.976 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/xtkbd.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/matrix-keymap.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/ 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/appletouch.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/bcm5974.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 122977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/cyapatp.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 88929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-17T11:27:56.977 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/gpio_mouse.ko 2023-05-17T11:27:56.978 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 334073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/psmouse.ko 2023-05-17T11:27:57.033 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/sermouse.ko 2023-05-17T11:27:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-17T11:27:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-17T11:27:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-17T11:27:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4/ 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 107777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/ 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/altera_ps2.ko 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/arc_ps2.ko 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/ct82c710.ko 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-17T11:27:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/parkbd.ko 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/pcips2.ko 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/ps2mult.ko 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/serio_raw.ko 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/serport.ko 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/sparse-keymap.ko 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/ 2023-05-17T11:27:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd/ 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/ 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-88pm860x.ko 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-adp5520.ko 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-bd2802.ko 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-blinkm.ko 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-da903x.ko 2023-05-17T11:27:57.037 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-da9052.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-gpio.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3530.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3533.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm355x.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3642.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lp3944.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lp8788.ko 2023-05-17T11:27:57.038 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-max8997.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-mc13783.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-menf21bmc.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-pca9532.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-pca955x.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-pca963x.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-ss4200.ko 2023-05-17T11:27:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-tca6507.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-wm831x-status.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-wm8350.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-17T11:27:57.040 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/ 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache/ 2023-05-17T11:27:57.041 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 631593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache/bcache.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-bio-prison.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 79553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-bufio.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache-smq.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 153889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 105505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-crypt.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-delay.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-era.ko 2023-05-17T11:27:57.042 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-flakey.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-log-userspace.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-log.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-mirror.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-multipath.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-queue-length.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-raid.ko 2023-05-17T11:27:57.043 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-region-hash.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-round-robin.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-service-time.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 108817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-snapshot.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-switch.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 181193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-thin-pool.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-verity.ko 2023-05-17T11:27:57.044 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-zero.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/faulty.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/linear.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/multipath.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data/ 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 192417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid0.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 111041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid1.ko 2023-05-17T11:27:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 158385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid10.ko 2023-05-17T11:27:57.046 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 391777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid456.ko 2023-05-17T11:27:57.046 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/ 2023-05-17T11:27:57.046 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/ 2023-05-17T11:27:57.046 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 174009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptbase.ko 2023-05-17T11:27:57.046 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptctl.ko 2023-05-17T11:27:57.046 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptfc.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptlan.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 122801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptsas.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 75937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptscsih.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptspi.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/ 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/88pm800.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/88pm805.ko 2023-05-17T11:27:57.047 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/88pm80x.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/arizona-i2c.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 121913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/arizona.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/bcm590xx.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/cros_ec_dev.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/dln2.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/janz-cmodio.ko 2023-05-17T11:27:57.048 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/kempld-core.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lm3533-core.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lp3943.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_ich.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_sch.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/max8907.ko 2023-05-17T11:27:57.049 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/mc13xxx-core.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/menf21bmc.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/pcf50633-adc.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/pcf50633-gpio.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/pcf50633.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/retu-mfd.ko 2023-05-17T11:27:57.050 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 76113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/si476x-core.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/sm501.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/tps65010.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/tps6507x.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/viperboard.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/vx855.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/wl1273-core.ko 2023-05-17T11:27:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/wm8994.ko 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ad525x_dpot.ko 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl/ 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds9802als.ko 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds990x.ko 2023-05-17T11:27:57.052 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/bh1770glc.ko 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/c2port/ 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/c2port/core.ko 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710/ 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710/cb710.ko 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ds1682.ko 2023-05-17T11:27:57.053 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/dummy-irq.ko 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/echo/ 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/echo/echo.ko 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/ 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/at24.ko 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/max6875.ko 2023-05-17T11:27:57.054 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/enclosure.ko 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/genwqe/ 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 151777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/hmc6352.ko 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/hpilo.ko 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ibmasm/ 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ics932s401.ko 2023-05-17T11:27:57.055 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29003.ko 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29020.ko 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/ 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/ 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 123577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-me.ko 2023-05-17T11:27:57.056 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 56017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-txe.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 304113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/phantom.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ti-st/ 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 74113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ti-st/st_drv.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_7xx1.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_core.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tsl2550.ko 2023-05-17T11:27:57.057 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_balloon.ko 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci/ 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 180377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding/ 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 484433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding/bonding.ko 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/ 2023-05-17T11:27:57.058 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53/ 2023-05-17T11:27:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 98553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-17T11:27:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-17T11:27:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-17T11:27:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx/ 2023-05-17T11:27:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 447025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-17T11:27:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dummy.ko 2023-05-17T11:27:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/eql.ko 2023-05-17T11:27:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ 2023-05-17T11:27:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/ 2023-05-17T11:27:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-17T11:27:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-17T11:27:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 130081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 68353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/ 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 98561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec/ 2023-05-17T11:27:57.061 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere/ 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 68713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon/ 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera/ 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-17T11:27:57.062 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/ 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 86849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/ 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx/ 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 97153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-05-17T11:27:57.063 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 104297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 89745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/ 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 80993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 69273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/ 2023-05-17T11:27:57.064 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 176761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1422217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 127561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet/ 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 130553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 311593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-17T11:27:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/ 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna/ 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 323097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/ 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 193001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 345433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-17T11:27:57.066 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1038537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 165945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/ 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic/ 2023-05-17T11:27:57.067 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 203169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/ 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/ 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 68953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 140721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-17T11:27:57.068 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/ 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dnet.ko 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ec_bhf.ko 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/ 2023-05-17T11:27:57.069 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet/ 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 280937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ethoc.ko 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fealnx.ko 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fujitsu/ 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 89969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-17T11:27:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000/ 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 295217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e/ 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 583489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k/ 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 245881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e/ 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 918521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-17T11:27:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf/ 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 301361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb/ 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 513657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf/ 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 92241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb/ 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 124121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-17T11:27:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 733809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 151361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 86417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/jme.ko 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/ 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-17T11:27:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 122185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/ 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 709977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 280081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-05-17T11:27:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1034761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 95169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/ 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-05-17T11:27:57.075 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 108305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/ 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion/ 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 150401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia/ 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 136281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-17T11:27:57.076 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/ 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/ 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 227049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 86585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-05-17T11:27:57.077 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 671353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc/ 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/ 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 66881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 183041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-17T11:27:57.078 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/samsung/ 2023-05-17T11:27:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-05-17T11:27:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 103713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-05-17T11:27:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc/ 2023-05-17T11:27:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 862657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-17T11:27:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan/ 2023-05-17T11:27:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/ 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 62841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/ 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 61041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 66689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-17T11:27:57.080 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 67777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/ 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-05-17T11:27:57.081 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 474905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/ 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 102945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 165841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti/ 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-17T11:27:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti/ 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 86025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/ 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 79761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/ 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 45289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-17T11:27:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom/ 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/ 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/defxx.ko 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/skfp/ 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 216481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/skfp/skfp.ko 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 76673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/geneve.ko 2023-05-17T11:27:57.084 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv/ 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 234841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154/ 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ifb.ko 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan/ 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 82705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvlan.ko 2023-05-17T11:27:57.085 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvtap.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/ 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-gpio.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mii.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/netconsole.ko 2023-05-17T11:27:57.086 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/nlmon.ko 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/ 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/ 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/amd.ko 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-17T11:27:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm87xx.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/broadcom.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/cicada.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/davicom.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/et1011c.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/icplus.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/lxt.ko 2023-05-17T11:27:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 75673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/marvell.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 74585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/micrel.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/national.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 91833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/phylink.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/qsemi.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/realtek.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/smsc.ko 2023-05-17T11:27:57.089 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/ste10Xp.ko 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/vitesse.ko 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/plip/ 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/plip/plip.ko 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_async.ko 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-17T11:27:57.090 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppoe.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppox.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pptp.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/sb1000.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/ 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/slip.ko 2023-05-17T11:27:57.091 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/sungem_phy.ko 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 63113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/tap.ko 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/ 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 104289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team.ko 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-17T11:27:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_random.ko 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 87345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/veth.ko 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3/ 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 120049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan/ 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 238977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan/vxlan.ko 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback/ 2023-05-17T11:27:57.093 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 143305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb/ 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb/ntb.ko 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/ 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/ 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 257665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme-core.ko 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme.ko 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/ 2023-05-17T11:27:57.094 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 128697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport.ko 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_cs.ko 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_pc.ko 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_serial.ko 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/ 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/ 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-05-17T11:27:57.095 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/pci-stub.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/xen-pcifront.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/ 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/i82092.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 143273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pcmcia.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pcmcia_core.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-05-17T11:27:57.096 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pd6729.ko 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 112481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/ 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/broadcom/ 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/samsung/ 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-05-17T11:27:57.097 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/ 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel/ 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/ 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/ 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec.ko 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-05-17T11:27:57.098 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/ 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 66617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acerhdf.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-17T11:27:57.099 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 105897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-17T11:27:57.100 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/hdaps.ko 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/ibm_rtl.ko 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/ 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel_ips.ko 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-17T11:27:57.101 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-17T11:27:57.102 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi.ko 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/ 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/88pm860x_battery.ko 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/88pm860x_charger.ko 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/bq2415x_charger.ko 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/bq24190_charger.ko 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/bq24735-charger.ko 2023-05-17T11:27:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/da9030_battery.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/da9052-battery.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2760_battery.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2780_battery.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2781_battery.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2782_battery.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/gpio-charger.ko 2023-05-17T11:27:57.104 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/isp1704_charger.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/lp8727_charger.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max14577_charger.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max17040_battery.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max17042_battery.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max8903_charger.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max8925_power.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/pcf50633-charger.ko 2023-05-17T11:27:57.105 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/sbs-battery.ko 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/test_power.ko 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/tps65090-charger.ko 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/wm831x_backup.ko 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/wm831x_power.ko 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/wm8350_power.ko 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/ 2023-05-17T11:27:57.106 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/ 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/ 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps_parport.ko 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/pps_core.ko 2023-05-17T11:27:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 64265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp.ko 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp_kvm.ko 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/ 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-88pm80x.ko 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-88pm860x.ko 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-17T11:27:57.108 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-da9052.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-da9055.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-da9063.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 68081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-17T11:27:57.109 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-em3027.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-17T11:27:57.110 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-lp8788.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t86.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max6900.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8907.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8925.ko 2023-05-17T11:27:57.111 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8997.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8998.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-palmas.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf50633.ko 2023-05-17T11:27:57.112 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rc5t583.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-17T11:27:57.113 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-s35390a.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-tps6586x.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-tps65910.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-wm831x.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-wm8350.ko 2023-05-17T11:27:57.114 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-x1205.ko 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-9xxx.ko 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-sas.ko 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-xxxx.ko 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 134673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/BusLogic.ko 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/a100u2w.ko 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid/ 2023-05-17T11:27:57.115 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 271161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 100129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/advansys.ko 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/ 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 355761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 295313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic94xx/ 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 188825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/am53c974.ko 2023-05-17T11:27:57.116 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr/ 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 106065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/atp870u.ko 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi/ 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 246913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa/ 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1172201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa/bfa.ko 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc/ 2023-05-17T11:27:57.117 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 236737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i/ 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 114969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ch.ko 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor/ 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 308401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/ 2023-05-17T11:27:57.118 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 75689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 141417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 75105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dc395x.ko 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dmx3191d.ko 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r/ 2023-05-17T11:27:57.119 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 211977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esp_scsi.ko 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/ 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 154601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fdomain.ko 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic/ 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 262025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic/fnic.ko 2023-05-17T11:27:57.120 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 201305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hpsa.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hptiop.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hv_storvsc.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/imm.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/initio.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 285985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ipr.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ips.ko 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci/ 2023-05-17T11:27:57.121 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 316817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci/isci.ko 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc/ 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 307873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc/libfc.ko 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 139737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi.ko 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas/ 2023-05-17T11:27:57.122 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 212217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas/libsas.ko 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc/ 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 2194601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/ 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 73113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 310241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 84289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid.ko 2023-05-17T11:27:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas/ 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 659569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas/ 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 119425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvumi.ko 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/ 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 81113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-05-17T11:27:57.124 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001/ 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 360881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 123073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pmcraid.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ppa.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla1280.ko 2023-05-17T11:27:57.125 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/ 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1850553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 85353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx/ 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 558737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qlogicfas408.ko 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/raid_class.ko 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 242441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_debug.ko 2023-05-17T11:27:57.126 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 171561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 270153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 94049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ses.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 115409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/st.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/stex.ko 2023-05-17T11:27:57.127 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2/ 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 161697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/virtio_scsi.ko 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/wd719x.ko 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/xen-scsifront.ko 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb/ 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 126593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb/ssb.ko 2023-05-17T11:27:57.128 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/ 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi/ 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 730161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback/ 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_file.ko 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_iblock.ko 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 913305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_mod.ko 2023-05-17T11:27:57.129 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_pscsi.ko 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 121793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_user.ko 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc/ 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 75905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/ 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/ 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/ 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-17T11:27:57.130 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-17T11:27:57.131 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_menlow.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-17T11:27:57.132 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless/ 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/moxa.ko 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/mxser.ko 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 104345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_gsm.ko 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_hdlc.ko 2023-05-17T11:27:57.133 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 67641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/nozomi.ko 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/ 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/ 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/altera_uart.ko 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/arc_uart.ko 2023-05-17T11:27:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 69793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm/ 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 102521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/rp2.ko 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 51705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/sc16is7xx.ko 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 99985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/synclink_gt.ko 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/ 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core/ 2023-05-17T11:27:57.135 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 518025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/ 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio.ko 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_aec.ko 2023-05-17T11:27:57.136 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_cif.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_dmem_genirq.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_mf624.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_netx.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_pci_generic.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_sercos3.ko 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/ 2023-05-17T11:27:57.137 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/c67x00/ 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/c67x00/c67x00.ko 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 144897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/ 2023-05-17T11:27:57.138 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 85025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-acm.ko 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usblp.ko 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 89409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usbtmc.ko 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/common/ 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/common/ulpi.ko 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc2/ 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-05-17T11:27:57.139 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/ 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 433729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/dwc3.ko 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/ 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/ 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/u_ether.ko 2023-05-17T11:27:57.140 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/u_serial.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 90825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 117593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-05-17T11:27:57.141 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 83697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 58001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 67913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-05-17T11:27:57.142 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/ 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-05-17T11:27:57.143 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 61665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 154617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/libcomposite.ko 2023-05-17T11:27:57.144 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/ 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/bdc/ 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 157161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 69193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-05-17T11:27:57.145 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 55473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 75545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/net2272.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 74529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/net2280.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 79913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 139729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-05-17T11:27:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/ 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/bcma-hcd.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 79529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/isp116x-hcd.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 87185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 78425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/sl811_cs.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/ssb-hcd.ko 2023-05-17T11:27:57.147 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 92241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/u132-hcd.ko 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/ 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/mdc800.ko 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/microtek.ko 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/adutux.ko 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/appledisplay.ko 2023-05-17T11:27:57.148 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/cytherm.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ehset.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi26.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi62.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ezusb.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 73217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/idmouse.ko 2023-05-17T11:27:57.149 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/iowarrior.ko 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ldusb.ko 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/legousbtower.ko 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/lvstest.ko 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga/ 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 64033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-17T11:27:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usb3503.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usblcd.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usbtest.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/uss720.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/yurex.ko 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/mon/ 2023-05-17T11:27:57.151 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/mon/usbmon.ko 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/musb/ 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 294641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/musb/musb_hdrc.ko 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/ 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-generic.ko 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-isp1301.ko 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-tahvo.ko 2023-05-17T11:27:57.152 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/aircable.ko 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ark3116.ko 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ch341.ko 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 69601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cp210x.ko 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cyberjack.ko 2023-05-17T11:27:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/empeg.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/f81232.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 174409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 136441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 123961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_ti.ko 2023-05-17T11:27:57.154 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 67329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipaq.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipw.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ir-usb.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 106985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-17T11:27:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mct_u232.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/metro-usb.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7720.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 77673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7840.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 55569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mxuport.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/navman.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/omninet.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/opticon.ko 2023-05-17T11:27:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 187217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/option.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/oti6858.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/pl2303.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcaux.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcserial.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/quatech2.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/safe_serial.ko 2023-05-17T11:27:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 50865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/sierra.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ssu100.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/symbolserial.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_debug.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-17T11:27:57.158 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 122417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usbserial.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/visor.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/whiteheat.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/wishbone-serial.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/uas.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-17T11:27:57.159 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-karma.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-17T11:27:57.160 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 176329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/usb-storage.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/ 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 71009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-17T11:27:57.161 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 104905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/ 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/ 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 145057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 97561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio.ko 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 71257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/ 2023-05-17T11:27:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 98209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost.ko 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_net.ko 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 86785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_scsi.ko 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/ 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/ 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-05-17T11:27:57.163 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/aat2870_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/adp5520_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/adp8860_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/adp8870_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/apple_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/as3711_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/bd6107.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/da903x_bl.ko 2023-05-17T11:27:57.164 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/da9052_bl.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/gpio_backlight.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/kb3886_bl.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lcd.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lm3533_bl.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lm3639_bl.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lv5207lp.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/max8925_bl.ko 2023-05-17T11:27:57.165 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/pandora_bl.ko 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/wm831x_bl.ko 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/ 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2482.ko 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2490.ko 2023-05-17T11:27:57.166 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/matrox_w1.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/w1-gpio.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/ 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-17T11:27:57.167 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 55993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/wire.ko 2023-05-17T11:27:57.168 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/acquirewdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/advantechwdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/cpu5wdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/da9052_wdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/da9055_wdt.ko 2023-05-17T11:27:57.169 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/da9063_wdt.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/dw_wdt.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/eurotechwdt.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/hpwdt.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/i6300esb.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-17T11:27:57.170 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ib700wdt.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ibmasr.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it87_wdt.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/kempld_wdt.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/machzwd.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/mena21_wdt.ko 2023-05-17T11:27:57.171 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/nv_tco.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pc87413_wdt.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/retu_wdt.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-05-17T11:27:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sc1200wdt.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/softdog.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-17T11:27:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/twl4030_wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/via_wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wafer5823wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wdt_pci.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wm831x_wdt.ko 2023-05-17T11:27:57.174 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wm8350_wdt.ko 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/xen_wdt.ko 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/ 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-evtchn.ko 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntalloc.ko 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntdev.ko 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback/ 2023-05-17T11:27:57.175 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 176105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-privcmd.ko 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 71449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-scsiback.ko 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs/ 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p/ 2023-05-17T11:27:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 171305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p/9p.ko 2023-05-17T11:27:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/adfs/ 2023-05-17T11:27:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/adfs/adfs.ko 2023-05-17T11:27:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs/ 2023-05-17T11:27:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 162241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs/affs.ko 2023-05-17T11:27:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/afs/ 2023-05-17T11:27:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 924521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/afs/kafs.ko 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/autofs/ 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 100321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/autofs/autofs4.ko 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs/ 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 63977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs/befs.ko 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/bfs/ 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/bfs/bfs.ko 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/binfmt_misc.ko 2023-05-17T11:27:57.178 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs/ 2023-05-17T11:27:57.179 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 3475873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs/btrfs.ko 2023-05-17T11:27:57.208 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles/ 2023-05-17T11:27:57.208 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 299529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles/cachefiles.ko 2023-05-17T11:27:57.208 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph/ 2023-05-17T11:27:57.208 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1229209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph/ceph.ko 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs/ 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 2614625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs/cifs.ko 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda/ 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 99153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda/coda.ko 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/configfs/ 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 105385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/configfs/configfs.ko 2023-05-17T11:27:57.209 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs/ 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs/cramfs.ko 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm/ 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 624153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm/dlm.ko 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/efs/ 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/efs/efs.ko 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs/ 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1470857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs/f2fs.ko 2023-05-17T11:27:57.210 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/ 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/msdos.ko 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/freevxfs/ 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 41961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/freevxfs/freevxfs.ko 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache/ 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 218289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache/fscache.ko 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/ 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/cuse.ko 2023-05-17T11:27:57.211 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2/ 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1222241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2/gfs2.ko 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs/ 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 140857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs/hfs.ko 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus/ 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 220953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus/hfsplus.ko 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hpfs/ 2023-05-17T11:27:57.212 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 193145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hpfs/hpfs.ko 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs/ 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 73961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs/isofs.ko 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs/ 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 418945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs/jfs.ko 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd/ 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 254633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd/lockd.ko 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix/ 2023-05-17T11:27:57.213 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 87417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix/minix.ko 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs/ 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 128313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs/netfs.ko 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/ 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout/ 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 81025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout/ 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 58929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-17T11:27:57.214 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout/ 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 117209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1016665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfs.ko 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv2.ko 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 119217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv3.ko 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 2003553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv4.ko 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/ 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/grace.ko 2023-05-17T11:27:57.215 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/nfs_acl.ko 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd/ 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1400409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd/nfsd.ko 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2/ 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 587089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2/nilfs2.ko 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/ 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-celtic.ko 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-centeuro.ko 2023-05-17T11:27:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-croatian.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-cyrillic.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-gaelic.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-greek.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-iceland.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-inuit.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-roman.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-romanian.ko 2023-05-17T11:27:57.217 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-turkish.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_ascii.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1250.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1251.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1255.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp737.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp775.ko 2023-05-17T11:27:57.218 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp850.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp852.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp855.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp857.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp860.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp861.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp862.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp863.ko 2023-05-17T11:27:57.219 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp864.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp865.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp866.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp869.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp874.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 93649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp932.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 142185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp936.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 165257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp949.ko 2023-05-17T11:27:57.220 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 117625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp950.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_euc-jp.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-1.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-13.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-14.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-15.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-2.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-3.ko 2023-05-17T11:27:57.221 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-4.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-5.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-6.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-7.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-9.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-r.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-ru.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-u.ko 2023-05-17T11:27:57.222 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_utf8.ko 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ntfs/ 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 218585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ntfs/ntfs.ko 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster/ 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 240737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm/ 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 439201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-17T11:27:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs/ 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 2510441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2.ko 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/omfs/ 2023-05-17T11:27:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 52145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/omfs/omfs.ko 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs/ 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 320649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs/overlay.ko 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore/ 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore/ramoops.ko 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx4/ 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx4/qnx4.ko 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx6/ 2023-05-17T11:27:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx6/qnx6.ko 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/ 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/quota_tree.ko 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/quota_v1.ko 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/quota_v2.ko 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs/ 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 527801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs/reiserfs.ko 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs/ 2023-05-17T11:27:57.226 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs/romfs.ko 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/ 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs/ 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 131193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs/squashfs.ko 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv/ 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 88441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv/sysv.ko 2023-05-17T11:27:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf/ 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 247873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf/udf.ko 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs/ 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 160129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs/ufs.ko 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs/ 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 3829249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs/xfs.ko 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/ 2023-05-17T11:27:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/locking/ 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/locking/locktorture.ko 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/time/ 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/time/test_udelay.ko 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 55009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/torture.ko 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc-itu-t.ko 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 5729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc7.ko 2023-05-17T11:27:57.229 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc8.ko 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/ 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libarc4.ko 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libdes.ko 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/interval_tree_test.ko 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/libcrc32c.ko 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lru_cache.ko 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/ 2023-05-17T11:27:57.230 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4_compress.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4hc_compress.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/math/ 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 5897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/math/cordic.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/memory-notifier-error-inject.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/notifier-error-inject.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/percpu_test.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/pm-notifier-error-inject.ko 2023-05-17T11:27:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6/ 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 141873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6/raid6_pq.ko 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/rbtree_test.ko 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon/ 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test-kstrtox.ko 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test-string_helpers.ko 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 4760329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_bpf.ko 2023-05-17T11:27:57.232 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 48057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_firmware.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 5873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_module.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_user_copy.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_bm.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_fsm.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_kmp.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/xz/ 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/xz/xz_dec_test.ko 2023-05-17T11:27:57.233 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/mm/ 2023-05-17T11:27:57.234 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/mm/hwpoison-inject.ko 2023-05-17T11:27:57.234 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ 2023-05-17T11:27:57.234 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/ 2023-05-17T11:27:57.234 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/6lowpan.ko 2023-05-17T11:27:57.234 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_dest.ko 2023-05-17T11:27:57.234 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_fragment.ko 2023-05-17T11:27:57.235 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_hop.ko 2023-05-17T11:27:57.235 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_mobility.ko 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_routing.ko 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_udp.ko 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/ 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/garp.ko 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/mrp.ko 2023-05-17T11:27:57.236 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/p8022.ko 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/psnap.ko 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/stp.ko 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q/ 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 80641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q/8021q.ko 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/ 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 191305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet.ko 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_fd.ko 2023-05-17T11:27:57.237 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_rdma.ko 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_virtio.ko 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv/ 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 652281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv/batman-adv.ko 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/ 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 63505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/br_netfilter.ko 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 772145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/bridge.ko 2023-05-17T11:27:57.238 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-17T11:27:57.239 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-17T11:27:57.240 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 73961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtables.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-17T11:27:57.241 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph/ 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1029769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph/libceph.ko 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/core/ 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 124297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/core/pktgen.ko 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/ 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 188577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp.ko 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_diag.ko 2023-05-17T11:27:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 55633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv4.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 58905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv6.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/ 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 274753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/dsa_core.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_brcm.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_dsa.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_none.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_trailer.ko 2023-05-17T11:27:57.243 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/hsr/ 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 99385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/hsr/hsr.ko 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan/ 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 245489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154.ko 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ 2023-05-17T11:27:57.244 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ah4.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/esp4.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/fou.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/gre.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/inet_diag.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 59737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_gre.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_tunnel.ko 2023-05-17T11:27:57.245 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_vti.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipcomp.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipip.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ip_tables.ko 2023-05-17T11:27:57.246 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-17T11:27:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-05-17T11:27:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_bic.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_dctcp.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_diag.ko 2023-05-17T11:27:57.249 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_highspeed.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_htcp.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_hybla.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_illinois.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_lp.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_scalable.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_vegas.ko 2023-05-17T11:27:57.250 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_veno.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_westwood.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_yeah.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tunnel4.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_diag.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_tunnel.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-17T11:27:57.251 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ah6.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/esp6.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/fou6.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 80297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_gre.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 90857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_tunnel.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_vti.ko 2023-05-17T11:27:57.252 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ipcomp6.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/mip6.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-17T11:27:57.253 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-17T11:27:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 37929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-17T11:27:57.255 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 72545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/sit.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/tunnel6.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-17T11:27:57.256 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/key/ 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 82505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/key/af_key.ko 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/ 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 120265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_core.ko 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_eth.ko 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 34969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip.ko 2023-05-17T11:27:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip6.ko 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_netlink.ko 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 53057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ppp.ko 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/lapb/ 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 46641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/lapb/lapb.ko 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/ 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/llc.ko 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 266497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/llc2.ko 2023-05-17T11:27:57.258 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154/ 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 279905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154/mac802154.ko 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls/ 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls/mpls_gso.ko 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 116641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set.ko 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-17T11:27:57.259 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 102681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 104097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 104697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 113953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 60665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-17T11:27:57.260 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 110721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 114241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 113889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 112713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 115777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 410073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-17T11:27:57.261 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-17T11:27:57.262 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 47601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conncount.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 396769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-17T11:27:57.263 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 117313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 107825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-17T11:27:57.264 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 65305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 86233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_log_syslog.ko 2023-05-17T11:27:57.265 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 91201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_irc.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_sip.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 575513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_tables.ko 2023-05-17T11:27:57.266 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 42137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_log.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 21729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 49001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_chain_nat.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_compat.ko 2023-05-17T11:27:57.267 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 40217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_ct.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fib.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_hash.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_limit.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_log.ko 2023-05-17T11:27:57.268 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_masq.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_nat.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_numgen.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_osf.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_queue.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_redir.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject_inet.ko 2023-05-17T11:27:57.269 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_socket.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_synproxy.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_tproxy.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 98833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/x_tables.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_AUDIT.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-17T11:27:57.270 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 17809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CT.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_DSCP.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HL.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HMARK.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 38513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LED.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LOG.ko 2023-05-17T11:27:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NETMAP.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFLOG.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_RATEEST.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_SECMARK.ko 2023-05-17T11:27:57.272 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TEE.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TPROXY.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TRACE.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_addrtype.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_bpf.ko 2023-05-17T11:27:57.273 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cgroup.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cluster.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_comment.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connbytes.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlabel.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlimit.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connmark.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_conntrack.ko 2023-05-17T11:27:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cpu.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dccp.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_devgroup.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dscp.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ecn.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_esp.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hashlimit.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_helper.ko 2023-05-17T11:27:57.275 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hl.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipcomp.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_iprange.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipvs.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_l2tp.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_length.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_limit.ko 2023-05-17T11:27:57.276 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mac.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mark.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_multiport.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nat.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nfacct.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_osf.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_owner.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_physdev.ko 2023-05-17T11:27:57.277 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_pkttype.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_policy.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_quota.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_rateest.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_realm.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_recent.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_sctp.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_set.ko 2023-05-17T11:27:57.278 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_socket.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_state.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_statistic.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_string.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_tcpmss.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_tcpudp.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_time.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_u32.ko 2023-05-17T11:27:57.279 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink/ 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 13417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink/netlink_diag.ko 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh/ 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh/nsh.ko 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/ 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 377353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/openvswitch.ko 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-geneve.ko 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-gre.ko 2023-05-17T11:27:57.280 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 11297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-vxlan.ko 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/packet/ 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/packet/af_packet_diag.ko 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/phonet/ 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 109633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/phonet/phonet.ko 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 54353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/phonet/pn_pep.ko 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/ 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 248545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds.ko 2023-05-17T11:27:57.281 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 164641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_rdma.ko 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 66441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_tcp.ko 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rxrpc/ 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 805849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rxrpc/rxrpc.ko 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/ 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_csum.ko 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_gact.ko 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 25185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_ipt.ko 2023-05-17T11:27:57.282 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_mirred.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_nat.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 39593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_pedit.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 31561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_police.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_simple.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_skbedit.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 35625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_vlan.ko 2023-05-17T11:27:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_basic.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_bpf.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_cgroup.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_flow.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_fw.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 36793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_route.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 57985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_u32.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_cmp.ko 2023-05-17T11:27:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 12969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_ipset.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_meta.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 7393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_nbyte.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_text.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 6753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_u32.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_choke.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_codel.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 30441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_drr.ko 2023-05-17T11:27:57.285 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 29913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_fq.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_fq_codel.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 32145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_gred.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 44345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hfsc.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hhf.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 63001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_htb.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_ingress.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio.ko 2023-05-17T11:27:57.286 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio_lib.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_multiq.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 33329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_netem.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 23497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_pie.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_plug.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_prio.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 43969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_qfq.ko 2023-05-17T11:27:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 28697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_red.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 24881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfb.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 27985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfq.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_tbf.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 26857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_teql.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/ 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 920945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 18601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp_diag.ko 2023-05-17T11:27:57.288 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/ 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/ 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 327521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 61329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 1405641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/sunrpc.ko 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma/ 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 681905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/ 2023-05-17T11:27:57.289 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 9593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/diag.ko 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 853201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/tipc.ko 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/unix/ 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 15233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/unix/unix_diag.ko 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/ 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 78425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 67537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 82401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock.ko 2023-05-17T11:27:57.290 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 16713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/x25/ 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 124593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/x25/x25.ko 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/ 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 20793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_algo.ko 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 19745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-17T11:27:57.291 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 101145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_user.ko 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/virt/ 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib/ 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 14433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib/irqbypass.ko 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 636465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.alias 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 622282 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.alias.bin 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 8260 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 22530 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin.alias.bin 2023-05-17T11:27:57.292 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 10532 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin.bin 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 70097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin.modinfo 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 146789 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.dep 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 233606 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.dep.bin 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 210 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.devname 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 73038 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.order 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 879 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.softdep 2023-05-17T11:27:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 251751 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.symbols 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 306320 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.symbols.bin 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/ 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/share/ 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/share/doc/ 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/share/doc/linux-image-6.3.0-g2bcb17939031/ 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 170 2023-05-17 05:52 ./usr/share/doc/linux-image-6.3.0-g2bcb17939031/changelog.Debian.gz 2023-05-17T11:27:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r-- root/root 691 2023-05-17 05:52 ./usr/share/doc/linux-image-6.3.0-g2bcb17939031/copyright 2023-05-17T11:27:57.295 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g2bcb17939031 2023-05-17T11:27:57.296 INFO:teuthology.task.kernel:searching for kernel 6.3.0-g2bcb17939031 2023-05-17T11:27:57.296 DEBUG:teuthology.orchestra.run.smithi060:> egrep '(submenu|menuentry.*6.3.0-g2bcb17939031).*{' /boot/grub/grub.cfg 2023-05-17T11:27:57.303 INFO:teuthology.orchestra.run.smithi060.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-17T11:27:57.303 INFO:teuthology.orchestra.run.smithi060.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g2bcb17939031' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g2bcb17939031-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-17T11:27:57.303 INFO:teuthology.orchestra.run.smithi060.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g2bcb17939031 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g2bcb17939031-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-17T11:27:57.304 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-05-17T11:27:57.304 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-g2bcb17939031 2023-05-17T11:27:57.304 DEBUG:teuthology.orchestra.run.smithi060:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-05-17T11:27:57.348 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi060.front.sepia.ceph.com to complete... 2023-05-17T11:27:57.820 INFO:teuthology.orchestra.run.smithi060.stderr:Sourcing file `/etc/default/grub' 2023-05-17T11:27:57.821 INFO:teuthology.orchestra.run.smithi060.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-17T11:27:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2023-05-17T11:27:58.047 INFO:teuthology.orchestra.run.smithi060.stderr:Found linux image: /boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T11:27:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:Found initrd image: /boot/initrd.img-6.3.0-g2bcb17939031 2023-05-17T11:27:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-17T11:27:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-17T11:27:58.366 INFO:teuthology.orchestra.run.smithi060.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-17T11:27:58.371 INFO:teuthology.orchestra.run.smithi060.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-17T11:27:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-17T11:27:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-17T11:27:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-17T11:27:58.521 INFO:teuthology.orchestra.run.smithi060.stderr:done 2023-05-17T11:27:59.228 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub' 2023-05-17T11:27:59.237 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-17T11:27:59.261 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2023-05-17T11:27:59.578 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T11:27:59.594 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-6.3.0-g2bcb17939031 2023-05-17T11:27:59.888 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-17T11:27:59.896 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-17T11:27:59.963 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-17T11:27:59.971 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-17T11:28:00.129 INFO:teuthology.orchestra.run.smithi003.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-17T11:28:00.129 INFO:teuthology.orchestra.run.smithi003.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-17T11:28:00.129 INFO:teuthology.orchestra.run.smithi003.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-17T11:28:00.166 INFO:teuthology.orchestra.run.smithi003.stderr:done 2023-05-17T11:28:00.389 DEBUG:teuthology.orchestra.run.smithi003:> dpkg-deb -c /tmp/linux-image.deb 2023-05-17T11:28:00.397 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./ 2023-05-17T11:28:00.397 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./boot/ 2023-05-17T11:28:00.398 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 4289818 2023-05-17 05:52 ./boot/System.map-6.3.0-g2bcb17939031 2023-05-17T11:28:00.410 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 166933 2023-05-17 05:52 ./boot/config-6.3.0-g2bcb17939031 2023-05-17T11:28:00.410 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11175936 2023-05-17 05:52 ./boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T11:28:00.430 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/ 2023-05-17T11:28:00.430 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/ 2023-05-17T11:28:00.430 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/postinst.d/ 2023-05-17T11:28:00.430 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/postrm.d/ 2023-05-17T11:28:00.430 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/preinst.d/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./etc/kernel/prerm.d/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/ 2023-05-17T11:28:00.431 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/ 2023-05-17T11:28:00.432 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/ 2023-05-17T11:28:00.432 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 527241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/aesni-intel.ko 2023-05-17T11:28:00.434 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-17T11:28:00.434 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 88441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 100081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 142185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-17T11:28:00.435 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 78905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 58273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-17T11:28:00.436 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/ 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/ 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce/ 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpuid.ko 2023-05-17T11:28:00.437 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/msr.ko 2023-05-17T11:28:00.438 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/ 2023-05-17T11:28:00.438 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 342897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-17T11:28:00.438 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 971009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-17T11:28:00.454 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 2208345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm.ko 2023-05-17T11:28:00.455 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ 2023-05-17T11:28:00.455 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 55889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/af_alg.ko 2023-05-17T11:28:00.455 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/algif_hash.ko 2023-05-17T11:28:00.455 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/algif_skcipher.ko 2023-05-17T11:28:00.456 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ansi_cprng.ko 2023-05-17T11:28:00.456 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/anubis.ko 2023-05-17T11:28:00.456 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/arc4.ko 2023-05-17T11:28:00.457 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/asymmetric_keys/ 2023-05-17T11:28:00.457 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-05-17T11:28:00.457 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/ 2023-05-17T11:28:00.457 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_memcpy.ko 2023-05-17T11:28:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_pq.ko 2023-05-17T11:28:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-17T11:28:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_tx.ko 2023-05-17T11:28:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_xor.ko 2023-05-17T11:28:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/raid6test.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authenc.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authencesn.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blake2b_generic.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_common.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_generic.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/camellia_generic.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast5_generic.ko 2023-05-17T11:28:00.459 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast6_generic.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast_common.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ccm.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cmac.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crc32_generic.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cryptd.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_engine.ko 2023-05-17T11:28:00.460 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_simd.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_user.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cts.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/des_generic.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/dh_generic.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/echainiv.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/essiv.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/fcrypt.ko 2023-05-17T11:28:00.461 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/khazad.ko 2023-05-17T11:28:00.462 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lrw.ko 2023-05-17T11:28:00.462 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4.ko 2023-05-17T11:28:00.462 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4hc.ko 2023-05-17T11:28:00.462 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/md4.ko 2023-05-17T11:28:00.462 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/michael_mic.ko 2023-05-17T11:28:00.462 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcbc.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcrypt.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/rmd160.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/seed.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/serpent_generic.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 148761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tcrypt.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tea.ko 2023-05-17T11:28:00.463 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_common.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_generic.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/vmac.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/wp512.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xcbc.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xor.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xts.ko 2023-05-17T11:28:00.464 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xxhash_generic.ko 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/ 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_extlog.ko 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_pad.ko 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/apei/ 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/apei/einj.ko 2023-05-17T11:28:00.465 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/ec_sys.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/platform_profile.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbs.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbshc.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/video.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/acard-ahci.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 88185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ahci.ko 2023-05-17T11:28:00.466 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ahci_platform.ko 2023-05-17T11:28:00.467 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 84753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/libahci.ko 2023-05-17T11:28:00.467 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/libahci_platform.ko 2023-05-17T11:28:00.467 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_acpi.ko 2023-05-17T11:28:00.467 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ali.ko 2023-05-17T11:28:00.467 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_amd.ko 2023-05-17T11:28:00.467 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_artop.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atiixp.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atp867x.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd640.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd64x.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cypress.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_efar.ko 2023-05-17T11:28:00.468 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt366.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt37x.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it8213.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it821x.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_jmicron.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_legacy.ko 2023-05-17T11:28:00.469 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_marvell.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_mpiix.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_netcell.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ninja32.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87410.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87415.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_oldpiix.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_opti.ko 2023-05-17T11:28:00.470 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_optidma.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pcmcia.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_piccolo.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_radisys.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_rdc.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_rz1000.ko 2023-05-17T11:28:00.471 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sch.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_serverworks.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sil680.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sl82c105.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_triflex.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_via.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pdc_adma.ko 2023-05-17T11:28:00.472 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_inic162x.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 82793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_mv.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_nv.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_promise.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_qstor.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil24.ko 2023-05-17T11:28:00.473 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sis.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_svw.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sx4.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_uli.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_via.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_vsc.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay/ 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay/ks0108.ko 2023-05-17T11:28:00.474 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma/ 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 121249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma/bcma.ko 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/ 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe/ 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 113145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe/aoe.ko 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd/ 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 963089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd/drbd.ko 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 172809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/floppy.ko 2023-05-17T11:28:00.475 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx/ 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 93865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 113657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/nbd.ko 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk/ 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 110513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk/null_blk.ko 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 81753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/pktcdvd.ko 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 253977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/rbd.ko 2023-05-17T11:28:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback/ 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 97705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram/ 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram/zram.ko 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/applicom.ko 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hangcheck-timer.ko 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/ 2023-05-17T11:28:00.477 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/via-rng.ko 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-17T11:28:00.478 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 147745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-17T11:28:00.479 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-17T11:28:00.479 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 138561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-17T11:28:00.479 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-17T11:28:00.479 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-17T11:28:00.508 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/lp.ko 2023-05-17T11:28:00.508 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave/ 2023-05-17T11:28:00.508 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave/mwave.ko 2023-05-17T11:28:00.508 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/nvram.ko 2023-05-17T11:28:00.508 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/ 2023-05-17T11:28:00.508 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 102457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ppdev.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tlclk.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/ 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-05-17T11:28:00.509 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/ 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/xillybus_class.ko 2023-05-17T11:28:00.510 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/xillybus_core.ko 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/ 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-palmas.ko 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-si5351.ko 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-twl6040.ko 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/clk/clk-wm831x.ko 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/ 2023-05-17T11:28:00.511 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 223113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp.ko 2023-05-17T11:28:00.512 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-aes.ko 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-sha.ko 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/ 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common/ 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 397793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio/ 2023-05-17T11:28:00.513 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 68121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca/ 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca/dca.ko 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw/ 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat/ 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 122841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-17T11:28:00.514 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/ 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 73761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/amd64_edac.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/e752x_edac.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/edac_mce_amd.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3000_edac.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3200_edac.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5100_edac.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5400_edac.ko 2023-05-17T11:28:00.515 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7300_edac.ko 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7core_edac.ko 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i82975x_edac.ko 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/ie31200_edac.ko 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 56369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/sb_edac.ko 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/x38_edac.ko 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/ 2023-05-17T11:28:00.516 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-gpio.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-max14577.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-max77693.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-max8997.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-palmas.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-rt8973a.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/extcon/extcon-sm5502.ko 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/ 2023-05-17T11:28:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/dmi-sysfs.ko 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/efi/ 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/efi/efi-pstore.ko 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/ 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-adp5520.ko 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-amd8111.ko 2023-05-17T11:28:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-arizona.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-da9052.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-da9055.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-dln2.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-f7188x.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-generic.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-ich.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-05-17T11:28:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-kempld.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-lp3943.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-max7300.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-max730x.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-max732x.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-pca953x.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-pcf857x.ko 2023-05-17T11:28:00.520 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-rdc321x.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-sch.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-sch311x.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-tps65912.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-twl4030.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-twl6040.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-17T11:28:00.521 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-vx855.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-wm831x.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-wm8350.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-wm8994.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/ 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-a4tech.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-apple.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-appleir.ko 2023-05-17T11:28:00.522 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-aureal.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-axff.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-belkin.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-cherry.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-chicony.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 58641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-cp2112.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-cypress.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-dr.ko 2023-05-17T11:28:00.523 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elecom.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elo.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-emsff.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ezkey.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gaff.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-generic.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gt683r.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gyration.ko 2023-05-17T11:28:00.524 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtekff.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-hyperv.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-icade.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-kensington.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-keytouch.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-kye.ko 2023-05-17T11:28:00.525 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lcpower.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-led.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lenovo.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lg-g15.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 94481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 80569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech.ko 2023-05-17T11:28:00.526 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-magicmouse.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-microsoft.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-monterey.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-multitouch.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ntrig.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ortek.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-penmount.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-petalynx.ko 2023-05-17T11:28:00.527 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-picolcd.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-pl.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-plantronics.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-primax.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-rmi.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-common.ko 2023-05-17T11:28:00.528 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-17T11:28:00.529 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-17T11:28:00.529 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-17T11:28:00.529 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-17T11:28:00.529 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-17T11:28:00.529 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-17T11:28:00.529 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-saitek.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-samsung.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sjoy.ko 2023-05-17T11:28:00.530 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sony.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-speedlink.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-steelseries.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sunplus.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tivo.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tmff.ko 2023-05-17T11:28:00.531 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-topseed.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-twinhan.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 71017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-uclogic.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-waltop.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 143097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-wiimote.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-xinmo.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zpff.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zydacron.ko 2023-05-17T11:28:00.532 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 260737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid.ko 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/uhid.ko 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/ 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 124897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/usbhid.ko 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/usbkbd.ko 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/usbhid/usbmouse.ko 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 215033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/wacom.ko 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/ 2023-05-17T11:28:00.533 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_balloon.ko 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 89177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_utils.ko 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 296369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_vmbus.ko 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 66169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru.ko 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru3.ko 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-17T11:28:00.534 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7414.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7418.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adc128d818.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1025.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 97537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1026.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1029.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1031.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm9240.ko 2023-05-17T11:28:00.535 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ads7828.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7410.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7411.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 74009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7462.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7470.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 64393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7475.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7x10.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/amc6821.ko 2023-05-17T11:28:00.536 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/applesmc.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asb100.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 58113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asc7621.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/atxp1.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/coretemp.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/da9052-hwmon.ko 2023-05-17T11:28:00.537 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/da9055-hwmon.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 99161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dme1737.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds1621.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds620.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc1403.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc2103.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc6w201.ko 2023-05-17T11:28:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 66481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71805f.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 94153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71882fg.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f75375s.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fam15h_power.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fschmd.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g760a.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g762.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl518sm.ko 2023-05-17T11:28:00.539 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl520sm.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/hih6130.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5500_temp.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5k_amb.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmaem.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmpex.ko 2023-05-17T11:28:00.540 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina209.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina2xx.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 125729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/it87.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/jc42.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k10temp.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k8temp.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lineage-pem.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm63.ko 2023-05-17T11:28:00.541 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm73.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm75.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm77.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm78.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm80.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm83.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm85.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm87.ko 2023-05-17T11:28:00.542 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm90.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm92.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 108401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm93.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95234.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95241.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95245.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc2945.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4151.ko 2023-05-17T11:28:00.543 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4215.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4222.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4245.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4260.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4261.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max16065.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1619.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1668.ko 2023-05-17T11:28:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max197.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6639.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6650.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6697.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/mc13783-adc.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/mcp3021.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-05-17T11:28:00.545 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6683.ko 2023-05-17T11:28:00.546 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 114257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775-core.ko 2023-05-17T11:28:00.546 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775.ko 2023-05-17T11:28:00.546 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct7802.ko 2023-05-17T11:28:00.546 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 81849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87360.ko 2023-05-17T11:28:00.546 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87427.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pcf8591.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-17T11:28:00.547 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 71425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/powr1220.ko 2023-05-17T11:28:00.548 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5627.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5636.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht15.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht21.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/shtc1.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sis5595.ko 2023-05-17T11:28:00.549 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smm665.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47b397.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m1.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m192.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/thmc50.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp102.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp103.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp401.ko 2023-05-17T11:28:00.550 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp421.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via-cputemp.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via686a.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt1211.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt8231.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627ehf.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 78441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627hf.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83781d.ko 2023-05-17T11:28:00.551 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83791d.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83792d.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 100953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83793.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 119009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83795.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l785ts.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l786ng.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-05-17T11:28:00.552 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/ 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/ 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/ 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-05-17T11:28:00.553 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-17T11:28:00.554 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-17T11:28:00.555 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-05-17T11:28:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-17T11:28:00.557 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-mux.ko 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-smbus.ko 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-stub.ko 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/ 2023-05-17T11:28:00.558 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 264089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 848969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_core.ko 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 68233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-17T11:28:00.559 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 321625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 96473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 271713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/ 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4/ 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 492057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4/ 2023-05-17T11:28:00.560 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 418801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5/ 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 732713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca/ 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 296153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/ocrdma/ 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 153177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/usnic/ 2023-05-17T11:28:00.561 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 168513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib/ 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 262729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser/ 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 99721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert/ 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 110705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-17T11:28:00.562 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp/ 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 128705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt/ 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 130009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/ 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/evbug.ko 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/ff-memless.ko 2023-05-17T11:28:00.563 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/ 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/gameport.ko 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/lightning.ko 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/ns558.ko 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/joydev.ko 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/ 2023-05-17T11:28:00.564 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/lkkbd.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/lm8323.ko 2023-05-17T11:28:00.565 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/lm8333.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/newtonkbd.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-05-17T11:28:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/qt1070.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/qt2160.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/stowaway.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/sunkbd.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-05-17T11:28:00.567 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/xtkbd.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/matrix-keymap.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/ 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/appletouch.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/bcm5974.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 122977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/cyapatp.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 88929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/gpio_mouse.ko 2023-05-17T11:28:00.568 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 334073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/psmouse.ko 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/sermouse.ko 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4/ 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 107777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/ 2023-05-17T11:28:00.569 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/altera_ps2.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/arc_ps2.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/ct82c710.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/parkbd.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/pcips2.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/ps2mult.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/serio_raw.ko 2023-05-17T11:28:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/serport.ko 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/sparse-keymap.ko 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/ 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd/ 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/ 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-88pm860x.ko 2023-05-17T11:28:00.571 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-adp5520.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-bd2802.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-blinkm.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-da903x.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-da9052.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-gpio.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3530.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3533.ko 2023-05-17T11:28:00.572 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm355x.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3642.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lp3944.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lp8788.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-max8997.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-mc13783.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-menf21bmc.ko 2023-05-17T11:28:00.573 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-pca9532.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-pca955x.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-pca963x.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-ss4200.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-tca6507.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-wm831x-status.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-wm8350.ko 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ 2023-05-17T11:28:00.574 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-17T11:28:00.575 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/ 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache/ 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 631593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache/bcache.ko 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-bio-prison.ko 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 79553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-bufio.ko 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache-smq.ko 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 153889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache.ko 2023-05-17T11:28:00.576 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 105505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-crypt.ko 2023-05-17T11:28:00.577 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-delay.ko 2023-05-17T11:28:00.577 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-era.ko 2023-05-17T11:28:00.577 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-flakey.ko 2023-05-17T11:28:00.577 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-log-userspace.ko 2023-05-17T11:28:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-log.ko 2023-05-17T11:28:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-mirror.ko 2023-05-17T11:28:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-multipath.ko 2023-05-17T11:28:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-queue-length.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-raid.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-region-hash.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-round-robin.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-service-time.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 108817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-snapshot.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-switch.ko 2023-05-17T11:28:00.609 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 181193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-thin-pool.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-verity.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-zero.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/faulty.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/linear.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/multipath.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data/ 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 192417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-17T11:28:00.610 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid0.ko 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 111041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid1.ko 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 158385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid10.ko 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 391777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid456.ko 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/ 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/ 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 174009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptbase.ko 2023-05-17T11:28:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptctl.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptfc.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptlan.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 122801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptsas.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 75937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptscsih.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptspi.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/ 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/88pm800.ko 2023-05-17T11:28:00.612 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/88pm805.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/88pm80x.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/arizona-i2c.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 121913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/arizona.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/bcm590xx.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/cros_ec_dev.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/dln2.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/janz-cmodio.ko 2023-05-17T11:28:00.613 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/kempld-core.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lm3533-core.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lp3943.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_ich.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_sch.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/max8907.ko 2023-05-17T11:28:00.614 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/mc13xxx-core.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/menf21bmc.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/pcf50633-adc.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/pcf50633-gpio.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/pcf50633.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/retu-mfd.ko 2023-05-17T11:28:00.615 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 76113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/si476x-core.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/sm501.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/tps65010.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/tps6507x.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/viperboard.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/vx855.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/wl1273-core.ko 2023-05-17T11:28:00.616 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/wm8994.ko 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ad525x_dpot.ko 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl/ 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds9802als.ko 2023-05-17T11:28:00.617 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds990x.ko 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/bh1770glc.ko 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/c2port/ 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/c2port/core.ko 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710/ 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710/cb710.ko 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ds1682.ko 2023-05-17T11:28:00.618 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/dummy-irq.ko 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/echo/ 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/echo/echo.ko 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/ 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/at24.ko 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/max6875.ko 2023-05-17T11:28:00.619 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/enclosure.ko 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/genwqe/ 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 151777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/hmc6352.ko 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/hpilo.ko 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ibmasm/ 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ics932s401.ko 2023-05-17T11:28:00.620 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29003.ko 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29020.ko 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/ 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/ 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 123577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-me.ko 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 56017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-txe.ko 2023-05-17T11:28:00.621 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 304113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei.ko 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/phantom.ko 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ti-st/ 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 74113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/ti-st/st_drv.ko 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_7xx1.ko 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_core.ko 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tsl2550.ko 2023-05-17T11:28:00.622 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_balloon.ko 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci/ 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 180377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding/ 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 484433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding/bonding.ko 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/ 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53/ 2023-05-17T11:28:00.623 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 98553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx/ 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 447025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dummy.ko 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/eql.ko 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ 2023-05-17T11:28:00.624 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/ 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 130081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 68353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/ 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-17T11:28:00.625 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 98561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec/ 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere/ 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 68713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon/ 2023-05-17T11:28:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera/ 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/ 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 86849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-17T11:28:00.627 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/ 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx/ 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 97153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 104297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 89745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/ 2023-05-17T11:28:00.628 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 80993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 69273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/ 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 176761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1422217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-17T11:28:00.629 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 127561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet/ 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 130553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 311593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/ 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna/ 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 323097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/ 2023-05-17T11:28:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 193001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 345433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1038537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 165945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-17T11:28:00.631 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/ 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic/ 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 203169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/ 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/ 2023-05-17T11:28:00.632 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 68953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 140721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/ 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-17T11:28:00.633 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dnet.ko 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ec_bhf.ko 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/ 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet/ 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 280937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ethoc.ko 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fealnx.ko 2023-05-17T11:28:00.634 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fujitsu/ 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 89969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000/ 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 295217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e/ 2023-05-17T11:28:00.635 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 583489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k/ 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 245881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e/ 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 918521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf/ 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 301361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb/ 2023-05-17T11:28:00.636 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 513657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf/ 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 92241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb/ 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 124121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 733809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-05-17T11:28:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 151361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 86417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/jme.ko 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/ 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 122185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/ 2023-05-17T11:28:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 709977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 280081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1034761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-05-17T11:28:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 95169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/ 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 108305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/ 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-17T11:28:00.640 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion/ 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 150401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia/ 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 136281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/ 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-17T11:28:00.641 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/ 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 227049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 86585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 671353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc/ 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-17T11:28:00.642 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/ 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 66881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 183041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/samsung/ 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-05-17T11:28:00.643 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 103713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc/ 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 862657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan/ 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/ 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 62841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-17T11:28:00.644 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/ 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 61041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 66689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 67777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/ 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-05-17T11:28:00.645 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 474905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/ 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 102945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 165841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-17T11:28:00.646 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti/ 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti/ 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 86025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/ 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 79761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-17T11:28:00.647 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/ 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 45289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom/ 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/ 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/defxx.ko 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/skfp/ 2023-05-17T11:28:00.648 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 216481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/fddi/skfp/skfp.ko 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 76673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/geneve.ko 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv/ 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 234841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154/ 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ifb.ko 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan/ 2023-05-17T11:28:00.649 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 82705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvlan.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvtap.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/ 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-gpio.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio.ko 2023-05-17T11:28:00.650 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mii.ko 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/netconsole.ko 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/nlmon.ko 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/ 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/ 2023-05-17T11:28:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/amd.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm87xx.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/broadcom.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/cicada.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/davicom.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/et1011c.ko 2023-05-17T11:28:00.652 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/icplus.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/lxt.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 75673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/marvell.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 74585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/micrel.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/national.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 91833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/phylink.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/qsemi.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/realtek.ko 2023-05-17T11:28:00.653 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/smsc.ko 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/ste10Xp.ko 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/vitesse.ko 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/plip/ 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/plip/plip.ko 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-17T11:28:00.654 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_async.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppoe.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppox.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pptp.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/sb1000.ko 2023-05-17T11:28:00.655 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/ 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/slip.ko 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/sungem_phy.ko 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 63113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/tap.ko 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/ 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 104289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team.ko 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-17T11:28:00.656 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_random.ko 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 87345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/veth.ko 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3/ 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 120049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan/ 2023-05-17T11:28:00.657 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 238977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan/vxlan.ko 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback/ 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 143305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb/ 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb/ntb.ko 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/ 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/ 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 257665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme-core.ko 2023-05-17T11:28:00.658 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme.ko 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/ 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 128697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport.ko 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_cs.ko 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_pc.ko 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_serial.ko 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/ 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/ 2023-05-17T11:28:00.659 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/pci-stub.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/xen-pcifront.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/ 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/i82092.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 143273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pcmcia.ko 2023-05-17T11:28:00.660 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pcmcia_core.ko 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pd6729.ko 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 112481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/ 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/broadcom/ 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-05-17T11:28:00.661 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/samsung/ 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/ 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel/ 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/ 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/ 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-05-17T11:28:00.662 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/ 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 66617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-17T11:28:00.663 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acerhdf.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 105897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-17T11:28:00.664 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/hdaps.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/ibm_rtl.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/ 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-05-17T11:28:00.665 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel_ips.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-17T11:28:00.666 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi.ko 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/ 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/88pm860x_battery.ko 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/88pm860x_charger.ko 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/bq2415x_charger.ko 2023-05-17T11:28:00.667 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/bq24190_charger.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/bq24735-charger.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/da9030_battery.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/da9052-battery.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2760_battery.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2780_battery.ko 2023-05-17T11:28:00.668 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2781_battery.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/ds2782_battery.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/gpio-charger.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/isp1704_charger.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/lp8727_charger.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max14577_charger.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max17040_battery.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max17042_battery.ko 2023-05-17T11:28:00.669 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max8903_charger.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/max8925_power.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/pcf50633-charger.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/sbs-battery.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/test_power.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/tps65090-charger.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/wm831x_backup.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/wm831x_power.ko 2023-05-17T11:28:00.670 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/power/supply/wm8350_power.ko 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/ 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/ 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/ 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-17T11:28:00.671 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps_parport.ko 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/pps_core.ko 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 64265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp.ko 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp_kvm.ko 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/ 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-88pm80x.ko 2023-05-17T11:28:00.672 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-88pm860x.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-da9052.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-da9055.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-da9063.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 68081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-17T11:28:00.673 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-em3027.ko 2023-05-17T11:28:00.674 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-lp8788.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t86.ko 2023-05-17T11:28:00.675 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max6900.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8907.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8925.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8997.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max8998.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-17T11:28:00.676 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-palmas.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf50633.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rc5t583.ko 2023-05-17T11:28:00.677 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-s35390a.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-tps6586x.ko 2023-05-17T11:28:00.678 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-tps65910.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-wm831x.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-wm8350.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-x1205.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-9xxx.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-sas.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-xxxx.ko 2023-05-17T11:28:00.679 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 134673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/BusLogic.ko 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/a100u2w.ko 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid/ 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 271161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 100129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/advansys.ko 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/ 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 355761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-17T11:28:00.680 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 295313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic94xx/ 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 188825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/am53c974.ko 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr/ 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 106065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/atp870u.ko 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi/ 2023-05-17T11:28:00.681 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 246913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa/ 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1172201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa/bfa.ko 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc/ 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 236737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i/ 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 114969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ch.ko 2023-05-17T11:28:00.682 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor/ 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 308401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/ 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 75689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 141417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-17T11:28:00.683 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 75105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dc395x.ko 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dmx3191d.ko 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r/ 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 211977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esp_scsi.ko 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/ 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 154601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-17T11:28:00.684 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fdomain.ko 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic/ 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 262025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic/fnic.ko 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 201305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hpsa.ko 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hptiop.ko 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hv_storvsc.ko 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/imm.ko 2023-05-17T11:28:00.685 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/initio.ko 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 285985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ipr.ko 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ips.ko 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci/ 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 316817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci/isci.ko 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc/ 2023-05-17T11:28:00.686 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 307873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc/libfc.ko 2023-05-17T11:28:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 139737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi.ko 2023-05-17T11:28:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-17T11:28:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas/ 2023-05-17T11:28:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 212217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas/libsas.ko 2023-05-17T11:28:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc/ 2023-05-17T11:28:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 2194601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-17T11:28:00.714 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/ 2023-05-17T11:28:00.714 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 73113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 310241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 84289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid.ko 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas/ 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 659569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas/ 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 119425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-17T11:28:00.715 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvumi.ko 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/ 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 81113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001/ 2023-05-17T11:28:00.716 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 360881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 123073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pmcraid.ko 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ppa.ko 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla1280.ko 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/ 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1850553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 85353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx/ 2023-05-17T11:28:00.717 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 558737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qlogicfas408.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/raid_class.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 242441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_debug.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 171561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 270153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 94049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-17T11:28:00.718 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ses.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 115409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/st.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/stex.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2/ 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 161697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/virtio_scsi.ko 2023-05-17T11:28:00.719 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/wd719x.ko 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/xen-scsifront.ko 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb/ 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 126593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb/ssb.ko 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/ 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi/ 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 730161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-17T11:28:00.720 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback/ 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_file.ko 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_iblock.ko 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 913305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_mod.ko 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_pscsi.ko 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 121793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_user.ko 2023-05-17T11:28:00.721 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc/ 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 75905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/ 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/ 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/ 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-17T11:28:00.722 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-17T11:28:00.723 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_menlow.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ 2023-05-17T11:28:00.724 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless/ 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/moxa.ko 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/mxser.ko 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 104345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_gsm.ko 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_hdlc.ko 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 67641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/nozomi.ko 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/ 2023-05-17T11:28:00.725 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/ 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/altera_uart.ko 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/arc_uart.ko 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 69793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-05-17T11:28:00.726 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm/ 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 102521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/rp2.ko 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 51705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/sc16is7xx.ko 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 99985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/synclink_gt.ko 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/ 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core/ 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 518025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-17T11:28:00.727 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/ 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio.ko 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_aec.ko 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_cif.ko 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_dmem_genirq.ko 2023-05-17T11:28:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_mf624.ko 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_netx.ko 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_pci_generic.ko 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_sercos3.ko 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/ 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/c67x00/ 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/c67x00/c67x00.ko 2023-05-17T11:28:00.729 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 144897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/ 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 85025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-acm.ko 2023-05-17T11:28:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usblp.ko 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 89409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usbtmc.ko 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/common/ 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/common/ulpi.ko 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc2/ 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/ 2023-05-17T11:28:00.731 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 433729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/dwc3/dwc3.ko 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/ 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/ 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/u_ether.ko 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/u_serial.ko 2023-05-17T11:28:00.732 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 90825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 117593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-05-17T11:28:00.733 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 83697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 58001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 67913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/ 2023-05-17T11:28:00.734 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-05-17T11:28:00.735 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-05-17T11:28:00.735 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-05-17T11:28:00.735 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-05-17T11:28:00.736 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 61665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 154617 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/libcomposite.ko 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/ 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/bdc/ 2023-05-17T11:28:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 157161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 69193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 55473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 75545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/net2272.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 74529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/net2280.ko 2023-05-17T11:28:00.738 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 79913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 139729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/ 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/bcma-hcd.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 79529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/isp116x-hcd.ko 2023-05-17T11:28:00.739 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 87185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 78425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/sl811_cs.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/ssb-hcd.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 92241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/u132-hcd.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/ 2023-05-17T11:28:00.740 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/mdc800.ko 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/microtek.ko 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/adutux.ko 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/appledisplay.ko 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/cytherm.ko 2023-05-17T11:28:00.741 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ehset.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi26.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi62.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ezusb.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 73217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/idmouse.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/iowarrior.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-17T11:28:00.742 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ldusb.ko 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/legousbtower.ko 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/lvstest.ko 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga/ 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 64033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usb3503.ko 2023-05-17T11:28:00.743 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usblcd.ko 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usbtest.ko 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/uss720.ko 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/yurex.ko 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/mon/ 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/mon/usbmon.ko 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/musb/ 2023-05-17T11:28:00.744 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 294641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/musb/musb_hdrc.ko 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/ 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-generic.ko 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-isp1301.ko 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-tahvo.ko 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/aircable.ko 2023-05-17T11:28:00.745 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ark3116.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ch341.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 69601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cp210x.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cyberjack.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/empeg.ko 2023-05-17T11:28:00.746 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/f81232.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 174409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 136441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 123961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_ti.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 67329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipaq.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipw.ko 2023-05-17T11:28:00.747 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ir-usb.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 106985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mct_u232.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/metro-usb.ko 2023-05-17T11:28:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7720.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 77673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7840.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 55569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mxuport.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/navman.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/omninet.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/opticon.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 187217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/option.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/oti6858.ko 2023-05-17T11:28:00.749 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/pl2303.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcaux.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcserial.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/quatech2.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/safe_serial.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 50865 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/sierra.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-17T11:28:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ssu100.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/symbolserial.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_debug.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 122417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usbserial.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/visor.ko 2023-05-17T11:28:00.751 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/whiteheat.ko 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/wishbone-serial.ko 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/uas.ko 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-17T11:28:00.752 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-karma.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-17T11:28:00.753 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 176329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/usb-storage.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/ 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 71009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 104905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-17T11:28:00.754 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/ 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/ 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 145057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 97561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio.ko 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 71257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/ 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 98209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost.ko 2023-05-17T11:28:00.755 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_net.ko 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 86785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_scsi.ko 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/ 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/ 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/aat2870_bl.ko 2023-05-17T11:28:00.756 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/adp5520_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/adp8860_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/adp8870_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/apple_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/as3711_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/bd6107.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/da903x_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/da9052_bl.ko 2023-05-17T11:28:00.757 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/gpio_backlight.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14337 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/kb3886_bl.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lcd.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lm3533_bl.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lm3639_bl.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lv5207lp.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/max8925_bl.ko 2023-05-17T11:28:00.758 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/pandora_bl.ko 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/wm831x_bl.ko 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/ 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2482.ko 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2490.ko 2023-05-17T11:28:00.759 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/matrox_w1.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/w1-gpio.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/ 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-17T11:28:00.760 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 55993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/wire.ko 2023-05-17T11:28:00.761 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/acquirewdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/advantechwdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/cpu5wdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/da9052_wdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/da9055_wdt.ko 2023-05-17T11:28:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/da9063_wdt.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/dw_wdt.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/eurotechwdt.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/hpwdt.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/i6300esb.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-17T11:28:00.763 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ib700wdt.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ibmasr.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it87_wdt.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/kempld_wdt.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/machzwd.ko 2023-05-17T11:28:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/mena21_wdt.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/nv_tco.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pc87413_wdt.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/retu_wdt.ko 2023-05-17T11:28:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sc1200wdt.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/softdog.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-17T11:28:00.766 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/twl4030_wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/via_wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wafer5823wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wdt_pci.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wm831x_wdt.ko 2023-05-17T11:28:00.767 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wm8350_wdt.ko 2023-05-17T11:28:00.768 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/xen_wdt.ko 2023-05-17T11:28:00.768 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/ 2023-05-17T11:28:00.768 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-evtchn.ko 2023-05-17T11:28:00.768 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntalloc.ko 2023-05-17T11:28:00.768 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntdev.ko 2023-05-17T11:28:00.768 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback/ 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 176105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-privcmd.ko 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 71449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-scsiback.ko 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs/ 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ 2023-05-17T11:28:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p/ 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 171305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p/9p.ko 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/adfs/ 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/adfs/adfs.ko 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs/ 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 162241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs/affs.ko 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/afs/ 2023-05-17T11:28:00.770 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 924521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/afs/kafs.ko 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/autofs/ 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 100321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/autofs/autofs4.ko 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs/ 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 63977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs/befs.ko 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/bfs/ 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/bfs/bfs.ko 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/binfmt_misc.ko 2023-05-17T11:28:00.771 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs/ 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 3475873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs/btrfs.ko 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles/ 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 299529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles/cachefiles.ko 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph/ 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1229209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph/ceph.ko 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs/ 2023-05-17T11:28:00.772 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 2614625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs/cifs.ko 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda/ 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 99153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda/coda.ko 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/configfs/ 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 105385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/configfs/configfs.ko 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs/ 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs/cramfs.ko 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm/ 2023-05-17T11:28:00.773 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 624153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm/dlm.ko 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/efs/ 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/efs/efs.ko 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs/ 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1470857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs/f2fs.ko 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/ 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/msdos.ko 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/freevxfs/ 2023-05-17T11:28:00.774 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 41961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/freevxfs/freevxfs.ko 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache/ 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 218289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache/fscache.ko 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/ 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/cuse.ko 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2/ 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1222241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2/gfs2.ko 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs/ 2023-05-17T11:28:00.775 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 140857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs/hfs.ko 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus/ 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 220953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus/hfsplus.ko 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hpfs/ 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 193145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/hpfs/hpfs.ko 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs/ 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 73961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs/isofs.ko 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs/ 2023-05-17T11:28:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 418945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs/jfs.ko 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd/ 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 254633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd/lockd.ko 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix/ 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 87417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix/minix.ko 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs/ 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 128313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs/netfs.ko 2023-05-17T11:28:00.777 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/ 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout/ 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 81025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout/ 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 58929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout/ 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 117209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1016665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfs.ko 2023-05-17T11:28:00.778 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv2.ko 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 119217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv3.ko 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 2003553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv4.ko 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/ 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/grace.ko 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/nfs_acl.ko 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd/ 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1400409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd/nfsd.ko 2023-05-17T11:28:00.779 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2/ 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 587089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2/nilfs2.ko 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/ 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-celtic.ko 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-centeuro.ko 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-croatian.ko 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-cyrillic.ko 2023-05-17T11:28:00.780 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-gaelic.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-greek.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-iceland.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-inuit.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-roman.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-romanian.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-turkish.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_ascii.ko 2023-05-17T11:28:00.781 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1250.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1251.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1255.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp737.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp775.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp850.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp852.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp855.ko 2023-05-17T11:28:00.782 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp857.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp860.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp861.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp862.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp863.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp864.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp865.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp866.ko 2023-05-17T11:28:00.783 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp869.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp874.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 93649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp932.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 142185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp936.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 165257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp949.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 117625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp950.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_euc-jp.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-1.ko 2023-05-17T11:28:00.784 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-13.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-14.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-15.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-2.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-3.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-4.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-5.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-6.ko 2023-05-17T11:28:00.785 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-7.ko 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-9.ko 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-r.ko 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-ru.ko 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-u.ko 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_utf8.ko 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ntfs/ 2023-05-17T11:28:00.786 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 218585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ntfs/ntfs.ko 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster/ 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 240737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm/ 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 439201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs/ 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-17T11:28:00.787 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 2510441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2.ko 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/omfs/ 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 52145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/omfs/omfs.ko 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs/ 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 320649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs/overlay.ko 2023-05-17T11:28:00.788 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore/ 2023-05-17T11:28:00.789 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore/ramoops.ko 2023-05-17T11:28:00.813 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx4/ 2023-05-17T11:28:00.813 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx4/qnx4.ko 2023-05-17T11:28:00.813 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx6/ 2023-05-17T11:28:00.813 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/qnx6/qnx6.ko 2023-05-17T11:28:00.813 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/ 2023-05-17T11:28:00.813 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/quota_tree.ko 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/quota_v1.ko 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/quota/quota_v2.ko 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs/ 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 527801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs/reiserfs.ko 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs/ 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs/romfs.ko 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/ 2023-05-17T11:28:00.814 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs/ 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 131193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs/squashfs.ko 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv/ 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 88441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv/sysv.ko 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf/ 2023-05-17T11:28:00.815 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 247873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf/udf.ko 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs/ 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 160129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs/ufs.ko 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs/ 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 3829249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs/xfs.ko 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/ 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/locking/ 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/locking/locktorture.ko 2023-05-17T11:28:00.816 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/time/ 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/time/test_udelay.ko 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 55009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/kernel/torture.ko 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc-itu-t.ko 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 5729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc7.ko 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6081 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc8.ko 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/ 2023-05-17T11:28:00.817 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libarc4.ko 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libdes.ko 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/interval_tree_test.ko 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/libcrc32c.ko 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lru_cache.ko 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/ 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4_compress.ko 2023-05-17T11:28:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4hc_compress.ko 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/math/ 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 5897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/math/cordic.ko 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/memory-notifier-error-inject.ko 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/notifier-error-inject.ko 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/percpu_test.ko 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/pm-notifier-error-inject.ko 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6/ 2023-05-17T11:28:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 141873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6/raid6_pq.ko 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/rbtree_test.ko 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon/ 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test-kstrtox.ko 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test-string_helpers.ko 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 4760329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_bpf.ko 2023-05-17T11:28:00.820 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 48057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_firmware.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 5873 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_module.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21177 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/test_user_copy.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_bm.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_fsm.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_kmp.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/xz/ 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/lib/xz/xz_dec_test.ko 2023-05-17T11:28:00.821 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/mm/ 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/mm/hwpoison-inject.ko 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/ 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/6lowpan.ko 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_dest.ko 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_fragment.ko 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_hop.ko 2023-05-17T11:28:00.822 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_mobility.ko 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_routing.ko 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_udp.ko 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/ 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/garp.ko 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33657 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/mrp.ko 2023-05-17T11:28:00.823 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/p8022.ko 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/psnap.ko 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/802/stp.ko 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q/ 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 80641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q/8021q.ko 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/ 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 191305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet.ko 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_fd.ko 2023-05-17T11:28:00.824 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_rdma.ko 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_virtio.ko 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv/ 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 652281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv/batman-adv.ko 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/ 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 63505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/br_netfilter.ko 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 772145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/bridge.ko 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ 2023-05-17T11:28:00.825 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8673 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-17T11:28:00.826 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-17T11:28:00.827 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 73961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtables.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13449 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-17T11:28:00.828 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph/ 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1029769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph/libceph.ko 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/core/ 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 124297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/core/pktgen.ko 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/ 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 188577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp.ko 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_diag.ko 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 55633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv4.ko 2023-05-17T11:28:00.829 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 58905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv6.ko 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/ 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 274753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/dsa_core.ko 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_brcm.ko 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_dsa.ko 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_none.ko 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_trailer.ko 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/hsr/ 2023-05-17T11:28:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 99385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/hsr/hsr.ko 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan/ 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 245489 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154.ko 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ 2023-05-17T11:28:00.831 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ah4.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/esp4.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/fou.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/gre.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/inet_diag.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 59737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_gre.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_tunnel.ko 2023-05-17T11:28:00.832 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33737 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_vti.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipcomp.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipip.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ip_tables.ko 2023-05-17T11:28:00.833 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-17T11:28:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11281 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-05-17T11:28:00.835 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_bic.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_dctcp.ko 2023-05-17T11:28:00.836 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14689 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_diag.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_highspeed.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_htcp.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_hybla.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10977 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_illinois.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_lp.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_scalable.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_vegas.ko 2023-05-17T11:28:00.837 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_veno.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10529 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_westwood.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_yeah.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21785 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tunnel4.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_diag.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_tunnel.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ 2023-05-17T11:28:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ah6.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/esp6.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13993 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/fou6.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 80297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_gre.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 90857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_tunnel.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_vti.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ipcomp6.ko 2023-05-17T11:28:00.839 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/mip6.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-17T11:28:00.840 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-17T11:28:00.841 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 37929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-17T11:28:00.842 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8577 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 72545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/sit.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/tunnel6.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22481 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/key/ 2023-05-17T11:28:00.843 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 82505 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/key/af_key.ko 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/ 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 120265 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_core.ko 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19841 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_eth.ko 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 34969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip.ko 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip6.ko 2023-05-17T11:28:00.844 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_netlink.ko 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 53057 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ppp.ko 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/lapb/ 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 46641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/lapb/lapb.ko 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/ 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/llc.ko 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 266497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/llc2.ko 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154/ 2023-05-17T11:28:00.845 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 279905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154/mac802154.ko 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls/ 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls/mpls_gso.ko 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 116641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set.ko 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28017 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-17T11:28:00.846 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 102681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 104097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 104697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 113953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 60665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 110721 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-17T11:28:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 114241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 113889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 112713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 115777 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 410073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-17T11:28:00.848 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11473 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7257 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-17T11:28:00.849 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8801 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13089 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 47601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conncount.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 396769 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15321 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-17T11:28:00.850 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 117313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8377 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 107825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-17T11:28:00.851 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 65305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 86233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36705 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_log_syslog.ko 2023-05-17T11:28:00.852 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 91201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11361 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_irc.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_sip.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 575513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_tables.ko 2023-05-17T11:28:00.853 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 42137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40225 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_log.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 21729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 49001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9961 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_chain_nat.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_compat.ko 2023-05-17T11:28:00.854 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 40217 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_ct.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9169 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10161 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fib.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13385 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_hash.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_limit.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_log.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_masq.ko 2023-05-17T11:28:00.855 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_nat.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13241 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_numgen.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_osf.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_queue.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_redir.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9585 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject_inet.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_socket.ko 2023-05-17T11:28:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_synproxy.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_tproxy.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 98833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/x_tables.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11665 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_AUDIT.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-17T11:28:00.857 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 17809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CT.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_DSCP.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HL.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HMARK.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 38513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LED.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LOG.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-17T11:28:00.858 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NETMAP.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFLOG.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_RATEEST.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_SECMARK.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-17T11:28:00.859 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16937 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TEE.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TPROXY.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TRACE.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_addrtype.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13457 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_bpf.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15209 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cgroup.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cluster.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7073 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_comment.ko 2023-05-17T11:28:00.860 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connbytes.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10649 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlabel.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlimit.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connmark.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_conntrack.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cpu.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dccp.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_devgroup.ko 2023-05-17T11:28:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dscp.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ecn.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11041 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_esp.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43025 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hashlimit.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10889 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_helper.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hl.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11553 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipcomp.ko 2023-05-17T11:28:00.862 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11033 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_iprange.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11289 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipvs.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_l2tp.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_length.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_limit.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7113 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mac.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8153 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mark.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_multiport.ko 2023-05-17T11:28:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13513 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nat.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nfacct.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_osf.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9121 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_owner.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_physdev.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7137 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_pkttype.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_policy.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9049 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_quota.ko 2023-05-17T11:28:00.864 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_rateest.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7761 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_realm.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36065 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_recent.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12897 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_sctp.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_set.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_socket.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9009 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_state.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_statistic.ko 2023-05-17T11:28:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8313 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_string.ko 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8129 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_tcpmss.ko 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13305 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_tcpudp.ko 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_time.ko 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8681 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_u32.ko 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink/ 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 13417 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink/netlink_diag.ko 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh/ 2023-05-17T11:28:00.866 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh/nsh.ko 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/ 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 377353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/openvswitch.ko 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9825 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-geneve.ko 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-gre.ko 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 11297 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-vxlan.ko 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/packet/ 2023-05-17T11:28:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/packet/af_packet_diag.ko 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/phonet/ 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 109633 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/phonet/phonet.ko 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 54353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/phonet/pn_pep.ko 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/ 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 248545 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds.ko 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 164641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_rdma.ko 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 66441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_tcp.ko 2023-05-17T11:28:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rxrpc/ 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 805849 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/rxrpc/rxrpc.ko 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/ 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_csum.ko 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23105 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_gact.ko 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 25185 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_ipt.ko 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33569 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_mirred.ko 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22929 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_nat.ko 2023-05-17T11:28:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 39593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_pedit.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 31561 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_police.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_simple.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35921 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_skbedit.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 35625 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_vlan.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_basic.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32409 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_bpf.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18729 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_cgroup.ko 2023-05-17T11:28:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_flow.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29809 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_fw.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 36793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_route.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 57985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_u32.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_cmp.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 12969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_ipset.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_meta.ko 2023-05-17T11:28:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 7393 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_nbyte.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10193 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_text.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 6753 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_u32.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19609 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_choke.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_codel.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 30441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_drr.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 29913 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_fq.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28953 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_fq_codel.ko 2023-05-17T11:28:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 32145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_gred.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 44345 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hfsc.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20369 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hhf.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 63001 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_htb.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15249 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_ingress.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9353 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio_lib.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23441 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_multiq.ko 2023-05-17T11:28:00.873 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 33329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_netem.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 23497 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_pie.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9833 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_plug.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22817 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_prio.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 43969 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_qfq.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 28697 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_red.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 24881 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfb.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 27985 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfq.ko 2023-05-17T11:28:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_tbf.ko 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 26857 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_teql.ko 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/ 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 920945 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp.ko 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 18601 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp_diag.ko 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/ 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/ 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 327521 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-17T11:28:00.875 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 61329 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 1405641 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/sunrpc.ko 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma/ 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 681905 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/ 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 9593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/diag.ko 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 853201 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/tipc.ko 2023-05-17T11:28:00.876 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/unix/ 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 15233 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/unix/unix_diag.ko 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/ 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 78425 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 67537 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 82401 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock.ko 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10273 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 16713 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-17T11:28:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/x25/ 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 124593 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/x25/x25.ko 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/ 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 20793 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_algo.ko 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 19745 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 101145 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_user.ko 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/virt/ 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib/ 2023-05-17T11:28:00.878 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 14433 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib/irqbypass.ko 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 636465 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.alias 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 622282 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.alias.bin 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 8260 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 22530 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin.alias.bin 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 10532 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin.bin 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 70097 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.builtin.modinfo 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 146789 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.dep 2023-05-17T11:28:00.879 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 233606 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.dep.bin 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 210 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.devname 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 73038 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.order 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 879 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.softdep 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 251751 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.symbols 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 306320 2023-05-17 05:52 ./lib/modules/6.3.0-g2bcb17939031/modules.symbols.bin 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/ 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/share/ 2023-05-17T11:28:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/share/doc/ 2023-05-17T11:28:00.881 INFO:teuthology.orchestra.run.smithi003.stdout:drwxr-xr-x root/root 0 2023-05-17 05:52 ./usr/share/doc/linux-image-6.3.0-g2bcb17939031/ 2023-05-17T11:28:00.881 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 170 2023-05-17 05:52 ./usr/share/doc/linux-image-6.3.0-g2bcb17939031/changelog.Debian.gz 2023-05-17T11:28:00.881 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r-- root/root 691 2023-05-17 05:52 ./usr/share/doc/linux-image-6.3.0-g2bcb17939031/copyright 2023-05-17T11:28:00.881 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g2bcb17939031 2023-05-17T11:28:00.882 INFO:teuthology.task.kernel:searching for kernel 6.3.0-g2bcb17939031 2023-05-17T11:28:00.882 DEBUG:teuthology.orchestra.run.smithi003:> egrep '(submenu|menuentry.*6.3.0-g2bcb17939031).*{' /boot/grub/grub.cfg 2023-05-17T11:28:00.889 INFO:teuthology.orchestra.run.smithi003.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-17T11:28:00.890 INFO:teuthology.orchestra.run.smithi003.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g2bcb17939031' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g2bcb17939031-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-17T11:28:00.890 INFO:teuthology.orchestra.run.smithi003.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g2bcb17939031 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g2bcb17939031-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-17T11:28:00.891 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-05-17T11:28:00.891 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-g2bcb17939031 2023-05-17T11:28:00.892 DEBUG:teuthology.orchestra.run.smithi003:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-05-17T11:28:00.933 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi003.front.sepia.ceph.com to complete... 2023-05-17T11:28:01.386 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub' 2023-05-17T11:28:01.387 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-17T11:28:01.412 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2023-05-17T11:28:01.643 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T11:28:01.650 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-6.3.0-g2bcb17939031 2023-05-17T11:28:01.908 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-17T11:28:01.913 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-17T11:28:01.959 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-17T11:28:01.965 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-17T11:28:02.094 INFO:teuthology.orchestra.run.smithi003.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-17T11:28:02.095 INFO:teuthology.orchestra.run.smithi003.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-17T11:28:02.095 INFO:teuthology.orchestra.run.smithi003.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-17T11:28:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:done 2023-05-17T11:28:29.668 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-17T11:28:29.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-05-17T11:28:29.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:28:33.252 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-17T11:28:33.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-05-17T11:28:33.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:28:47.984 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-05-17T11:28:51.568 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-05-17T11:29:18.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-05-17T11:29:18.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:29:21.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-05-17T11:29:21.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-05-17T11:29:21.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:29:24.628 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-05-17T11:29:51.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-05-17T11:29:51.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:29:51.322 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-05-17T11:29:52.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-05-17T11:29:52.064 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.3.0-g2bcb17939031"... 2023-05-17T11:29:52.064 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-05-17T11:29:52.112 INFO:teuthology.orchestra.run.smithi060.stdout:6.3.0-g2bcb17939031 2023-05-17T11:29:52.113 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g2bcb17939031 vs 6.3.0-g2bcb17939031 2023-05-17T11:29:52.113 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-17T11:29:52.114 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-17T11:29:53.114 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-17T11:29:53.115 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-17T11:29:53.208 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2023-05-17T11:29:53.259 DEBUG:teuthology.parallel:result is None 2023-05-17T11:29:54.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-05-17T11:29:54.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:29:54.834 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-05-17T11:29:55.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-05-17T11:29:55.429 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.3.0-g2bcb17939031"... 2023-05-17T11:29:55.429 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-05-17T11:29:55.478 INFO:teuthology.orchestra.run.smithi003.stdout:6.3.0-g2bcb17939031 2023-05-17T11:29:55.479 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g2bcb17939031 vs 6.3.0-g2bcb17939031 2023-05-17T11:29:55.479 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-17T11:29:55.479 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-17T11:29:56.480 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-17T11:29:56.480 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-17T11:29:56.574 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2023-05-17T11:29:56.614 DEBUG:teuthology.parallel:result is None 2023-05-17T11:29:56.615 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-17T11:29:56.621 INFO:teuthology.task.internal:Creating test directory... 2023-05-17T11:29:56.622 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-17T11:29:56.625 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-17T11:29:56.636 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-17T11:29:56.651 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-17T11:29:56.692 INFO:teuthology.task.internal:Creating archive directory... 2023-05-17T11:29:56.692 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-17T11:29:56.698 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-17T11:29:56.720 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-17T11:29:56.738 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-17T11:29:56.739 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-17T11:29:56.760 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-17T11:29:56.784 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T11:29:56.798 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T11:29:56.829 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T11:29:56.842 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T11:29:56.845 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-17T11:29:56.852 INFO:teuthology.task.internal:Configuring sudo... 2023-05-17T11:29:56.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-17T11:29:56.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-17T11:29:56.883 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-17T11:29:56.893 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-17T11:29:56.894 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-17T11:29:56.918 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-17T11:29:56.936 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T11:29:56.975 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T11:29:57.028 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:29:57.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-17T11:29:57.097 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T11:29:57.106 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T11:29:57.161 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:29:57.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-17T11:29:57.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2023-05-17T11:29:57.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-05-17T11:29:57.398 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-17T11:29:57.406 INFO:teuthology.task.internal:Starting timer... 2023-05-17T11:29:57.407 INFO:teuthology.run_tasks:Running task pcp... 2023-05-17T11:29:57.448 INFO:teuthology.run_tasks:Running task selinux... 2023-05-17T11:29:57.478 DEBUG:teuthology.task.selinux:Excluding smithi003: OS 'ubuntu' does not support SELinux 2023-05-17T11:29:57.479 DEBUG:teuthology.task.selinux:Excluding smithi060: OS 'ubuntu' does not support SELinux 2023-05-17T11:29:57.479 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-17T11:29:57.480 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-05-17T11:29:57.480 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-17T11:29:57.480 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-17T11:29:57.538 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-05-17T11:29:57.538 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-17T11:29:57.564 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-17T11:29:57.565 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi060.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-17T11:39:47.302 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com')] 2023-05-17T11:39:47.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-05-17T11:39:47.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:39:47.384 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-05-17T11:39:47.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-05-17T11:39:47.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T11:39:47.622 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-05-17T11:39:47.758 INFO:teuthology.run_tasks:Running task clock... 2023-05-17T11:39:47.773 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-17T11:39:47.773 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-17T11:39:47.774 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T11:39:47.778 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-17T11:39:47.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T11:39:47.813 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-17T11:39:47.813 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Command line: ntpd -gq 2023-05-17T11:39:47.813 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: ---------------------------------------------------- 2023-05-17T11:39:47.813 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: ntp-4 is maintained by Network Time Foundation, 2023-05-17T11:39:47.814 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-17T11:39:47.814 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: corporation. Support and training for ntp-4 are 2023-05-17T11:39:47.814 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: available at https://www.nwtime.org/support 2023-05-17T11:39:47.814 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: ---------------------------------------------------- 2023-05-17T11:39:47.815 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: proto: precision = 0.042 usec (-24) 2023-05-17T11:39:47.815 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: basedate set to 2022-02-04 2023-05-17T11:39:47.815 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: gps base set to 2022-02-06 (week 2196) 2023-05-17T11:39:47.815 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-17T11:39:47.815 INFO:teuthology.orchestra.run.smithi003.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-17T11:39:47.816 INFO:teuthology.orchestra.run.smithi003.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-17T11:39:47.816 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: restrict ::: KOD does nothing without LIMITED. 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listen and drop on 0 v6wildcard [::]:123 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listen normally on 2 lo 127.0.0.1:123 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listen normally on 3 ens1f0 172.21.15.3:123 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listen normally on 4 lo [::1]:123 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15dc%2]:123 2023-05-17T11:39:47.817 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:47 ntpd[26895]: Listening on routing socket on fd #22 for interface updates 2023-05-17T11:39:47.838 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-17T11:39:47.838 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Command line: ntpd -gq 2023-05-17T11:39:47.838 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: ---------------------------------------------------- 2023-05-17T11:39:47.839 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: ntp-4 is maintained by Network Time Foundation, 2023-05-17T11:39:47.839 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-17T11:39:47.839 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: corporation. Support and training for ntp-4 are 2023-05-17T11:39:47.840 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: available at https://www.nwtime.org/support 2023-05-17T11:39:47.840 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: ---------------------------------------------------- 2023-05-17T11:39:47.842 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: proto: precision = 0.044 usec (-24) 2023-05-17T11:39:47.843 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: basedate set to 2022-02-04 2023-05-17T11:39:47.843 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: gps base set to 2022-02-06 (week 2196) 2023-05-17T11:39:47.843 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-17T11:39:47.843 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: restrict ::: KOD does nothing without LIMITED. 2023-05-17T11:39:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-17T11:39:47.844 INFO:teuthology.orchestra.run.smithi060.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-17T11:39:47.844 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listen and drop on 0 v6wildcard [::]:123 2023-05-17T11:39:47.845 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-17T11:39:47.845 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listen normally on 2 lo 127.0.0.1:123 2023-05-17T11:39:47.845 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listen normally on 3 ens1f0 172.21.15.60:123 2023-05-17T11:39:47.845 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listen normally on 4 lo [::1]:123 2023-05-17T11:39:47.845 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1560%3]:123 2023-05-17T11:39:47.845 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:47 ntpd[26859]: Listening on routing socket on fd #22 for interface updates 2023-05-17T11:39:48.813 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:48 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:48.813 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:48 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:48.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:48 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:48.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:48 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:48.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:48 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:48.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:48 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:48.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:48 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:48.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:48 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:49.813 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:49 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:49.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:49 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:49.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:49 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:49.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:49 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:49 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:49.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:49 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:50.813 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:50 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:50 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:50 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:50 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:50 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:50 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:50 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:50 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:50 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:50 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:50 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:50 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:51.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:51.816 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:51.816 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:51.817 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:51.817 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:51.817 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:51.818 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:51.818 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:51.818 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:51.819 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:51.819 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:51.819 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:51 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:51.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:51 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:51.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:51 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:51.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:51 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:51.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:51 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:51.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:51 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:51.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:51 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:52.813 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:52 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:52 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:52 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:52 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:52 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:52.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:52 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:52.841 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:52.841 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:52.841 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:52.841 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:52 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:53.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:53.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:53.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:53.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:53.816 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:53 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:53 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:53 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:53 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:53 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:53 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:53 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:54 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:54 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:54 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:54 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:54 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:54 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:54.841 INFO:teuthology.orchestra.run.smithi060.stdout:17 May 11:39:54 ntpd[26859]: ntpd: time slew +0.002369 s 2023-05-17T11:39:54.841 INFO:teuthology.orchestra.run.smithi060.stdout:ntpd: time slew +0.002369s 2023-05-17T11:39:54.841 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:54.841 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-17T11:39:54.842 INFO:teuthology.orchestra.run.smithi060.stderr:17 May 11:39:54 ntpd[26859]: can't open /var/log/ntpstats/loopstats.20230517: Permission denied 2023-05-17T11:39:54.958 INFO:teuthology.orchestra.run.smithi060.stdout: remote refid st t when poll reach delay offset jitter 2023-05-17T11:39:54.958 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================== 2023-05-17T11:39:54.958 INFO:teuthology.orchestra.run.smithi060.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:54.959 INFO:teuthology.orchestra.run.smithi060.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:54.959 INFO:teuthology.orchestra.run.smithi060.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:54.959 INFO:teuthology.orchestra.run.smithi060.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:55.814 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/rawstats.20230517: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-17T11:39:55.815 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/peerstats.20230517: Permission denied 2023-05-17T11:39:55.816 INFO:teuthology.orchestra.run.smithi003.stdout:17 May 11:39:55 ntpd[26895]: ntpd: time slew -0.000754 s 2023-05-17T11:39:55.816 INFO:teuthology.orchestra.run.smithi003.stdout:ntpd: time slew -0.000754s 2023-05-17T11:39:55.816 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-17T11:39:55.817 INFO:teuthology.orchestra.run.smithi003.stderr:17 May 11:39:55 ntpd[26895]: can't open /var/log/ntpstats/loopstats.20230517: Permission denied 2023-05-17T11:39:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: remote refid st t when poll reach delay offset jitter 2023-05-17T11:39:55.926 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================== 2023-05-17T11:39:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:55.926 INFO:teuthology.orchestra.run.smithi003.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:55.927 INFO:teuthology.orchestra.run.smithi003.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-17T11:39:55.927 INFO:teuthology.run_tasks:Running task install... 2023-05-17T11:39:55.938 DEBUG:teuthology.task.install:project ceph 2023-05-17T11:39:55.938 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}} 2023-05-17T11:39:55.939 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'} 2023-05-17T11:39:55.939 INFO:teuthology.task.install:Using flavor: default 2023-05-17T11:39:55.945 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-17T11:39:55.946 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-17T11:39:55.946 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-key list | grep Ceph 2023-05-17T11:39:55.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo apt-key list | grep Ceph 2023-05-17T11:39:56.049 INFO:teuthology.orchestra.run.smithi060.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-17T11:39:56.069 INFO:teuthology.orchestra.run.smithi003.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-17T11:39:56.099 INFO:teuthology.orchestra.run.smithi060.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-17T11:39:56.100 INFO:teuthology.orchestra.run.smithi060.stdout:uid [ unknown] Ceph.com (release key) 2023-05-17T11:39:56.100 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-17T11:39:56.101 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-17T11:39:56.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-17T11:39:56.118 INFO:teuthology.orchestra.run.smithi003.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-17T11:39:56.119 INFO:teuthology.orchestra.run.smithi003.stdout:uid [ unknown] Ceph.com (release key) 2023-05-17T11:39:56.120 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-17T11:39:56.120 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-17T11:39:56.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-17T11:39:56.242 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default/ 2023-05-17T11:39:56.243 INFO:teuthology.task.install.deb:Package version is 18.0.0-3926-g27be5126-1jammy 2023-05-17T11:39:56.261 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default/ 2023-05-17T11:39:56.262 INFO:teuthology.task.install.deb:Package version is 18.0.0-3926-g27be5126-1jammy 2023-05-17T11:39:56.355 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:39:56.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-17T11:39:56.365 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:39:56.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-17T11:39:56.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo apt-get update 2023-05-17T11:39:56.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-05-17T11:39:56.564 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-17T11:39:56.571 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-17T11:39:56.571 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-17T11:39:56.578 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-17T11:39:56.589 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-17T11:39:56.595 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-17T11:39:56.619 INFO:teuthology.orchestra.run.smithi060.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy InRelease 2023-05-17T11:39:56.620 INFO:teuthology.orchestra.run.smithi003.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy InRelease 2023-05-17T11:39:56.641 INFO:teuthology.orchestra.run.smithi060.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-17T11:39:56.642 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-17T11:39:56.663 INFO:teuthology.orchestra.run.smithi060.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-17T11:39:56.664 INFO:teuthology.orchestra.run.smithi003.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-17T11:39:56.685 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2023-05-17T11:39:56.686 INFO:teuthology.orchestra.run.smithi060.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-17T11:39:56.696 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-17T11:39:56.702 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-17T11:39:56.716 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-17T11:39:56.722 INFO:teuthology.orchestra.run.smithi060.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2023-05-17T11:39:57.155 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 28.5 kB in 1s (50.8 kB/s) 2023-05-17T11:39:57.158 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 28.5 kB in 1s (51.6 kB/s) 2023-05-17T11:39:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2023-05-17T11:39:58.034 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-05-17T11:39:58.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3926-g27be5126-1jammy cephadm=18.0.0-3926-g27be5126-1jammy ceph-mds=18.0.0-3926-g27be5126-1jammy ceph-mgr=18.0.0-3926-g27be5126-1jammy ceph-common=18.0.0-3926-g27be5126-1jammy ceph-fuse=18.0.0-3926-g27be5126-1jammy ceph-test=18.0.0-3926-g27be5126-1jammy ceph-volume=18.0.0-3926-g27be5126-1jammy radosgw=18.0.0-3926-g27be5126-1jammy python3-rados=18.0.0-3926-g27be5126-1jammy python3-rgw=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy python3-rbd=18.0.0-3926-g27be5126-1jammy libcephfs2=18.0.0-3926-g27be5126-1jammy libcephfs-dev=18.0.0-3926-g27be5126-1jammy librados2=18.0.0-3926-g27be5126-1jammy librbd1=18.0.0-3926-g27be5126-1jammy rbd-fuse=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy cephfs-shell=18.0.0-3926-g27be5126-1jammy cephfs-top=18.0.0-3926-g27be5126-1jammy cephfs-mirror=18.0.0-3926-g27be5126-1jammy 2023-05-17T11:39:58.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3926-g27be5126-1jammy cephadm=18.0.0-3926-g27be5126-1jammy ceph-mds=18.0.0-3926-g27be5126-1jammy ceph-mgr=18.0.0-3926-g27be5126-1jammy ceph-common=18.0.0-3926-g27be5126-1jammy ceph-fuse=18.0.0-3926-g27be5126-1jammy ceph-test=18.0.0-3926-g27be5126-1jammy ceph-volume=18.0.0-3926-g27be5126-1jammy radosgw=18.0.0-3926-g27be5126-1jammy python3-rados=18.0.0-3926-g27be5126-1jammy python3-rgw=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy python3-rbd=18.0.0-3926-g27be5126-1jammy libcephfs2=18.0.0-3926-g27be5126-1jammy libcephfs-dev=18.0.0-3926-g27be5126-1jammy librados2=18.0.0-3926-g27be5126-1jammy librbd1=18.0.0-3926-g27be5126-1jammy rbd-fuse=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy cephfs-shell=18.0.0-3926-g27be5126-1jammy cephfs-top=18.0.0-3926-g27be5126-1jammy cephfs-mirror=18.0.0-3926-g27be5126-1jammy 2023-05-17T11:39:58.123 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2023-05-17T11:39:58.126 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-05-17T11:39:58.280 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-05-17T11:39:58.281 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-05-17T11:39:58.283 INFO:teuthology.orchestra.run.smithi060.stdout:Building dependency tree... 2023-05-17T11:39:58.284 INFO:teuthology.orchestra.run.smithi060.stdout:Reading state information... 2023-05-17T11:39:58.423 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-05-17T11:39:58.424 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-17T11:39:58.424 INFO:teuthology.orchestra.run.smithi003.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-17T11:39:58.424 INFO:teuthology.orchestra.run.smithi003.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-17T11:39:58.424 INFO:teuthology.orchestra.run.smithi003.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-17T11:39:58.425 INFO:teuthology.orchestra.run.smithi003.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-17T11:39:58.425 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-17T11:39:58.426 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-05-17T11:39:58.426 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-17T11:39:58.426 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-17T11:39:58.426 INFO:teuthology.orchestra.run.smithi003.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-17T11:39:58.426 INFO:teuthology.orchestra.run.smithi003.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-17T11:39:58.427 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-17T11:39:58.428 INFO:teuthology.orchestra.run.smithi003.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-17T11:39:58.428 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-17T11:39:58.429 INFO:teuthology.orchestra.run.smithi003.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-17T11:39:58.430 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-17T11:39:58.431 INFO:teuthology.orchestra.run.smithi003.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-17T11:39:58.432 INFO:teuthology.orchestra.run.smithi003.stdout: python3-watchdog 2023-05-17T11:39:58.432 INFO:teuthology.orchestra.run.smithi003.stdout:Recommended packages: 2023-05-17T11:39:58.432 INFO:teuthology.orchestra.run.smithi003.stdout: btrfs-tools 2023-05-17T11:39:58.433 INFO:teuthology.orchestra.run.smithi060.stdout:The following packages were automatically installed and are no longer required: 2023-05-17T11:39:58.433 INFO:teuthology.orchestra.run.smithi060.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-17T11:39:58.433 INFO:teuthology.orchestra.run.smithi060.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-17T11:39:58.433 INFO:teuthology.orchestra.run.smithi060.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-17T11:39:58.434 INFO:teuthology.orchestra.run.smithi060.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-17T11:39:58.434 INFO:teuthology.orchestra.run.smithi060.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-17T11:39:58.434 INFO:teuthology.orchestra.run.smithi060.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-17T11:39:58.434 INFO:teuthology.orchestra.run.smithi060.stdout:The following additional packages will be installed: 2023-05-17T11:39:58.434 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-17T11:39:58.436 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-17T11:39:58.436 INFO:teuthology.orchestra.run.smithi060.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-17T11:39:58.436 INFO:teuthology.orchestra.run.smithi060.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-17T11:39:58.436 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-17T11:39:58.437 INFO:teuthology.orchestra.run.smithi060.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-17T11:39:58.437 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-17T11:39:58.437 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-17T11:39:58.438 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-17T11:39:58.438 INFO:teuthology.orchestra.run.smithi060.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-17T11:39:58.438 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-17T11:39:58.438 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-17T11:39:58.439 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-17T11:39:58.439 INFO:teuthology.orchestra.run.smithi060.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-17T11:39:58.439 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-17T11:39:58.439 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-17T11:39:58.440 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-17T11:39:58.440 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-17T11:39:58.440 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-17T11:39:58.440 INFO:teuthology.orchestra.run.smithi060.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-17T11:39:58.441 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-17T11:39:58.441 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-17T11:39:58.441 INFO:teuthology.orchestra.run.smithi060.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-17T11:39:58.442 INFO:teuthology.orchestra.run.smithi060.stdout:Suggested packages: 2023-05-17T11:39:58.442 INFO:teuthology.orchestra.run.smithi060.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout: python3-watchdog 2023-05-17T11:39:58.443 INFO:teuthology.orchestra.run.smithi060.stdout:Recommended packages: 2023-05-17T11:39:58.444 INFO:teuthology.orchestra.run.smithi060.stdout: btrfs-tools 2023-05-17T11:39:58.566 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-05-17T11:39:58.566 INFO:teuthology.orchestra.run.smithi003.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-17T11:39:58.567 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-17T11:39:58.567 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-17T11:39:58.567 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-17T11:39:58.567 INFO:teuthology.orchestra.run.smithi003.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-17T11:39:58.567 INFO:teuthology.orchestra.run.smithi003.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-17T11:39:58.567 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-17T11:39:58.568 INFO:teuthology.orchestra.run.smithi003.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-17T11:39:58.569 INFO:teuthology.orchestra.run.smithi003.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-17T11:39:58.570 INFO:teuthology.orchestra.run.smithi003.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-17T11:39:58.571 INFO:teuthology.orchestra.run.smithi003.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-17T11:39:58.571 INFO:teuthology.orchestra.run.smithi003.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-17T11:39:58.571 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-17T11:39:58.571 INFO:teuthology.orchestra.run.smithi003.stdout: socat xmlstarlet 2023-05-17T11:39:58.575 INFO:teuthology.orchestra.run.smithi060.stdout:The following NEW packages will be installed: 2023-05-17T11:39:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-17T11:39:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-17T11:39:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-17T11:39:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-17T11:39:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-17T11:39:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-17T11:39:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-17T11:39:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-17T11:39:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-17T11:39:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-17T11:39:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-17T11:39:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-17T11:39:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-17T11:39:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-17T11:39:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-17T11:39:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-17T11:39:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-17T11:39:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-17T11:39:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-17T11:39:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-17T11:39:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-17T11:39:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-17T11:39:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-17T11:39:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-17T11:39:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-17T11:39:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-17T11:39:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: socat xmlstarlet 2023-05-17T11:39:58.727 INFO:teuthology.orchestra.run.smithi003.stdout:0 upgraded, 115 newly installed, 0 to remove and 148 not upgraded. 2023-05-17T11:39:58.727 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 175 MB of archives. 2023-05-17T11:39:58.727 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-17T11:39:58.728 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3926-g27be5126-1jammy [3,403 kB] 2023-05-17T11:39:58.728 INFO:teuthology.orchestra.run.smithi060.stdout:0 upgraded, 115 newly installed, 0 to remove and 148 not upgraded. 2023-05-17T11:39:58.728 INFO:teuthology.orchestra.run.smithi060.stdout:Need to get 175 MB of archives. 2023-05-17T11:39:58.728 INFO:teuthology.orchestra.run.smithi060.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-17T11:39:58.728 INFO:teuthology.orchestra.run.smithi060.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3926-g27be5126-1jammy [3,403 kB] 2023-05-17T11:39:58.763 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-17T11:39:58.777 INFO:teuthology.orchestra.run.smithi060.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-17T11:39:58.845 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-17T11:39:58.866 INFO:teuthology.orchestra.run.smithi060.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-17T11:39:58.891 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-17T11:39:58.915 INFO:teuthology.orchestra.run.smithi060.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-17T11:39:58.993 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3926-g27be5126-1jammy [3,095 kB] 2023-05-17T11:39:59.086 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-17T11:39:59.105 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3926-g27be5126-1jammy [657 kB] 2023-05-17T11:39:59.126 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3926-g27be5126-1jammy [343 kB] 2023-05-17T11:39:59.129 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-17T11:39:59.137 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3926-g27be5126-1jammy [23.0 kB] 2023-05-17T11:39:59.138 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3926-g27be5126-1jammy [170 kB] 2023-05-17T11:39:59.144 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3926-g27be5126-1jammy [49.0 kB] 2023-05-17T11:39:59.145 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3926-g27be5126-1jammy [319 kB] 2023-05-17T11:39:59.155 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3926-g27be5126-1jammy [5,850 kB] 2023-05-17T11:39:59.160 INFO:teuthology.orchestra.run.smithi060.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-17T11:39:59.205 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-17T11:39:59.216 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-17T11:39:59.244 INFO:teuthology.orchestra.run.smithi060.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-17T11:39:59.262 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-17T11:39:59.444 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-17T11:39:59.452 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-17T11:39:59.486 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-17T11:39:59.531 INFO:teuthology.orchestra.run.smithi060.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-17T11:39:59.578 INFO:teuthology.orchestra.run.smithi060.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3926-g27be5126-1jammy [3,095 kB] 2023-05-17T11:39:59.592 INFO:teuthology.orchestra.run.smithi060.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-17T11:39:59.659 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-17T11:39:59.667 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3926-g27be5126-1jammy [102 kB] 2023-05-17T11:39:59.668 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3926-g27be5126-1jammy [429 kB] 2023-05-17T11:39:59.682 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3926-g27be5126-1jammy [21.9 MB] 2023-05-17T11:39:59.855 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-17T11:39:59.937 INFO:teuthology.orchestra.run.smithi060.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3926-g27be5126-1jammy [657 kB] 2023-05-17T11:39:59.948 INFO:teuthology.orchestra.run.smithi060.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3926-g27be5126-1jammy [343 kB] 2023-05-17T11:39:59.960 INFO:teuthology.orchestra.run.smithi060.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-17T11:39:59.986 INFO:teuthology.orchestra.run.smithi060.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3926-g27be5126-1jammy [23.0 kB] 2023-05-17T11:39:59.987 INFO:teuthology.orchestra.run.smithi060.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3926-g27be5126-1jammy [170 kB] 2023-05-17T11:39:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3926-g27be5126-1jammy [49.0 kB] 2023-05-17T11:39:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3926-g27be5126-1jammy [319 kB] 2023-05-17T11:40:00.024 INFO:teuthology.orchestra.run.smithi060.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3926-g27be5126-1jammy [5,850 kB] 2023-05-17T11:40:00.219 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-17T11:40:00.226 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-17T11:40:00.228 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-17T11:40:00.240 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-17T11:40:00.242 INFO:teuthology.orchestra.run.smithi003.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-17T11:40:00.243 INFO:teuthology.orchestra.run.smithi003.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-17T11:40:00.244 INFO:teuthology.orchestra.run.smithi003.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-17T11:40:00.246 INFO:teuthology.orchestra.run.smithi003.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-17T11:40:00.247 INFO:teuthology.orchestra.run.smithi003.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-17T11:40:00.413 INFO:teuthology.orchestra.run.smithi003.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-17T11:40:00.597 INFO:teuthology.orchestra.run.smithi060.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3926-g27be5126-1jammy [102 kB] 2023-05-17T11:40:00.599 INFO:teuthology.orchestra.run.smithi060.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3926-g27be5126-1jammy [429 kB] 2023-05-17T11:40:00.651 INFO:teuthology.orchestra.run.smithi060.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3926-g27be5126-1jammy [21.9 MB] 2023-05-17T11:40:00.807 INFO:teuthology.orchestra.run.smithi003.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3926-g27be5126-1jammy [6,825 kB] 2023-05-17T11:40:00.847 INFO:teuthology.orchestra.run.smithi003.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-17T11:40:00.856 INFO:teuthology.orchestra.run.smithi003.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-17T11:40:00.861 INFO:teuthology.orchestra.run.smithi003.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-17T11:40:00.865 INFO:teuthology.orchestra.run.smithi003.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-17T11:40:00.883 INFO:teuthology.orchestra.run.smithi003.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-17T11:40:00.886 INFO:teuthology.orchestra.run.smithi003.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-17T11:40:00.888 INFO:teuthology.orchestra.run.smithi003.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-17T11:40:00.930 INFO:teuthology.orchestra.run.smithi003.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-17T11:40:00.944 INFO:teuthology.orchestra.run.smithi003.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-17T11:40:00.949 INFO:teuthology.orchestra.run.smithi003.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-17T11:40:01.144 INFO:teuthology.orchestra.run.smithi003.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3926-g27be5126-1jammy [226 kB] 2023-05-17T11:40:01.149 INFO:teuthology.orchestra.run.smithi003.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3926-g27be5126-1jammy [114 kB] 2023-05-17T11:40:01.152 INFO:teuthology.orchestra.run.smithi003.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3926-g27be5126-1jammy [1,469 kB] 2023-05-17T11:40:01.202 INFO:teuthology.orchestra.run.smithi003.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-17T11:40:01.225 INFO:teuthology.orchestra.run.smithi003.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3926-g27be5126-1jammy [9,853 kB] 2023-05-17T11:40:01.285 INFO:teuthology.orchestra.run.smithi003.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-17T11:40:01.375 INFO:teuthology.orchestra.run.smithi003.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-17T11:40:01.431 INFO:teuthology.orchestra.run.smithi003.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-17T11:40:01.550 INFO:teuthology.orchestra.run.smithi003.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-17T11:40:01.635 INFO:teuthology.orchestra.run.smithi003.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-17T11:40:01.654 INFO:teuthology.orchestra.run.smithi003.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-17T11:40:01.683 INFO:teuthology.orchestra.run.smithi003.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-17T11:40:01.695 INFO:teuthology.orchestra.run.smithi003.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-17T11:40:01.732 INFO:teuthology.orchestra.run.smithi003.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-17T11:40:01.740 INFO:teuthology.orchestra.run.smithi003.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-17T11:40:01.752 INFO:teuthology.orchestra.run.smithi003.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3926-g27be5126-1jammy [31.5 MB] 2023-05-17T11:40:01.931 INFO:teuthology.orchestra.run.smithi003.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-17T11:40:02.776 INFO:teuthology.orchestra.run.smithi003.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-17T11:40:02.777 INFO:teuthology.orchestra.run.smithi003.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-17T11:40:02.782 INFO:teuthology.orchestra.run.smithi003.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-17T11:40:02.783 INFO:teuthology.orchestra.run.smithi003.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-17T11:40:02.783 INFO:teuthology.orchestra.run.smithi003.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-17T11:40:02.796 INFO:teuthology.orchestra.run.smithi003.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-17T11:40:02.858 INFO:teuthology.orchestra.run.smithi003.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-17T11:40:02.860 INFO:teuthology.orchestra.run.smithi003.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-17T11:40:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-17T11:40:02.923 INFO:teuthology.orchestra.run.smithi003.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-17T11:40:03.019 INFO:teuthology.orchestra.run.smithi003.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3926-g27be5126-1jammy [3,592 B] 2023-05-17T11:40:03.020 INFO:teuthology.orchestra.run.smithi003.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3926-g27be5126-1jammy [810 kB] 2023-05-17T11:40:03.035 INFO:teuthology.orchestra.run.smithi003.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3926-g27be5126-1jammy [2,157 kB] 2023-05-17T11:40:03.060 INFO:teuthology.orchestra.run.smithi060.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-17T11:40:03.088 INFO:teuthology.orchestra.run.smithi003.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-17T11:40:03.106 INFO:teuthology.orchestra.run.smithi003.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3926-g27be5126-1jammy [96.5 kB] 2023-05-17T11:40:03.109 INFO:teuthology.orchestra.run.smithi003.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3926-g27be5126-1jammy [124 kB] 2023-05-17T11:40:03.113 INFO:teuthology.orchestra.run.smithi003.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3926-g27be5126-1jammy [1,840 kB] 2023-05-17T11:40:03.174 INFO:teuthology.orchestra.run.smithi003.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3926-g27be5126-1jammy [8,615 kB] 2023-05-17T11:40:03.350 INFO:teuthology.orchestra.run.smithi003.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-17T11:40:03.383 INFO:teuthology.orchestra.run.smithi003.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-17T11:40:03.414 INFO:teuthology.orchestra.run.smithi003.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-17T11:40:03.414 INFO:teuthology.orchestra.run.smithi060.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-17T11:40:03.462 INFO:teuthology.orchestra.run.smithi003.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-17T11:40:03.471 INFO:teuthology.orchestra.run.smithi003.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3926-g27be5126-1jammy [3,724 B] 2023-05-17T11:40:03.471 INFO:teuthology.orchestra.run.smithi003.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3926-g27be5126-1jammy [40.9 MB] 2023-05-17T11:40:03.481 INFO:teuthology.orchestra.run.smithi003.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-17T11:40:03.509 INFO:teuthology.orchestra.run.smithi003.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-17T11:40:03.710 INFO:teuthology.orchestra.run.smithi003.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-17T11:40:03.762 INFO:teuthology.orchestra.run.smithi003.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-17T11:40:03.812 INFO:teuthology.orchestra.run.smithi003.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-17T11:40:03.819 INFO:teuthology.orchestra.run.smithi003.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-17T11:40:04.046 INFO:teuthology.orchestra.run.smithi003.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-17T11:40:04.193 INFO:teuthology.orchestra.run.smithi060.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3926-g27be5126-1jammy [6,825 kB] 2023-05-17T11:40:04.511 INFO:teuthology.orchestra.run.smithi003.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-17T11:40:04.517 INFO:teuthology.orchestra.run.smithi003.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-17T11:40:04.585 INFO:teuthology.orchestra.run.smithi060.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-17T11:40:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-17T11:40:04.707 INFO:teuthology.orchestra.run.smithi003.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-17T11:40:04.711 INFO:teuthology.orchestra.run.smithi003.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-17T11:40:04.713 INFO:teuthology.orchestra.run.smithi003.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-17T11:40:04.715 INFO:teuthology.orchestra.run.smithi003.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-17T11:40:04.737 INFO:teuthology.orchestra.run.smithi003.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-17T11:40:04.744 INFO:teuthology.orchestra.run.smithi003.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-17T11:40:04.803 INFO:teuthology.orchestra.run.smithi003.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-17T11:40:04.968 INFO:teuthology.orchestra.run.smithi003.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-17T11:40:05.136 INFO:teuthology.orchestra.run.smithi003.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-17T11:40:05.171 INFO:teuthology.orchestra.run.smithi060.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-17T11:40:05.230 INFO:teuthology.orchestra.run.smithi060.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3926-g27be5126-1jammy [226 kB] 2023-05-17T11:40:05.235 INFO:teuthology.orchestra.run.smithi060.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3926-g27be5126-1jammy [114 kB] 2023-05-17T11:40:05.239 INFO:teuthology.orchestra.run.smithi060.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3926-g27be5126-1jammy [1,469 kB] 2023-05-17T11:40:05.360 INFO:teuthology.orchestra.run.smithi060.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3926-g27be5126-1jammy [9,853 kB] 2023-05-17T11:40:05.367 INFO:teuthology.orchestra.run.smithi060.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-17T11:40:05.416 INFO:teuthology.orchestra.run.smithi003.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-17T11:40:05.442 INFO:teuthology.orchestra.run.smithi003.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-17T11:40:05.603 INFO:teuthology.orchestra.run.smithi003.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3926-g27be5126-1jammy [238 kB] 2023-05-17T11:40:05.606 INFO:teuthology.orchestra.run.smithi003.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3926-g27be5126-1jammy [214 kB] 2023-05-17T11:40:05.607 INFO:teuthology.orchestra.run.smithi003.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3926-g27be5126-1jammy [23.8 kB] 2023-05-17T11:40:05.608 INFO:teuthology.orchestra.run.smithi003.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3926-g27be5126-1jammy [13.2 kB] 2023-05-17T11:40:05.608 INFO:teuthology.orchestra.run.smithi003.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3926-g27be5126-1jammy [28.3 kB] 2023-05-17T11:40:05.609 INFO:teuthology.orchestra.run.smithi003.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3926-g27be5126-1jammy [11.5 MB] 2023-05-17T11:40:06.068 INFO:teuthology.orchestra.run.smithi060.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-17T11:40:06.100 INFO:teuthology.orchestra.run.smithi060.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3926-g27be5126-1jammy [31.5 MB] 2023-05-17T11:40:06.101 INFO:teuthology.orchestra.run.smithi060.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-17T11:40:06.108 INFO:teuthology.orchestra.run.smithi060.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-17T11:40:06.167 INFO:teuthology.orchestra.run.smithi060.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-17T11:40:06.171 INFO:teuthology.orchestra.run.smithi060.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-17T11:40:06.180 INFO:teuthology.orchestra.run.smithi060.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-17T11:40:06.189 INFO:teuthology.orchestra.run.smithi060.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-17T11:40:06.200 INFO:teuthology.orchestra.run.smithi060.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-17T11:40:06.207 INFO:teuthology.orchestra.run.smithi060.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-17T11:40:06.277 INFO:teuthology.orchestra.run.smithi003.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3926-g27be5126-1jammy [82.1 kB] 2023-05-17T11:40:06.382 INFO:teuthology.orchestra.run.smithi060.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-17T11:40:06.848 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 175 MB in 8s (22.7 MB/s) 2023-05-17T11:40:06.923 INFO:teuthology.orchestra.run.smithi060.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-17T11:40:06.979 INFO:teuthology.orchestra.run.smithi060.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-17T11:40:06.993 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-17T11:40:07.009 INFO:teuthology.orchestra.run.smithi060.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-17T11:40:07.021 INFO:teuthology.orchestra.run.smithi060.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-17T11:40:07.063 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132939 files and directories currently installed.) 2023-05-17T11:40:07.066 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-17T11:40:07.097 INFO:teuthology.orchestra.run.smithi060.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-17T11:40:07.108 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-17T11:40:07.109 INFO:teuthology.orchestra.run.smithi060.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-17T11:40:07.111 INFO:teuthology.orchestra.run.smithi060.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-17T11:40:07.219 INFO:teuthology.orchestra.run.smithi060.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-17T11:40:07.251 INFO:teuthology.orchestra.run.smithi060.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3926-g27be5126-1jammy [3,592 B] 2023-05-17T11:40:07.251 INFO:teuthology.orchestra.run.smithi060.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3926-g27be5126-1jammy [810 kB] 2023-05-17T11:40:07.266 INFO:teuthology.orchestra.run.smithi060.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3926-g27be5126-1jammy [2,157 kB] 2023-05-17T11:40:07.277 INFO:teuthology.orchestra.run.smithi060.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-17T11:40:07.311 INFO:teuthology.orchestra.run.smithi060.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-17T11:40:07.337 INFO:teuthology.orchestra.run.smithi060.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3926-g27be5126-1jammy [96.5 kB] 2023-05-17T11:40:07.339 INFO:teuthology.orchestra.run.smithi060.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3926-g27be5126-1jammy [124 kB] 2023-05-17T11:40:07.344 INFO:teuthology.orchestra.run.smithi060.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3926-g27be5126-1jammy [1,840 kB] 2023-05-17T11:40:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3926-g27be5126-1jammy [8,615 kB] 2023-05-17T11:40:07.419 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-17T11:40:07.432 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-17T11:40:07.469 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-17T11:40:07.690 INFO:teuthology.orchestra.run.smithi060.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3926-g27be5126-1jammy [3,724 B] 2023-05-17T11:40:07.690 INFO:teuthology.orchestra.run.smithi060.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3926-g27be5126-1jammy [40.9 MB] 2023-05-17T11:40:07.780 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cmd2. 2023-05-17T11:40:07.793 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-17T11:40:07.831 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-17T11:40:08.150 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-17T11:40:08.164 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-17T11:40:08.168 INFO:teuthology.orchestra.run.smithi060.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-17T11:40:08.242 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-17T11:40:08.251 INFO:teuthology.orchestra.run.smithi060.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-17T11:40:08.341 INFO:teuthology.orchestra.run.smithi060.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-17T11:40:08.398 INFO:teuthology.orchestra.run.smithi060.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-17T11:40:08.544 INFO:teuthology.orchestra.run.smithi060.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-17T11:40:08.545 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-17T11:40:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-17T11:40:08.603 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-17T11:40:08.700 INFO:teuthology.orchestra.run.smithi060.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-17T11:40:08.742 INFO:teuthology.orchestra.run.smithi060.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-17T11:40:08.846 INFO:teuthology.orchestra.run.smithi060.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-17T11:40:08.894 INFO:teuthology.orchestra.run.smithi060.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-17T11:40:08.923 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-17T11:40:08.937 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-17T11:40:08.981 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-17T11:40:09.043 INFO:teuthology.orchestra.run.smithi060.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3926-g27be5126-1jammy [238 kB] 2023-05-17T11:40:09.045 INFO:teuthology.orchestra.run.smithi060.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3926-g27be5126-1jammy [214 kB] 2023-05-17T11:40:09.048 INFO:teuthology.orchestra.run.smithi060.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3926-g27be5126-1jammy [23.8 kB] 2023-05-17T11:40:09.048 INFO:teuthology.orchestra.run.smithi060.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3926-g27be5126-1jammy [13.2 kB] 2023-05-17T11:40:09.049 INFO:teuthology.orchestra.run.smithi060.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-17T11:40:09.049 INFO:teuthology.orchestra.run.smithi060.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3926-g27be5126-1jammy [28.3 kB] 2023-05-17T11:40:09.050 INFO:teuthology.orchestra.run.smithi060.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3926-g27be5126-1jammy [11.5 MB] 2023-05-17T11:40:09.110 INFO:teuthology.orchestra.run.smithi060.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-17T11:40:09.351 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-17T11:40:09.365 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-17T11:40:09.409 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-17T11:40:09.427 INFO:teuthology.orchestra.run.smithi060.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3926-g27be5126-1jammy [82.1 kB] 2023-05-17T11:40:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-17T11:40:09.846 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-17T11:40:09.859 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-17T11:40:09.912 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:40:10.316 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-17T11:40:10.329 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-17T11:40:10.541 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:40:10.877 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-17T11:40:10.891 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-17T11:40:10.935 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:40:11.230 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-17T11:40:11.244 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-17T11:40:11.288 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-17T11:40:11.599 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librados2. 2023-05-17T11:40:11.613 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../011-librados2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:11.658 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:12.085 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librbd1. 2023-05-17T11:40:12.099 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../012-librbd1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:12.144 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:12.529 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libcephfs2. 2023-05-17T11:40:12.543 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:12.580 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:12.841 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rados. 2023-05-17T11:40:12.854 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:12.899 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:13.201 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-17T11:40:13.215 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:13.260 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:13.495 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cephfs. 2023-05-17T11:40:13.509 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:13.554 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-17T11:40:13.845 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:13.890 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:14.218 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-prettytable. 2023-05-17T11:40:14.231 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-17T11:40:14.276 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-17T11:40:14.537 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rbd. 2023-05-17T11:40:14.550 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:14.915 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-17T11:40:14.928 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-17T11:40:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-17T11:40:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librgw2. 2023-05-17T11:40:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../021-librgw2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:15.853 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rgw. 2023-05-17T11:40:15.867 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:15.912 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:16.198 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-17T11:40:16.211 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-17T11:40:16.248 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-17T11:40:16.534 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libradosstriper1. 2023-05-17T11:40:16.548 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-common. 2023-05-17T11:40:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:18.085 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-base. 2023-05-17T11:40:18.098 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:18.160 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:18.888 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-17T11:40:18.902 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-17T11:40:18.938 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-17T11:40:18.964 INFO:teuthology.orchestra.run.smithi060.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-17T11:40:19.172 INFO:teuthology.orchestra.run.smithi060.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-17T11:40:19.250 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cheroot. 2023-05-17T11:40:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-17T11:40:19.308 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-17T11:40:19.349 INFO:teuthology.orchestra.run.smithi060.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-17T11:40:19.415 INFO:teuthology.orchestra.run.smithi060.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-17T11:40:19.433 INFO:teuthology.orchestra.run.smithi060.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-17T11:40:19.590 INFO:teuthology.orchestra.run.smithi060.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-17T11:40:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-17T11:40:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-17T11:40:19.686 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-17T11:40:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-17T11:40:20.002 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-17T11:40:20.047 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-17T11:40:20.308 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-17T11:40:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-17T11:40:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-17T11:40:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-tempora. 2023-05-17T11:40:20.674 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-17T11:40:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-17T11:40:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-portend. 2023-05-17T11:40:21.219 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-17T11:40:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-17T11:40:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-17T11:40:21.530 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-17T11:40:21.566 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-17T11:40:21.861 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-17T11:40:21.875 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-17T11:40:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-17T11:40:22.256 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-natsort. 2023-05-17T11:40:22.270 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-17T11:40:22.314 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-17T11:40:22.617 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-logutils. 2023-05-17T11:40:22.631 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-17T11:40:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-17T11:40:22.928 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-17T11:40:22.942 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-17T11:40:22.978 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-17T11:40:23.251 INFO:teuthology.orchestra.run.smithi060.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-17T11:40:23.273 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-mako. 2023-05-17T11:40:23.287 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-17T11:40:23.331 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-17T11:40:23.603 INFO:teuthology.orchestra.run.smithi060.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-17T11:40:23.635 INFO:teuthology.orchestra.run.smithi060.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-17T11:40:23.660 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-17T11:40:23.674 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-17T11:40:23.709 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-17T11:40:23.954 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-17T11:40:23.968 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-17T11:40:24.004 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-17T11:40:24.290 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webob. 2023-05-17T11:40:24.304 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-17T11:40:24.356 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-17T11:40:24.693 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-waitress. 2023-05-17T11:40:24.707 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-17T11:40:24.754 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-17T11:40:25.012 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-tempita. 2023-05-17T11:40:25.026 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-17T11:40:25.062 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-17T11:40:25.357 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-paste. 2023-05-17T11:40:25.371 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-17T11:40:25.417 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-17T11:40:25.712 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-17T11:40:25.726 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-17T11:40:25.770 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-17T11:40:26.073 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-17T11:40:26.087 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-17T11:40:26.139 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-17T11:40:26.434 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webtest. 2023-05-17T11:40:26.449 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-17T11:40:26.492 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-17T11:40:26.553 INFO:teuthology.orchestra.run.smithi060.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-17T11:40:26.724 INFO:teuthology.orchestra.run.smithi060.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-17T11:40:26.803 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pecan. 2023-05-17T11:40:26.817 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-17T11:40:26.861 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-17T11:40:26.981 INFO:teuthology.orchestra.run.smithi060.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-17T11:40:27.013 INFO:teuthology.orchestra.run.smithi060.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-17T11:40:27.040 INFO:teuthology.orchestra.run.smithi060.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-17T11:40:27.094 INFO:teuthology.orchestra.run.smithi060.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-17T11:40:27.111 INFO:teuthology.orchestra.run.smithi060.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-17T11:40:27.140 INFO:teuthology.orchestra.run.smithi060.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-17T11:40:27.233 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-certifi. 2023-05-17T11:40:27.247 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-17T11:40:27.291 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-17T11:40:27.566 INFO:teuthology.orchestra.run.smithi060.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-17T11:40:27.586 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-idna. 2023-05-17T11:40:27.600 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-17T11:40:27.644 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-17T11:40:27.787 INFO:teuthology.orchestra.run.smithi060.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-17T11:40:27.891 INFO:teuthology.orchestra.run.smithi060.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-17T11:40:27.926 INFO:teuthology.orchestra.run.smithi060.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-17T11:40:27.980 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-urllib3. 2023-05-17T11:40:27.994 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-17T11:40:28.038 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-17T11:40:28.342 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-requests. 2023-05-17T11:40:28.356 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-17T11:40:28.400 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-17T11:40:28.417 INFO:teuthology.orchestra.run.smithi060.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-17T11:40:28.719 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-17T11:40:28.733 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-17T11:40:28.794 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-17T11:40:28.998 INFO:teuthology.orchestra.run.smithi060.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-17T11:40:29.009 INFO:teuthology.orchestra.run.smithi060.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-17T11:40:29.081 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-17T11:40:29.095 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:29.139 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:29.468 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-17T11:40:29.482 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:29.510 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:29.813 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-openssl. 2023-05-17T11:40:29.827 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-17T11:40:29.871 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-17T11:40:29.900 INFO:teuthology.orchestra.run.smithi060.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-17T11:40:30.191 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr. 2023-05-17T11:40:30.205 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:30.249 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:30.457 INFO:teuthology.orchestra.run.smithi060.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-17T11:40:30.466 INFO:teuthology.orchestra.run.smithi060.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-17T11:40:30.575 INFO:teuthology.orchestra.run.smithi060.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-17T11:40:30.585 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mon. 2023-05-17T11:40:30.599 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:30.607 INFO:teuthology.orchestra.run.smithi060.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-17T11:40:30.644 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:30.827 INFO:teuthology.orchestra.run.smithi060.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-17T11:40:30.903 INFO:teuthology.orchestra.run.smithi060.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-17T11:40:31.422 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-osd. 2023-05-17T11:40:31.436 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:31.480 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:31.781 INFO:teuthology.orchestra.run.smithi060.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-17T11:40:31.972 INFO:teuthology.orchestra.run.smithi060.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-17T11:40:32.148 INFO:teuthology.orchestra.run.smithi060.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-17T11:40:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-17T11:40:32.450 INFO:teuthology.orchestra.run.smithi060.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-17T11:40:33.184 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph. 2023-05-17T11:40:33.197 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../061-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:33.242 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:33.528 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-fuse. 2023-05-17T11:40:33.542 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:33.578 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:33.948 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mds. 2023-05-17T11:40:33.962 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:34.006 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:34.375 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephadm. 2023-05-17T11:40:34.389 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../064-cephadm_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:34.434 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:34.720 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-17T11:40:34.735 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-17T11:40:34.770 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-17T11:40:35.048 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-17T11:40:35.062 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-17T11:40:35.106 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-17T11:40:35.836 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 175 MB in 37s (4,765 kB/s) 2023-05-17T11:40:35.984 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-17T11:40:36.053 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-babel. 2023-05-17T11:40:36.054 INFO:teuthology.orchestra.run.smithi060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132939 files and directories currently installed.) 2023-05-17T11:40:36.058 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-17T11:40:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-17T11:40:36.100 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-17T11:40:36.103 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-17T11:40:36.386 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-17T11:40:36.398 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-17T11:40:36.453 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-17T11:40:36.589 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jinja2. 2023-05-17T11:40:36.603 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-17T11:40:36.647 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-17T11:40:36.872 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cmd2. 2023-05-17T11:40:36.885 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-17T11:40:36.922 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-17T11:40:37.025 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-17T11:40:37.039 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:37.092 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:37.225 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-17T11:40:37.239 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-17T11:40:37.325 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-17T11:40:37.421 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-17T11:40:37.434 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-17T11:40:37.479 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-17T11:40:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-17T11:40:37.608 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-17T11:40:37.653 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-17T11:40:37.790 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-17T11:40:37.804 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-17T11:40:37.848 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-17T11:40:37.990 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-17T11:40:38.003 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-17T11:40:38.048 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-17T11:40:38.160 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-routes. 2023-05-17T11:40:38.174 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-17T11:40:38.218 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-17T11:40:38.384 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-17T11:40:38.398 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-17T11:40:38.443 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-17T11:40:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-17T11:40:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:38.813 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-17T11:40:38.827 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-17T11:40:38.871 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:40:38.974 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-17T11:40:38.987 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-17T11:40:39.016 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-17T11:40:39.257 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-17T11:40:39.271 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-17T11:40:39.358 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:40:39.528 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-joblib. 2023-05-17T11:40:39.542 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-17T11:40:39.586 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-17T11:40:39.720 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-17T11:40:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-17T11:40:39.777 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:40:39.940 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-17T11:40:39.954 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-17T11:40:39.998 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-17T11:40:40.089 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-17T11:40:40.102 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-17T11:40:40.139 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-17T11:40:40.309 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-sklearn. 2023-05-17T11:40:40.323 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-17T11:40:40.367 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-17T11:40:40.450 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librados2. 2023-05-17T11:40:40.463 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../011-librados2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:40.508 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:40.928 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librbd1. 2023-05-17T11:40:40.941 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../012-librbd1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:40.986 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:41.042 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-17T11:40:41.055 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:41.092 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:41.364 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libcephfs2. 2023-05-17T11:40:41.378 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:41.414 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:41.858 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rados. 2023-05-17T11:40:41.871 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:41.916 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:42.054 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cachetools. 2023-05-17T11:40:42.068 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-17T11:40:42.104 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-17T11:40:42.236 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-17T11:40:42.249 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:42.294 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:42.390 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-17T11:40:42.405 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-17T11:40:42.448 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-17T11:40:42.547 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cephfs. 2023-05-17T11:40:42.560 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:42.605 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:42.768 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-17T11:40:42.782 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-17T11:40:42.834 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-17T11:40:42.907 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-17T11:40:42.921 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:42.966 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:43.170 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rsa. 2023-05-17T11:40:43.185 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-17T11:40:43.228 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-17T11:40:43.336 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-prettytable. 2023-05-17T11:40:43.349 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-17T11:40:43.394 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-17T11:40:43.625 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-google-auth. 2023-05-17T11:40:43.638 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rbd. 2023-05-17T11:40:43.640 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-17T11:40:43.652 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:43.683 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-17T11:40:43.696 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:43.971 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-17T11:40:43.984 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-17T11:40:43.991 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-17T11:40:44.004 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-17T11:40:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-17T11:40:44.049 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-17T11:40:44.340 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-websocket. 2023-05-17T11:40:44.354 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-17T11:40:44.369 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librgw2. 2023-05-17T11:40:44.382 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../021-librgw2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:44.398 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-17T11:40:44.427 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:44.718 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-17T11:40:44.733 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-17T11:40:44.776 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-17T11:40:44.888 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rgw. 2023-05-17T11:40:44.902 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:44.946 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:45.232 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-17T11:40:45.246 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-17T11:40:45.282 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-17T11:40:45.440 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-17T11:40:45.453 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:45.490 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:45.569 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libradosstriper1. 2023-05-17T11:40:45.582 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:45.627 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:45.775 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-17T11:40:45.789 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-17T11:40:45.826 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-17T11:40:46.022 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-common. 2023-05-17T11:40:46.035 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:46.162 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-17T11:40:46.177 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-17T11:40:46.237 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-17T11:40:46.498 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package jq. 2023-05-17T11:40:46.513 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-17T11:40:46.556 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-17T11:40:46.767 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package socat. 2023-05-17T11:40:46.781 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-17T11:40:46.817 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-17T11:40:47.095 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package xmlstarlet. 2023-05-17T11:40:47.110 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-17T11:40:47.153 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-17T11:40:47.203 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-base. 2023-05-17T11:40:47.217 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:47.270 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:47.533 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-test. 2023-05-17T11:40:47.546 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:47.582 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:47.923 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-17T11:40:47.936 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-17T11:40:47.965 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-17T11:40:48.243 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cheroot. 2023-05-17T11:40:48.256 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-17T11:40:48.301 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-17T11:40:48.613 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-17T11:40:48.626 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-17T11:40:48.671 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-17T11:40:48.974 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-17T11:40:48.988 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-17T11:40:49.032 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-17T11:40:49.170 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-volume. 2023-05-17T11:40:49.184 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:49.219 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:49.301 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-17T11:40:49.315 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-17T11:40:49.352 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-17T11:40:49.566 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-17T11:40:49.580 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:49.624 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:49.646 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-tempora. 2023-05-17T11:40:49.660 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-17T11:40:49.705 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-17T11:40:49.902 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-colorama. 2023-05-17T11:40:49.916 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-17T11:40:49.968 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-17T11:40:49.974 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-portend. 2023-05-17T11:40:49.988 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-17T11:40:50.032 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-17T11:40:50.230 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-shell. 2023-05-17T11:40:50.244 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:50.287 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:50.302 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-17T11:40:50.315 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-17T11:40:50.343 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-17T11:40:50.548 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-top. 2023-05-17T11:40:50.563 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:50.607 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:50.655 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-17T11:40:50.668 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-17T11:40:50.713 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-17T11:40:50.859 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-17T11:40:50.873 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:50.917 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:51.058 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-natsort. 2023-05-17T11:40:51.072 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-17T11:40:51.141 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-17T11:40:51.229 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package nvme-cli. 2023-05-17T11:40:51.243 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-17T11:40:51.279 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-17T11:40:51.462 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-logutils. 2023-05-17T11:40:51.475 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-17T11:40:51.520 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-17T11:40:51.743 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-17T11:40:51.756 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-17T11:40:51.800 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-17T11:40:51.822 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-17T11:40:51.837 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-17T11:40:52.039 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-17T11:40:52.263 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-17T11:40:52.276 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-17T11:40:52.345 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-17T11:40:52.409 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-mako. 2023-05-17T11:40:52.422 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-17T11:40:52.467 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-17T11:40:52.640 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pastescript. 2023-05-17T11:40:52.654 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-17T11:40:52.698 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-17T11:40:52.762 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-17T11:40:52.776 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-17T11:40:52.812 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-17T11:40:52.993 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pluggy. 2023-05-17T11:40:53.007 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-17T11:40:53.042 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-17T11:40:53.090 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-17T11:40:53.103 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-17T11:40:53.140 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-17T11:40:53.345 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-psutil. 2023-05-17T11:40:53.361 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-17T11:40:53.404 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-17T11:40:53.434 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-webob. 2023-05-17T11:40:53.448 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-17T11:40:53.492 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-17T11:40:53.748 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-py. 2023-05-17T11:40:53.763 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-17T11:40:53.798 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-17T11:40:53.837 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-waitress. 2023-05-17T11:40:53.851 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-17T11:40:53.898 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-17T11:40:54.093 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pygments. 2023-05-17T11:40:54.107 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-17T11:40:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-17T11:40:54.190 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-tempita. 2023-05-17T11:40:54.204 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-17T11:40:54.240 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-17T11:40:54.509 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-paste. 2023-05-17T11:40:54.523 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-17T11:40:54.568 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-17T11:40:54.605 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-17T11:40:54.618 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-17T11:40:54.663 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-17T11:40:54.888 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-17T11:40:54.901 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-17T11:40:54.974 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-toml. 2023-05-17T11:40:54.979 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-17T11:40:54.989 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-17T11:40:55.032 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-17T11:40:55.291 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-17T11:40:55.301 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pytest. 2023-05-17T11:40:55.304 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-17T11:40:55.316 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-17T11:40:55.349 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-17T11:40:55.351 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-17T11:40:55.610 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-webtest. 2023-05-17T11:40:55.624 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-17T11:40:55.660 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-17T11:40:55.713 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-simplejson. 2023-05-17T11:40:55.728 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-17T11:40:55.771 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-17T11:40:55.980 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pecan. 2023-05-17T11:40:55.994 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-17T11:40:56.038 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-17T11:40:56.049 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-17T11:40:56.064 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-17T11:40:56.107 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-17T11:40:56.401 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-certifi. 2023-05-17T11:40:56.415 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-17T11:40:56.459 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-17T11:40:56.746 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-idna. 2023-05-17T11:40:56.759 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-17T11:40:56.795 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-17T11:40:56.861 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package radosgw. 2023-05-17T11:40:56.874 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../113-radosgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:56.911 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:57.065 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-urllib3. 2023-05-17T11:40:57.079 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-17T11:40:57.123 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-17T11:40:57.418 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-requests. 2023-05-17T11:40:57.432 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-17T11:40:57.476 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-17T11:40:57.506 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package rbd-fuse. 2023-05-17T11:40:57.520 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:57.564 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:57.788 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-17T11:40:57.801 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-17T11:40:57.846 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-17T11:40:57.856 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-17T11:40:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-17T11:40:58.112 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:40:58.136 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-17T11:40:58.157 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:58.261 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-17T11:40:58.500 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-17T11:40:58.537 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-17T11:40:58.552 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:58.604 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:58.873 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-openssl. 2023-05-17T11:40:58.887 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-17T11:40:58.919 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-17T11:40:58.931 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-17T11:40:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr. 2023-05-17T11:40:59.273 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:59.318 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:40:59.613 INFO:teuthology.orchestra.run.smithi003.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-17T11:40:59.704 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mon. 2023-05-17T11:40:59.718 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:40:59.757 INFO:teuthology.orchestra.run.smithi003.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-05-17T11:40:59.762 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:00.055 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:00.549 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-osd. 2023-05-17T11:41:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:00.607 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:Adding system user cephadm....done 2023-05-17T11:41:00.728 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-17T11:41:01.004 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-17T11:41:01.264 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-17T11:41:01.390 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-17T11:41:01.649 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-17T11:41:01.786 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph. 2023-05-17T11:41:01.799 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../061-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:01.844 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:02.084 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-17T11:41:02.156 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-fuse. 2023-05-17T11:41:02.169 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:02.193 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-17T11:41:02.214 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:02.495 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-17T11:41:02.759 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mds. 2023-05-17T11:41:02.772 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:02.817 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:02.872 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-17T11:41:03.140 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-17T11:41:03.187 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package cephadm. 2023-05-17T11:41:03.200 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../064-cephadm_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:03.245 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:03.416 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-17T11:41:03.531 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-17T11:41:03.545 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-17T11:41:03.590 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-17T11:41:03.700 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-17T11:41:03.892 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-17T11:41:03.906 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-17T11:41:03.951 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-17T11:41:03.968 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-17T11:41:04.238 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-17T11:41:04.514 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:04.781 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-17T11:41:04.907 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-17T11:41:04.948 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-babel. 2023-05-17T11:41:04.960 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-17T11:41:04.989 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-17T11:41:05.175 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-17T11:41:05.292 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jinja2. 2023-05-17T11:41:05.305 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-17T11:41:05.342 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-17T11:41:05.434 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-17T11:41:05.560 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-17T11:41:05.654 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-17T11:41:05.667 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:05.704 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:05.929 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-17T11:41:06.024 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-17T11:41:06.038 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-17T11:41:06.062 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-17T11:41:06.082 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-17T11:41:06.339 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-17T11:41:06.385 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-17T11:41:06.399 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-17T11:41:06.477 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-17T11:41:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-17T11:41:06.788 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-routes. 2023-05-17T11:41:06.802 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-17T11:41:06.855 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-17T11:41:06.932 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-17T11:41:07.258 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-17T11:41:07.272 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:07.324 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:07.651 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-17T11:41:07.736 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-17T11:41:07.750 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-17T11:41:07.795 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-17T11:41:07.944 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-17T11:41:08.053 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-17T11:41:08.162 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-17T11:41:08.267 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-joblib. 2023-05-17T11:41:08.281 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-17T11:41:08.325 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-17T11:41:08.480 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-17T11:41:08.687 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-17T11:41:08.701 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-17T11:41:08.745 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-17T11:41:08.890 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-17T11:41:09.024 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-sklearn. 2023-05-17T11:41:09.037 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-17T11:41:09.073 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-17T11:41:09.149 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-17T11:41:09.550 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-17T11:41:09.691 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-17T11:41:09.704 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:09.741 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:09.852 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-17T11:41:10.161 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-17T11:41:10.513 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-17T11:41:10.702 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cachetools. 2023-05-17T11:41:10.717 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-17T11:41:10.760 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-17T11:41:10.806 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-17T11:41:10.931 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:11.063 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-17T11:41:11.078 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-17T11:41:11.121 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-17T11:41:11.233 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-idna (3.3-1) ... 2023-05-17T11:41:11.492 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-17T11:41:11.506 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-17T11:41:11.550 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-17T11:41:11.584 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-17T11:41:11.861 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rsa. 2023-05-17T11:41:11.875 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-17T11:41:11.919 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-17T11:41:12.325 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-google-auth. 2023-05-17T11:41:12.340 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-17T11:41:12.383 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-17T11:41:12.861 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-17T11:41:12.864 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:41:12.875 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-17T11:41:12.920 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-17T11:41:12.999 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-17T11:41:13.231 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-websocket. 2023-05-17T11:41:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-17T11:41:13.274 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-17T11:41:13.289 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-17T11:41:13.400 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-17T11:41:13.518 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-17T11:41:13.585 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-17T11:41:13.599 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-17T11:41:13.634 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-17T11:41:13.820 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-17T11:41:14.121 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-17T11:41:14.290 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-17T11:41:14.303 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:14.340 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:41:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-17T11:41:14.632 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-17T11:41:14.693 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-17T11:41:14.706 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-17T11:41:14.743 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-17T11:41:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-17T11:41:15.088 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-17T11:41:15.100 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-17T11:41:15.146 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-17T11:41:15.268 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-17T11:41:15.398 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package jq. 2023-05-17T11:41:15.411 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-17T11:41:15.457 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-17T11:41:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-17T11:41:15.676 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package socat. 2023-05-17T11:41:15.689 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-17T11:41:15.726 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-17T11:41:15.787 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-17T11:41:16.038 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package xmlstarlet. 2023-05-17T11:41:16.051 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-17T11:41:16.063 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-17T11:41:16.096 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-17T11:41:16.339 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-17T11:41:16.434 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-test. 2023-05-17T11:41:16.446 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-17T11:41:16.484 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:16.757 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-17T11:41:16.883 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-17T11:41:17.201 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-17T11:41:17.503 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-17T11:41:17.862 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-17T11:41:18.063 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-volume. 2023-05-17T11:41:18.077 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:18.121 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-17T11:41:18.493 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-17T11:41:18.506 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:18.523 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-17T11:41:18.551 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:18.649 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-17T11:41:18.862 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-colorama. 2023-05-17T11:41:18.876 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-17T11:41:18.920 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-17T11:41:19.059 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-17T11:41:19.156 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package cephfs-shell. 2023-05-17T11:41:19.170 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:19.206 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-17T11:41:19.467 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package cephfs-top. 2023-05-17T11:41:19.481 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-17T11:41:19.526 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:19.561 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:41:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-17T11:41:19.778 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-17T11:41:19.792 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:19.837 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:20.021 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-17T11:41:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package nvme-cli. 2023-05-17T11:41:20.187 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-17T11:41:20.223 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-17T11:41:20.331 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-17T11:41:20.553 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-17T11:41:20.567 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-17T11:41:20.611 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-17T11:41:20.615 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-17T11:41:20.741 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-17T11:41:20.998 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-17T11:41:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-17T11:41:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-17T11:41:21.048 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-17T11:41:21.302 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-17T11:41:21.359 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pastescript. 2023-05-17T11:41:21.372 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-17T11:41:21.417 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-17T11:41:21.570 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-17T11:41:21.737 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pluggy. 2023-05-17T11:41:21.751 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-17T11:41:21.795 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-17T11:41:21.971 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-17T11:41:22.115 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-psutil. 2023-05-17T11:41:22.129 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-17T11:41:22.165 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-17T11:41:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-17T11:41:22.535 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-py. 2023-05-17T11:41:22.549 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-17T11:41:22.593 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-17T11:41:22.633 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-17T11:41:22.759 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:23.113 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pygments. 2023-05-17T11:41:23.128 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-17T11:41:23.129 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:23.163 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-17T11:41:23.256 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:23.382 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:23.508 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-17T11:41:23.575 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-17T11:41:23.588 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-17T11:41:23.625 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-17T11:41:23.809 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:23.887 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-toml. 2023-05-17T11:41:23.900 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-17T11:41:23.918 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:23.944 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-17T11:41:24.028 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:24.250 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-17T11:41:24.250 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-17T11:41:24.255 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pytest. 2023-05-17T11:41:24.269 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-17T11:41:24.314 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-17T11:41:24.610 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-simplejson. 2023-05-17T11:41:24.623 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-17T11:41:24.659 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-17T11:41:24.929 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-17T11:41:24.943 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-17T11:41:24.980 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:24.987 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-17T11:41:25.106 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:25.232 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:25.357 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-17T11:41:25.691 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package radosgw. 2023-05-17T11:41:25.704 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../113-radosgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:25.749 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:26.494 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package rbd-fuse. 2023-05-17T11:41:26.509 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-17T11:41:26.544 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:26.696 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:26.803 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-17T11:41:26.821 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:26.947 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:27.073 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:27.082 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-17T11:41:27.199 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:27.208 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-17T11:41:27.325 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:27.472 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-17T11:41:27.836 INFO:teuthology.orchestra.run.smithi003.stdout:Adding group ceph....done 2023-05-17T11:41:27.923 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-17T11:41:28.196 INFO:teuthology.orchestra.run.smithi003.stdout:Adding system user ceph....done 2023-05-17T11:41:28.381 INFO:teuthology.orchestra.run.smithi003.stdout:Setting system user ceph properties....done 2023-05-17T11:41:28.400 INFO:teuthology.orchestra.run.smithi003.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-17T11:41:28.541 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-17T11:41:28.605 INFO:teuthology.orchestra.run.smithi060.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-17T11:41:28.656 INFO:teuthology.orchestra.run.smithi060.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-05-17T11:41:28.710 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:28.944 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-17T11:41:29.254 INFO:teuthology.orchestra.run.smithi060.stdout:Adding system user cephadm....done 2023-05-17T11:41:29.416 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-17T11:41:29.676 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:29.768 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-17T11:41:29.777 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:29.903 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:30.052 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-17T11:41:30.161 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-17T11:41:30.193 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-17T11:41:30.193 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-17T11:41:30.404 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-17T11:41:30.672 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-17T11:41:30.798 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-17T11:41:31.117 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-17T11:41:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:31.502 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-17T11:41:31.522 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-17T11:41:31.745 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-17T11:41:32.021 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-17T11:41:32.282 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:32.306 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-17T11:41:32.543 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-17T11:41:32.543 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-17T11:41:32.641 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-17T11:41:32.925 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-17T11:41:33.193 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:33.262 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:33.461 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-17T11:41:33.488 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-17T11:41:33.488 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-17T11:41:33.561 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-17T11:41:33.821 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-17T11:41:34.105 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-17T11:41:34.163 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:34.232 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-17T11:41:34.503 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-17T11:41:34.504 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-17T11:41:34.599 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-17T11:41:34.726 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-17T11:41:34.993 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-17T11:41:35.190 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:35.261 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-17T11:41:35.316 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:35.475 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:35.563 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-17T11:41:35.680 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-17T11:41:35.681 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-17T11:41:36.273 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-17T11:41:36.384 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:36.510 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:36.549 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-17T11:41:36.645 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:36.683 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-17T11:41:36.788 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:36.809 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-17T11:41:36.914 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-17T11:41:37.110 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-17T11:41:37.495 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-17T11:41:37.746 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-17T11:41:38.065 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-17T11:41:38.139 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-17T11:41:38.449 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-17T11:41:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-17T11:41:38.546 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-17T11:41:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-05-17T11:41:38.775 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-05-17T11:41:38.776 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-05-17T11:41:38.776 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-17T11:41:38.917 INFO:teuthology.orchestra.run.smithi003.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-17T11:41:38.917 INFO:teuthology.orchestra.run.smithi003.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-17T11:41:38.917 INFO:teuthology.orchestra.run.smithi003.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-17T11:41:38.918 INFO:teuthology.orchestra.run.smithi003.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-17T11:41:38.919 INFO:teuthology.orchestra.run.smithi003.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-17T11:41:38.919 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-17T11:41:38.920 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-05-17T11:41:38.920 INFO:teuthology.orchestra.run.smithi003.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-17T11:41:38.920 INFO:teuthology.orchestra.run.smithi003.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-17T11:41:38.920 INFO:teuthology.orchestra.run.smithi003.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-17T11:41:38.920 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-17T11:41:38.921 INFO:teuthology.orchestra.run.smithi003.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-17T11:41:38.921 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-05-17T11:41:38.921 INFO:teuthology.orchestra.run.smithi003.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-17T11:41:38.921 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-17T11:41:38.921 INFO:teuthology.orchestra.run.smithi003.stdout: libengine-pkcs11-openssl 2023-05-17T11:41:38.965 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-05-17T11:41:38.965 INFO:teuthology.orchestra.run.smithi003.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-17T11:41:38.966 INFO:teuthology.orchestra.run.smithi003.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-17T11:41:38.966 INFO:teuthology.orchestra.run.smithi003.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-17T11:41:38.966 INFO:teuthology.orchestra.run.smithi003.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-17T11:41:38.966 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-17T11:41:38.966 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-17T11:41:38.967 INFO:teuthology.orchestra.run.smithi003.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-17T11:41:38.967 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-05-17T11:41:38.967 INFO:teuthology.orchestra.run.smithi003.stdout: libssl3 2023-05-17T11:41:39.127 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-17T11:41:39.150 INFO:teuthology.orchestra.run.smithi003.stdout:1 upgraded, 39 newly installed, 0 to remove and 147 not upgraded. 2023-05-17T11:41:39.150 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 54.6 MB of archives. 2023-05-17T11:41:39.150 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-17T11:41:39.150 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-17T11:41:39.369 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-17T11:41:39.487 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:39.631 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-17T11:41:39.789 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-idna (3.3-1) ... 2023-05-17T11:41:40.131 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-17T11:41:41.429 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:41:41.596 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-17T11:41:41.873 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-17T11:41:41.891 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-17T11:41:41.999 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-17T11:41:42.125 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-17T11:41:42.434 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-17T11:41:42.686 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-17T11:41:42.929 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:41:42.946 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-17T11:41:43.027 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-17T11:41:43.054 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-17T11:41:43.180 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-17T11:41:43.234 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-17T11:41:43.362 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-17T11:41:43.406 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-17T11:41:43.507 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-17T11:41:43.535 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-17T11:41:43.642 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-17T11:41:43.651 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-17T11:41:43.783 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-17T11:41:43.832 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-17T11:41:44.051 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-17T11:41:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-17T11:41:44.302 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-17T11:41:44.553 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-17T11:41:44.821 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-17T11:41:44.947 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-17T11:41:45.231 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-17T11:41:45.391 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-17T11:41:45.692 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-17T11:41:46.001 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-17T11:41:46.253 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-17T11:41:46.619 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-17T11:41:46.856 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-17T11:41:46.981 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-17T11:41:47.383 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-17T11:41:47.660 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-17T11:41:47.911 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-17T11:41:48.011 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-17T11:41:48.338 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-17T11:41:48.647 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-17T11:41:48.940 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-17T11:41:49.066 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-17T11:41:49.351 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-17T11:41:49.627 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-17T11:41:49.878 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-17T11:41:50.263 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-17T11:41:50.564 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-17T11:41:50.933 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-17T11:41:51.059 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:51.177 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:51.388 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:51.514 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:51.641 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:51.769 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-17T11:41:52.062 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:52.188 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:52.314 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:52.529 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-17T11:41:52.530 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-17T11:41:53.191 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:53.316 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:53.442 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:53.561 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-17T11:41:54.915 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:55.041 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:55.151 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:55.260 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:55.370 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:55.496 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:56.040 INFO:teuthology.orchestra.run.smithi060.stdout:Adding group ceph....done 2023-05-17T11:41:56.400 INFO:teuthology.orchestra.run.smithi060.stdout:Adding system user ceph....done 2023-05-17T11:41:56.586 INFO:teuthology.orchestra.run.smithi060.stdout:Setting system user ceph properties....done 2023-05-17T11:41:56.601 INFO:teuthology.orchestra.run.smithi060.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-17T11:41:56.743 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-17T11:41:57.177 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-17T11:41:57.906 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:58.175 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:58.443 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-17T11:41:58.443 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-17T11:41:59.435 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:41:59.781 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-17T11:42:00.495 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:00.705 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-17T11:42:00.705 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-17T11:42:01.380 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:01.580 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-17T11:42:01.581 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-17T11:42:02.232 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:02.567 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-17T11:42:02.567 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-17T11:42:03.242 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:03.378 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:03.519 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-17T11:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-17T11:42:04.378 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:04.496 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:04.631 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:04.773 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-17T11:42:04.900 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-17T11:42:06.035 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-17T11:42:06.504 INFO:teuthology.orchestra.run.smithi060.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-17T11:42:06.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-17T11:42:06.582 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2023-05-17T11:42:06.743 INFO:teuthology.orchestra.run.smithi060.stdout:Building dependency tree... 2023-05-17T11:42:06.744 INFO:teuthology.orchestra.run.smithi060.stdout:Reading state information... 2023-05-17T11:42:06.889 INFO:teuthology.orchestra.run.smithi060.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout:The following packages were automatically installed and are no longer required: 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-17T11:42:06.890 INFO:teuthology.orchestra.run.smithi060.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-17T11:42:06.891 INFO:teuthology.orchestra.run.smithi060.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-17T11:42:06.891 INFO:teuthology.orchestra.run.smithi060.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-17T11:42:06.892 INFO:teuthology.orchestra.run.smithi060.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-17T11:42:06.892 INFO:teuthology.orchestra.run.smithi060.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-17T11:42:06.892 INFO:teuthology.orchestra.run.smithi060.stdout:The following additional packages will be installed: 2023-05-17T11:42:06.892 INFO:teuthology.orchestra.run.smithi060.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-17T11:42:06.892 INFO:teuthology.orchestra.run.smithi060.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-17T11:42:06.892 INFO:teuthology.orchestra.run.smithi060.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-17T11:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-17T11:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-17T11:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout:Suggested packages: 2023-05-17T11:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-17T11:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-17T11:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout: libengine-pkcs11-openssl 2023-05-17T11:42:06.936 INFO:teuthology.orchestra.run.smithi060.stdout:The following NEW packages will be installed: 2023-05-17T11:42:06.937 INFO:teuthology.orchestra.run.smithi060.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-17T11:42:06.937 INFO:teuthology.orchestra.run.smithi060.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-17T11:42:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-17T11:42:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-17T11:42:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-17T11:42:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-17T11:42:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-17T11:42:06.939 INFO:teuthology.orchestra.run.smithi060.stdout:The following packages will be upgraded: 2023-05-17T11:42:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: libssl3 2023-05-17T11:42:07.133 INFO:teuthology.orchestra.run.smithi060.stdout:1 upgraded, 39 newly installed, 0 to remove and 147 not upgraded. 2023-05-17T11:42:07.133 INFO:teuthology.orchestra.run.smithi060.stdout:Need to get 54.6 MB of archives. 2023-05-17T11:42:07.133 INFO:teuthology.orchestra.run.smithi060.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-17T11:42:07.134 INFO:teuthology.orchestra.run.smithi060.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-17T11:42:07.817 INFO:teuthology.orchestra.run.smithi060.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-17T11:42:09.558 INFO:teuthology.orchestra.run.smithi060.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-17T11:42:10.227 INFO:teuthology.orchestra.run.smithi060.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-17T11:42:10.272 INFO:teuthology.orchestra.run.smithi060.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-17T11:42:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-17T11:42:10.475 INFO:teuthology.orchestra.run.smithi060.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-17T11:42:10.501 INFO:teuthology.orchestra.run.smithi060.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-17T11:42:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-17T11:42:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-17T11:42:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-17T11:42:10.813 INFO:teuthology.orchestra.run.smithi060.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-17T11:42:11.162 INFO:teuthology.orchestra.run.smithi060.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-17T11:42:17.102 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-17T11:42:17.333 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-17T11:42:17.340 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-17T11:42:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-17T11:42:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-17T11:42:18.323 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-17T11:42:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-17T11:42:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-17T11:42:19.538 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-17T11:42:22.125 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-17T11:42:22.208 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-17T11:42:23.339 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-17T11:42:25.575 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-17T11:42:25.955 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-17T11:42:26.003 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-17T11:42:26.030 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-17T11:42:26.054 INFO:teuthology.orchestra.run.smithi003.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-17T11:42:27.265 INFO:teuthology.orchestra.run.smithi003.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-17T11:42:27.431 INFO:teuthology.orchestra.run.smithi003.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-17T11:42:44.282 INFO:teuthology.orchestra.run.smithi003.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-17T11:42:44.450 INFO:teuthology.orchestra.run.smithi003.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-17T11:42:44.533 INFO:teuthology.orchestra.run.smithi003.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-17T11:42:44.534 INFO:teuthology.orchestra.run.smithi003.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-17T11:42:44.615 INFO:teuthology.orchestra.run.smithi003.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-17T11:42:44.623 INFO:teuthology.orchestra.run.smithi003.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-17T11:42:45.371 INFO:teuthology.orchestra.run.smithi003.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-17T11:42:45.381 INFO:teuthology.orchestra.run.smithi003.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-17T11:42:45.795 INFO:teuthology.orchestra.run.smithi003.stdout:Preconfiguring packages ... 2023-05-17T11:42:45.943 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 54.6 MB in 1min 6s (822 kB/s) 2023-05-17T11:42:46.081 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package flex. 2023-05-17T11:42:46.156 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-05-17T11:42:46.160 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-17T11:42:46.196 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-17T11:42:46.765 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-17T11:42:47.052 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-17T11:42:47.440 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-17T11:42:47.936 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package bison. 2023-05-17T11:42:48.010 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-05-17T11:42:48.013 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-17T11:42:48.054 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-17T11:42:48.430 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-17T11:42:48.443 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-17T11:42:48.480 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-17T11:42:48.817 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package dump. 2023-05-17T11:42:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-17T11:42:48.875 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking dump (0.4b47-3) ... 2023-05-17T11:42:49.170 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package indent. 2023-05-17T11:42:49.184 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-17T11:42:49.228 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-17T11:42:49.472 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-17T11:42:49.486 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-17T11:42:49.522 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-17T11:42:49.859 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-17T11:42:49.873 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-17T11:42:49.918 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-17T11:42:50.187 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-17T11:42:50.201 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-17T11:42:50.245 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-17T11:42:50.565 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-17T11:42:50.580 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-17T11:42:50.616 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-17T11:42:50.842 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-17T11:42:50.856 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-17T11:42:50.909 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-17T11:42:51.128 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjson-perl. 2023-05-17T11:42:51.143 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-17T11:42:51.186 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-17T11:42:51.498 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-17T11:42:51.512 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-17T11:42:51.556 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-17T11:42:52.917 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-17T11:42:52.931 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-17T11:42:52.975 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:42:53.081 INFO:teuthology.orchestra.run.smithi060.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-17T11:42:53.220 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-17T11:42:53.234 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-17T11:42:53.278 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:42:53.359 INFO:teuthology.orchestra.run.smithi060.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-17T11:42:53.372 INFO:teuthology.orchestra.run.smithi060.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-17T11:42:53.597 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-17T11:42:53.611 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-17T11:42:53.655 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:42:53.763 INFO:teuthology.orchestra.run.smithi060.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-17T11:42:53.783 INFO:teuthology.orchestra.run.smithi060.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-17T11:42:54.000 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-17T11:42:54.014 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-17T11:42:54.058 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-17T11:42:54.336 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-17T11:42:54.350 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-17T11:42:54.394 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-17T11:42:54.488 INFO:teuthology.orchestra.run.smithi060.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-17T11:42:54.681 INFO:teuthology.orchestra.run.smithi060.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-17T11:42:54.730 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-17T11:42:54.744 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:42:54.788 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:42:55.107 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-17T11:42:55.122 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:42:55.166 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:42:55.452 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-17T11:42:55.466 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:42:55.510 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:42:55.771 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-17T11:42:55.785 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-17T11:42:55.829 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-17T11:42:55.887 INFO:teuthology.orchestra.run.smithi060.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-17T11:42:55.894 INFO:teuthology.orchestra.run.smithi060.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-17T11:42:56.349 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-17T11:42:56.363 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-17T11:42:56.407 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-17T11:42:56.735 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package modemmanager. 2023-05-17T11:42:56.750 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-17T11:42:56.793 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:42:57.349 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package network-manager. 2023-05-17T11:42:57.363 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-17T11:42:57.407 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-17T11:42:58.039 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ppp. 2023-05-17T11:42:58.054 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-17T11:42:58.441 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-17T11:42:58.769 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package pptp-linux. 2023-05-17T11:42:58.782 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-17T11:42:58.835 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-17T11:42:59.088 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-17T11:42:59.101 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-17T11:42:59.138 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-17T11:42:59.440 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-17T11:42:59.454 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-17T11:42:59.490 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql-client-common (238) ... 2023-05-17T11:42:59.753 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-17T11:42:59.766 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:42:59.795 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:43:00.307 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql-common. 2023-05-17T11:43:00.320 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-17T11:43:00.366 INFO:teuthology.orchestra.run.smithi003.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-17T11:43:00.389 INFO:teuthology.orchestra.run.smithi060.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-17T11:43:00.397 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql-common (238) ... 2023-05-17T11:43:00.472 INFO:teuthology.orchestra.run.smithi060.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-17T11:43:00.867 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql-14. 2023-05-17T11:43:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:43:00.919 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:43:01.961 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql. 2023-05-17T11:43:01.974 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-17T11:43:02.003 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql (14+238) ... 2023-05-17T11:43:02.230 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql-client. 2023-05-17T11:43:02.243 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-17T11:43:02.280 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql-client (14+238) ... 2023-05-17T11:43:02.524 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-17T11:43:02.537 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-17T11:43:02.574 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-17T11:43:02.806 INFO:teuthology.orchestra.run.smithi060.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-17T11:43:02.893 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package tcl8.6. 2023-05-17T11:43:02.907 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-17T11:43:02.951 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-17T11:43:03.254 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package tcl. 2023-05-17T11:43:03.268 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-17T11:43:03.308 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-17T11:43:03.657 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package wpasupplicant. 2023-05-17T11:43:03.671 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-17T11:43:03.715 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-17T11:43:04.044 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-17T11:43:04.058 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-17T11:43:04.102 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-17T11:43:04.422 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-17T11:43:04.437 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-17T11:43:04.480 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-17T11:43:04.764 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql-client-common (238) ... 2023-05-17T11:43:04.995 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-17T11:43:05.129 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-17T11:43:05.255 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:43:05.364 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-17T11:43:05.474 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-17T11:43:05.600 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:43:06.524 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-17T11:43:06.622 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-17T11:43:06.988 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-17T11:43:06.988 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-17T11:43:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-17T11:43:07.767 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-17T11:43:07.893 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-17T11:43:08.044 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-17T11:43:08.170 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-17T11:43:08.304 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-17T11:43:08.394 INFO:teuthology.orchestra.run.smithi060.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-17T11:43:08.422 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-17T11:43:08.486 INFO:teuthology.orchestra.run.smithi060.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-17T11:43:08.531 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-17T11:43:08.560 INFO:teuthology.orchestra.run.smithi060.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-17T11:43:08.627 INFO:teuthology.orchestra.run.smithi060.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-17T11:43:09.170 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-17T11:43:09.304 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up dump (0.4b47-3) ... 2023-05-17T11:43:09.400 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-17T11:43:09.464 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:43:09.565 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-17T11:43:09.683 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-17T11:43:09.809 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-17T11:43:09.934 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-17T11:43:10.024 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-17T11:43:10.086 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-17T11:43:10.221 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-17T11:43:10.397 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-17T11:43:10.514 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:43:10.932 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-17T11:43:11.117 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql-client (14+238) ... 2023-05-17T11:43:11.243 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-17T11:43:11.631 INFO:teuthology.orchestra.run.smithi060.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-17T11:43:11.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:43:11.881 INFO:teuthology.orchestra.run.smithi003.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-17T11:43:11.881 INFO:teuthology.orchestra.run.smithi003.stdout:which means they are currently configured by ifupdown: 2023-05-17T11:43:11.881 INFO:teuthology.orchestra.run.smithi003.stdout:- ens1f0 2023-05-17T11:43:11.882 INFO:teuthology.orchestra.run.smithi003.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-17T11:43:11.882 INFO:teuthology.orchestra.run.smithi003.stdout:remove their configuration from /etc/network/interfaces. 2023-05-17T11:43:11.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:43:12.016 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-17T11:43:12.048 INFO:teuthology.orchestra.run.smithi060.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-17T11:43:12.432 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-17T11:43:12.877 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-17T11:43:13.604 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:43:13.747 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-17T11:43:13.856 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-17T11:43:13.957 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql-common (238) ... 2023-05-17T11:43:14.834 INFO:teuthology.orchestra.run.smithi003.stdout:Adding user postgres to group ssl-cert 2023-05-17T11:43:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:43:15.087 INFO:teuthology.orchestra.run.smithi003.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-17T11:43:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-17T11:43:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:Removing obsolete dictionary files: 2023-05-17T11:43:16.111 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-17T11:43:16.600 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:43:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-17T11:43:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-17T11:43:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-17T11:43:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:This user must also own the server process. 2023-05-17T11:43:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:The database cluster will be initialized with locale "en_US". 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:The default text search configuration will be set to "english". 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:Data page checksums are disabled. 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:43:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-17T11:43:17.004 INFO:teuthology.orchestra.run.smithi003.stdout:creating subdirectories ... ok 2023-05-17T11:43:17.004 INFO:teuthology.orchestra.run.smithi003.stdout:selecting dynamic shared memory implementation ... posix 2023-05-17T11:43:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:selecting default max_connections ... 100 2023-05-17T11:43:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:selecting default shared_buffers ... 128MB 2023-05-17T11:43:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:selecting default time zone ... Etc/UTC 2023-05-17T11:43:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:creating configuration files ... ok 2023-05-17T11:43:17.255 INFO:teuthology.orchestra.run.smithi003.stdout:running bootstrap script ... ok 2023-05-17T11:43:17.918 INFO:teuthology.orchestra.run.smithi003.stdout:performing post-bootstrap initialization ... ok 2023-05-17T11:43:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:syncing data to disk ... ok 2023-05-17T11:43:18.965 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-17T11:43:22.057 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:43:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-17T11:43:22.309 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up postgresql (14+238) ... 2023-05-17T11:43:22.418 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:43:22.519 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:43:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-17T11:43:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-17T11:43:23.597 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-17T11:43:23.932 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-17T11:43:24.067 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-17T11:43:25.469 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-17T11:43:25.553 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-17T11:43:26.219 INFO:teuthology.orchestra.run.smithi003.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-17T11:43:26.222 DEBUG:teuthology.parallel:result is None 2023-05-17T11:43:49.484 INFO:teuthology.orchestra.run.smithi060.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-17T11:43:49.674 INFO:teuthology.orchestra.run.smithi060.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-17T11:43:49.757 INFO:teuthology.orchestra.run.smithi060.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-17T11:43:49.758 INFO:teuthology.orchestra.run.smithi060.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-17T11:43:49.844 INFO:teuthology.orchestra.run.smithi060.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-17T11:43:49.860 INFO:teuthology.orchestra.run.smithi060.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-17T11:43:52.279 INFO:teuthology.orchestra.run.smithi060.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-17T11:43:52.329 INFO:teuthology.orchestra.run.smithi060.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-17T11:43:52.809 INFO:teuthology.orchestra.run.smithi060.stdout:Preconfiguring packages ... 2023-05-17T11:43:52.958 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 54.6 MB in 1min 45s (518 kB/s) 2023-05-17T11:43:53.087 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package flex. 2023-05-17T11:43:53.162 INFO:teuthology.orchestra.run.smithi060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-05-17T11:43:53.166 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-17T11:43:53.211 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-17T11:43:53.696 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-17T11:43:53.850 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-17T11:43:54.248 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-17T11:43:54.801 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package bison. 2023-05-17T11:43:54.878 INFO:teuthology.orchestra.run.smithi060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-05-17T11:43:54.882 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-17T11:43:54.929 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-17T11:43:55.330 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-17T11:43:55.343 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-17T11:43:55.380 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-17T11:43:55.716 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package dump. 2023-05-17T11:43:55.730 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-17T11:43:55.775 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking dump (0.4b47-3) ... 2023-05-17T11:43:56.078 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package indent. 2023-05-17T11:43:56.092 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-17T11:43:56.128 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-17T11:43:56.364 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-17T11:43:56.378 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-17T11:43:56.414 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-17T11:43:56.742 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-17T11:43:56.757 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-17T11:43:56.801 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-17T11:43:57.045 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-17T11:43:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-17T11:43:57.103 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-17T11:43:57.390 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-17T11:43:57.404 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-17T11:43:57.440 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-17T11:43:57.676 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-17T11:43:57.690 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-17T11:43:57.734 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-17T11:43:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libjson-perl. 2023-05-17T11:43:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-17T11:43:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-17T11:43:58.365 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-17T11:43:58.380 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-17T11:43:58.423 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-17T11:43:59.726 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-17T11:43:59.741 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-17T11:43:59.809 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:44:00.070 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-17T11:44:00.085 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-17T11:44:00.129 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:44:00.456 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-17T11:44:00.471 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-17T11:44:00.515 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:44:00.817 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-17T11:44:00.832 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-17T11:44:00.867 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-17T11:44:01.162 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-17T11:44:01.176 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-17T11:44:01.220 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-17T11:44:01.556 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-17T11:44:01.571 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:44:01.614 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:44:01.934 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-17T11:44:01.949 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:44:01.984 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:44:02.228 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-17T11:44:02.243 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:44:02.286 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:44:02.514 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-17T11:44:02.529 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-17T11:44:02.572 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-17T11:44:03.092 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-17T11:44:03.106 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-17T11:44:03.151 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-17T11:44:03.495 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package modemmanager. 2023-05-17T11:44:03.509 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-17T11:44:03.553 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:44:04.185 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package network-manager. 2023-05-17T11:44:04.199 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-17T11:44:04.251 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-17T11:44:04.858 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ppp. 2023-05-17T11:44:04.873 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-17T11:44:05.265 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-17T11:44:05.605 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package pptp-linux. 2023-05-17T11:44:05.618 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-17T11:44:05.654 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-17T11:44:05.924 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-17T11:44:05.937 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-17T11:44:05.974 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-17T11:44:06.235 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-17T11:44:06.249 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-17T11:44:06.294 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql-client-common (238) ... 2023-05-17T11:44:06.556 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-17T11:44:06.570 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:44:06.623 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql-common. 2023-05-17T11:44:07.216 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-17T11:44:07.279 INFO:teuthology.orchestra.run.smithi060.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-17T11:44:07.309 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql-common (238) ... 2023-05-17T11:44:07.760 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql-14. 2023-05-17T11:44:07.775 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-17T11:44:07.812 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:44:08.938 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql. 2023-05-17T11:44:08.952 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-17T11:44:08.996 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql (14+238) ... 2023-05-17T11:44:09.223 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql-client. 2023-05-17T11:44:09.241 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-17T11:44:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql-client (14+238) ... 2023-05-17T11:44:09.493 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-17T11:44:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-17T11:44:09.551 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-17T11:44:09.853 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package tcl8.6. 2023-05-17T11:44:09.868 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-17T11:44:09.912 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-17T11:44:10.189 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package tcl. 2023-05-17T11:44:10.204 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-17T11:44:10.252 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-17T11:44:10.525 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package wpasupplicant. 2023-05-17T11:44:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-17T11:44:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-17T11:44:10.913 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-17T11:44:10.928 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-17T11:44:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-17T11:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-17T11:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-17T11:44:11.450 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-17T11:44:11.725 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql-client-common (238) ... 2023-05-17T11:44:11.931 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-17T11:44:12.065 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-17T11:44:12.200 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-17T11:44:12.410 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-17T11:44:12.519 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:44:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-17T11:44:13.532 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-17T11:44:13.883 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-17T11:44:13.883 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-17T11:44:14.620 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-17T11:44:14.746 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-17T11:44:14.872 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-17T11:44:15.006 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-17T11:44:15.182 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-17T11:44:15.308 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-17T11:44:15.434 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-17T11:44:16.032 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-17T11:44:16.174 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up dump (0.4b47-3) ... 2023-05-17T11:44:16.269 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-17T11:44:16.335 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:44:16.460 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-17T11:44:16.587 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-17T11:44:16.696 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-17T11:44:16.797 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-17T11:44:16.870 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-17T11:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-17T11:44:17.066 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-17T11:44:17.209 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-17T11:44:17.310 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:44:17.436 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-17T11:44:17.604 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql-client (14+238) ... 2023-05-17T11:44:17.730 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-17T11:44:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:18.429 INFO:teuthology.orchestra.run.smithi060.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-17T11:44:18.429 INFO:teuthology.orchestra.run.smithi060.stdout:which means they are currently configured by ifupdown: 2023-05-17T11:44:18.429 INFO:teuthology.orchestra.run.smithi060.stdout:- ens1f0 2023-05-17T11:44:18.430 INFO:teuthology.orchestra.run.smithi060.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-17T11:44:18.430 INFO:teuthology.orchestra.run.smithi060.stdout:remove their configuration from /etc/network/interfaces. 2023-05-17T11:44:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:18.565 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-17T11:44:18.984 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-17T11:44:19.407 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-17T11:44:20.202 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-17T11:44:20.345 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-17T11:44:20.472 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-17T11:44:20.598 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql-common (238) ... 2023-05-17T11:44:21.495 INFO:teuthology.orchestra.run.smithi060.stdout:Adding user postgres to group ssl-cert 2023-05-17T11:44:21.719 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:21.719 INFO:teuthology.orchestra.run.smithi060.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-17T11:44:21.965 INFO:teuthology.orchestra.run.smithi060.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-17T11:44:21.965 INFO:teuthology.orchestra.run.smithi060.stdout:Removing obsolete dictionary files: 2023-05-17T11:44:22.734 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-17T11:44:23.216 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-17T11:44:23.575 INFO:teuthology.orchestra.run.smithi060.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-17T11:44:23.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-17T11:44:23.652 INFO:teuthology.orchestra.run.smithi060.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-17T11:44:23.652 INFO:teuthology.orchestra.run.smithi060.stdout:This user must also own the server process. 2023-05-17T11:44:23.652 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:23.653 INFO:teuthology.orchestra.run.smithi060.stdout:The database cluster will be initialized with locale "en_US". 2023-05-17T11:44:23.653 INFO:teuthology.orchestra.run.smithi060.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-17T11:44:23.653 INFO:teuthology.orchestra.run.smithi060.stdout:The default text search configuration will be set to "english". 2023-05-17T11:44:23.653 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:23.653 INFO:teuthology.orchestra.run.smithi060.stdout:Data page checksums are disabled. 2023-05-17T11:44:23.654 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:23.654 INFO:teuthology.orchestra.run.smithi060.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-17T11:44:23.655 INFO:teuthology.orchestra.run.smithi060.stdout:creating subdirectories ... ok 2023-05-17T11:44:23.655 INFO:teuthology.orchestra.run.smithi060.stdout:selecting dynamic shared memory implementation ... posix 2023-05-17T11:44:23.676 INFO:teuthology.orchestra.run.smithi060.stdout:selecting default max_connections ... 100 2023-05-17T11:44:23.708 INFO:teuthology.orchestra.run.smithi060.stdout:selecting default shared_buffers ... 128MB 2023-05-17T11:44:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:selecting default time zone ... Etc/UTC 2023-05-17T11:44:23.723 INFO:teuthology.orchestra.run.smithi060.stdout:creating configuration files ... ok 2023-05-17T11:44:23.904 INFO:teuthology.orchestra.run.smithi060.stdout:running bootstrap script ... ok 2023-05-17T11:44:24.609 INFO:teuthology.orchestra.run.smithi060.stdout:performing post-bootstrap initialization ... ok 2023-05-17T11:44:25.109 INFO:teuthology.orchestra.run.smithi060.stdout:syncing data to disk ... ok 2023-05-17T11:44:25.649 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-17T11:44:28.848 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:44:28.975 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-17T11:44:29.101 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up postgresql (14+238) ... 2023-05-17T11:44:29.227 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-17T11:44:29.352 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-17T11:44:29.601 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-17T11:44:29.601 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-17T11:44:30.430 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-17T11:44:30.857 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-17T11:44:31.017 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-17T11:44:32.470 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-17T11:44:32.578 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-17T11:44:33.260 INFO:teuthology.orchestra.run.smithi060.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-17T11:44:33.264 DEBUG:teuthology.parallel:result is None 2023-05-17T11:44:33.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-17T11:44:33.403 DEBUG:teuthology.orchestra.run.smithi003:> dpkg-query -W -f '${Version}' ceph 2023-05-17T11:44:33.427 INFO:teuthology.orchestra.run.smithi003.stdout:18.0.0-3926-g27be5126-1jammy 2023-05-17T11:44:33.427 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3926-g27be5126-1jammy 2023-05-17T11:44:33.428 INFO:teuthology.task.install:The correct ceph version 18.0.0-3926-g27be5126-1jammy is installed. 2023-05-17T11:44:33.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-17T11:44:33.566 DEBUG:teuthology.orchestra.run.smithi060:> dpkg-query -W -f '${Version}' ceph 2023-05-17T11:44:33.587 INFO:teuthology.orchestra.run.smithi060.stdout:18.0.0-3926-g27be5126-1jammy 2023-05-17T11:44:33.588 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3926-g27be5126-1jammy 2023-05-17T11:44:33.588 INFO:teuthology.task.install:The correct ceph version 18.0.0-3926-g27be5126-1jammy is installed. 2023-05-17T11:44:33.588 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-17T11:44:33.589 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:33.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-17T11:44:33.611 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:33.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-17T11:44:33.651 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-17T11:44:33.652 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:33.652 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2023-05-17T11:44:33.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-17T11:44:33.734 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:33.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-05-17T11:44:33.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-17T11:44:33.810 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-17T11:44:33.811 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:33.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-17T11:44:33.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-17T11:44:33.894 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:33.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-17T11:44:33.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-17T11:44:33.970 INFO:teuthology.run_tasks:Running task ceph... 2023-05-17T11:44:34.041 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-17T11:44:34.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2023-05-17T11:44:34.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2023-05-17T11:44:34.062 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-17T11:44:34.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-17T11:44:34.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-17T11:44:34.123 INFO:tasks.ceph:Creating extra log directories... 2023-05-17T11:44:34.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-17T11:44:34.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-17T11:44:34.192 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-17T11:44:34.192 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-17T11:44:34.193 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-17T11:44:34.193 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:34.193 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-17T11:44:34.234 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-17T11:44:34.323 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:34.323 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-17T11:44:34.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-17T11:44:34.426 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-17T11:44:34.426 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-17T11:44:34.426 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7276583', 'branch': 'wip-rishabh-2023May15-1524', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7276583', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-05-17_11:09:48-fs-wip-rishabh-2023May15-1524-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023May15-1524'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023May15-1524', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023May15-1524', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi003.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIXs459KR1ImAEFVOz9pFYiSjtUzpZ4MLEbP1acyIZVo', 'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPgD96A7ibuTyVELWnAUYBTpXXKD3lnRM8JK/HeB0qfFlnPP7ZdJsx8h6FnHc2647C9ViBF04AoaLTpLyRmaH7Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-17_11:09:48', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-17T11:44:34.427 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-17T11:44:34.430 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-17T11:44:34.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2023-05-17T11:44:34.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2023-05-17T11:44:34.526 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:34.527 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2023-05-17T11:44:34.549 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-17T11:44:34.550 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2023-05-17T11:44:34.598 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-17T11:44:34.598 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:34.598 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-05-17T11:44:34.599 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:34.599 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-05-17 11:35:12.236491052 +0000 2023-05-17T11:44:34.599 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-05-17 11:35:12.232491087 +0000 2023-05-17T11:44:34.599 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-05-17 11:35:12.232491087 +0000 2023-05-17T11:44:34.599 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-05-17 11:35:12.232491087 +0000 2023-05-17T11:44:34.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-17T11:44:34.660 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-05-17T11:44:34.661 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-05-17T11:44:34.661 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000633891 s, 808 kB/s 2023-05-17T11:44:34.662 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-17T11:44:34.711 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2023-05-17T11:44:34.762 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-17T11:44:34.762 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:34.762 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 916 Links: 1 2023-05-17T11:44:34.762 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:34.763 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-05-17 11:35:13.552479297 +0000 2023-05-17T11:44:34.763 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-05-17 11:35:13.024484013 +0000 2023-05-17T11:44:34.763 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-05-17 11:35:13.024484013 +0000 2023-05-17T11:44:34.763 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-05-17 11:35:13.024484013 +0000 2023-05-17T11:44:34.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-17T11:44:34.819 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-05-17T11:44:34.820 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-05-17T11:44:34.820 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000354637 s, 1.4 MB/s 2023-05-17T11:44:34.821 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-17T11:44:34.871 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2023-05-17T11:44:34.926 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-17T11:44:34.926 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:34.926 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 933 Links: 1 2023-05-17T11:44:34.926 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:34.927 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-05-17 11:35:13.820476902 +0000 2023-05-17T11:44:34.927 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-05-17 11:35:13.816476939 +0000 2023-05-17T11:44:34.927 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-05-17 11:35:13.816476939 +0000 2023-05-17T11:44:34.927 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-05-17 11:35:13.816476939 +0000 2023-05-17T11:44:34.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-17T11:44:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-05-17T11:44:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-05-17T11:44:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000349351 s, 1.5 MB/s 2023-05-17T11:44:34.985 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-17T11:44:35.040 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2023-05-17T11:44:35.090 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-17T11:44:35.090 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:35.090 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 951 Links: 1 2023-05-17T11:44:35.090 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:35.091 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-05-17 11:35:15.128465219 +0000 2023-05-17T11:44:35.091 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-05-17 11:35:14.568470222 +0000 2023-05-17T11:44:35.091 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-05-17 11:35:14.568470222 +0000 2023-05-17T11:44:35.091 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-05-17 11:35:14.568470222 +0000 2023-05-17T11:44:35.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-17T11:44:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-05-17T11:44:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-05-17T11:44:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000356687 s, 1.4 MB/s 2023-05-17T11:44:35.154 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-17T11:44:35.208 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:35.208 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:35.208 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-05-17T11:44:35.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-17T11:44:35.216 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-05-17T11:44:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 889 Links: 1 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-05-17 11:35:16.588455697 +0000 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-05-17 11:35:16.584455733 +0000 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-05-17 11:35:16.584455733 +0000 2023-05-17T11:44:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-05-17 11:35:16.584455733 +0000 2023-05-17T11:44:35.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-17T11:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-05-17T11:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-05-17T11:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000261044 s, 2.0 MB/s 2023-05-17T11:44:35.332 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-17T11:44:35.386 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-05-17T11:44:35.437 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-17T11:44:35.437 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:35.437 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-05-17T11:44:35.437 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:35.437 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-05-17 11:35:18.040442728 +0000 2023-05-17T11:44:35.438 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-05-17 11:35:17.496447587 +0000 2023-05-17T11:44:35.438 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-05-17 11:35:17.496447587 +0000 2023-05-17T11:44:35.438 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-05-17 11:35:17.496447587 +0000 2023-05-17T11:44:35.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-17T11:44:35.499 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-05-17T11:44:35.499 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-05-17T11:44:35.499 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000256975 s, 2.0 MB/s 2023-05-17T11:44:35.501 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-17T11:44:35.554 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-05-17T11:44:35.604 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-17T11:44:35.605 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:35.605 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-05-17T11:44:35.605 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:35.605 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-05-17 11:35:18.988434259 +0000 2023-05-17T11:44:35.605 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-05-17 11:35:18.312440298 +0000 2023-05-17T11:44:35.605 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-05-17 11:35:18.312440298 +0000 2023-05-17T11:44:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-05-17 11:35:18.312440298 +0000 2023-05-17T11:44:35.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-17T11:44:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-05-17T11:44:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-05-17T11:44:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000268637 s, 1.9 MB/s 2023-05-17T11:44:35.665 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-17T11:44:35.714 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-05-17T11:44:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-17T11:44:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T11:44:35.765 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-05-17T11:44:35.765 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T11:44:35.765 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-05-17 11:35:19.784427150 +0000 2023-05-17T11:44:35.766 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-05-17 11:35:19.256431866 +0000 2023-05-17T11:44:35.766 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-05-17 11:35:19.256431866 +0000 2023-05-17T11:44:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-05-17 11:35:19.256431866 +0000 2023-05-17T11:44:35.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-17T11:44:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-05-17T11:44:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-05-17T11:44:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000258665 s, 2.0 MB/s 2023-05-17T11:44:35.828 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-17T11:44:35.878 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:35.879 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-17T11:44:35.879 INFO:tasks.ceph:Generating config... 2023-05-17T11:44:35.880 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-17T11:44:35.880 INFO:tasks.ceph:[client] debug client = 20 2023-05-17T11:44:35.880 INFO:tasks.ceph:[client] debug ms = 1 2023-05-17T11:44:35.881 INFO:tasks.ceph:[client] pid file = 2023-05-17T11:44:35.881 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-17T11:44:35.881 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-17T11:44:35.881 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-17T11:44:35.881 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-17T11:44:35.882 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-17T11:44:35.882 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-17T11:44:35.882 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-17T11:44:35.882 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-17T11:44:35.882 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-17T11:44:35.883 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-17T11:44:35.883 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-17T11:44:35.883 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-17T11:44:35.883 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-17T11:44:35.883 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-17T11:44:35.883 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-17T11:44:35.884 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-17T11:44:35.884 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-17T11:44:35.884 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-17T11:44:35.884 INFO:tasks.ceph:[osd] bdev async discard = True 2023-05-17T11:44:35.884 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-05-17T11:44:35.885 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-05-17T11:44:35.885 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-17T11:44:35.885 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-17T11:44:35.885 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-17T11:44:35.885 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-17T11:44:35.885 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-17T11:44:35.886 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-17T11:44:35.886 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-17T11:44:35.886 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-17T11:44:35.886 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-17T11:44:35.886 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-17T11:44:35.887 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-17T11:44:35.887 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-17T11:44:35.887 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-17T11:44:35.887 INFO:tasks.ceph:Setting up mon.a... 2023-05-17T11:44:35.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-17T11:44:35.933 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2023-05-17T11:44:35.945 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-17T11:44:36.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T11:44:36.054 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3'), ('mon.b', '172.21.15.60'), ('mon.c', '[v2:172.21.15.60:3301,v1:172.21.15.60:6790]')] 2023-05-17T11:44:36.055 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3,172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-17T11:44:36.056 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:36.056 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-17T11:44:36.101 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --add b 172.21.15.60 --addv c '[v2:172.21.15.60:3301,v1:172.21.15.60:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:36.187 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:36.188 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid ae6aed9e-9392-45b7-b249-815180a4cc03 2023-05-17T11:44:36.188 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = pacific 2023-05-17T11:44:36.188 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2023-05-17T11:44:36.188 INFO:teuthology.orchestra.run.smithi003.stdout:fsid ae6aed9e-9392-45b7-b249-815180a4cc03 2023-05-17T11:44:36.188 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2023-05-17T11:44:36.183370+0000 2023-05-17T11:44:36.188 INFO:teuthology.orchestra.run.smithi003.stdout:created 2023-05-17T11:44:36.183370+0000 2023-05-17T11:44:36.189 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 16 (pacific) 2023-05-17T11:44:36.189 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2023-05-17T11:44:36.189 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-05-17T11:44:36.189 INFO:teuthology.orchestra.run.smithi003.stdout:1: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2023-05-17T11:44:36.189 INFO:teuthology.orchestra.run.smithi003.stdout:2: [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] mon.c 2023-05-17T11:44:36.189 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-17T11:44:36.190 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-17T11:44:36.198 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ae6aed9e-9392-45b7-b249-815180a4cc03... 2023-05-17T11:44:36.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-17T11:44:36.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-17T11:44:36.280 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2023-05-17T11:44:36.280 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.281 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2023-05-17T11:44:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2023-05-17T11:44:36.283 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-17T11:44:36.284 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.285 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "172.21.15.3,172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790]" 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = ae6aed9e-9392-45b7-b249-815180a4cc03 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2023-05-17T11:44:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2023-05-17T11:44:36.287 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.288 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2023-05-17T11:44:36.289 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: bdev async discard = True 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: bdev enable discard = True 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore allocator = bitmap 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 1/20 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 1/20 2023-05-17T11:44:36.290 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 4/10 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2023-05-17T11:44:36.291 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-05-17T11:44:36.292 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-05-17T11:44:36.293 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-17T11:44:36.294 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2023-05-17T11:44:36.295 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout: mon op complaint time = 120 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2023-05-17T11:44:36.296 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: client mount timeout = 600 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: debug client = 20 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = "" 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-05-17T11:44:36.297 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d] 2023-05-17T11:44:36.298 INFO:teuthology.orchestra.run.smithi003.stdout:[mds] 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: debug mds = 20 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: debug mds balancer = 20 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug frag = True 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug scatterstat = True 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: mds op complaint time = 180 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: mds verify scatter = True 2023-05-17T11:44:36.299 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-05-17T11:44:36.300 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-05-17T11:44:36.300 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-05-17T11:44:36.300 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2023-05-17T11:44:36.300 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.301 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-17T11:44:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2023-05-17T11:44:36.303 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-17T11:44:36.304 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.305 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.3,172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790]" 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = ae6aed9e-9392-45b7-b249-815180a4cc03 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2023-05-17T11:44:36.306 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2023-05-17T11:44:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.308 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2023-05-17T11:44:36.309 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore allocator = bitmap 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2023-05-17T11:44:36.310 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2023-05-17T11:44:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-05-17T11:44:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-05-17T11:44:36.313 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-17T11:44:36.314 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2023-05-17T11:44:36.315 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2023-05-17T11:44:36.316 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = "" 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-05-17T11:44:36.317 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2023-05-17T11:44:36.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds balancer = 20 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2023-05-17T11:44:36.319 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-05-17T11:44:36.320 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-05-17T11:44:36.320 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-05-17T11:44:36.321 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-17T11:44:36.321 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-17T11:44:36.421 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-17T11:44:36.422 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:36.422 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-17T11:44:36.429 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:36.430 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-17T11:44:36.477 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:44:36.477 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:36.478 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-17T11:44:36.478 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T11:44:36.548 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:44:36.548 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:36.601 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:44:36.602 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:36.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-17T11:44:36.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T11:44:36.636 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:44:36.636 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:36.688 INFO:tasks.ceph:Setting up mon nodes... 2023-05-17T11:44:36.688 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-17T11:44:36.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-17T11:44:36.743 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-17T11:44:36.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-17T11:44:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-17T11:44:36.821 INFO:tasks.ceph:Setting up mds nodes... 2023-05-17T11:44:36.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-17T11:44:36.875 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-17T11:44:36.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-17T11:44:36.898 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-17T11:44:36.991 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-17T11:44:36.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-17T11:44:37.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-17T11:44:37.073 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-17T11:44:37.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-17T11:44:37.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-17T11:44:37.191 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-17T11:44:37.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-17T11:44:37.213 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-17T11:44:37.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-17T11:44:37.254 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-17T11:44:37.321 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-17T11:44:37.403 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-17T11:44:37.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-17T11:44:37.461 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-17T11:44:37.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-17T11:44:37.565 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-17T11:44:37.581 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-17T11:44:37.581 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-17T11:44:37.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-17T11:44:37.600 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:37.600 INFO:tasks.ceph:role: osd.0 2023-05-17T11:44:37.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:44:37.601 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-17T11:44:37.668 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:37.668 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:37.668 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:37.668 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:37.668 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:37.668 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:37.669 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:37.669 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:37.669 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:37.669 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:38.123 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-05-17T11:44:38.126 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-05-17T11:44:38.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-17T11:44:38.228 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-17T11:44:38.244 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:38.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:38.245 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-17T11:44:38.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:38.309 INFO:tasks.ceph:role: osd.1 2023-05-17T11:44:38.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:44:38.310 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-17T11:44:38.377 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:38.377 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:38.378 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:38.847 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-05-17T11:44:38.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-05-17T11:44:38.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-17T11:44:39.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-17T11:44:39.017 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:39.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:39.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-17T11:44:39.082 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:39.083 INFO:tasks.ceph:role: osd.2 2023-05-17T11:44:39.083 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:44:39.083 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-17T11:44:39.154 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:39.154 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:39.154 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:39.154 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:39.154 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:39.155 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:39.155 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:39.155 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:39.155 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:39.155 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:39.634 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-05-17T11:44:39.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-05-17T11:44:39.637 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-17T11:44:39.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-17T11:44:39.796 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:39.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:39.797 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-17T11:44:39.859 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:39.859 INFO:tasks.ceph:role: osd.3 2023-05-17T11:44:39.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:44:39.859 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-17T11:44:39.935 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:39.935 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:39.935 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:39.935 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:39.935 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:39.936 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:39.936 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:39.936 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:39.936 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:39.936 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:40.384 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-05-17T11:44:40.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-05-17T11:44:40.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-17T11:44:40.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-17T11:44:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:40.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:40.524 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:40.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:40.639+0000 7fc12602b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-17T11:44:40.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:40.647+0000 7fc12602b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-17T11:44:40.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:40.647+0000 7fc12602b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T11:44:40.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:40.647+0000 7fc12602b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T11:44:40.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:40.647+0000 7fc12602b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T11:44:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:40.651+0000 7fc12602b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-17T11:44:43.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-17T11:44:43.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:43.747+0000 7f57d219d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-17T11:44:43.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:43.747+0000 7f57d219d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-17T11:44:43.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:43.751+0000 7f57d219d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T11:44:43.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:43.751+0000 7f57d219d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T11:44:43.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:43.751+0000 7f57d219d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T11:44:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:43.751+0000 7f57d219d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-17T11:44:46.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-17T11:44:46.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:46.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:46.855+0000 7fa3a99b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-17T11:44:46.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:46.859+0000 7fa3a99b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-17T11:44:46.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:46.859+0000 7fa3a99b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T11:44:46.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:46.859+0000 7fa3a99b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T11:44:46.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:46.859+0000 7fa3a99b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T11:44:46.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:46.859+0000 7fa3a99b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-17T11:44:49.853 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-17T11:44:49.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:49.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:49.955+0000 7f9ec6bbf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-17T11:44:49.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:49.959+0000 7f9ec6bbf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-17T11:44:49.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:49.959+0000 7f9ec6bbf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T11:44:49.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:49.959+0000 7f9ec6bbf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T11:44:49.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:49.959+0000 7f9ec6bbf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T11:44:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:44:49.959+0000 7f9ec6bbf640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-17T11:44:52.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-17T11:44:52.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-17T11:44:52.998 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:52.999 INFO:tasks.ceph:role: osd.4 2023-05-17T11:44:52.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:44:52.999 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-17T11:44:53.061 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:53.062 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:53.062 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:53.062 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:53.062 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:53.062 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:53.063 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:53.063 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:53.063 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:53.063 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:53.090 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-05-17T11:44:53.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-05-17T11:44:53.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-17T11:44:53.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-17T11:44:53.221 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:53.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:53.223 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-17T11:44:53.288 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:53.288 INFO:tasks.ceph:role: osd.5 2023-05-17T11:44:53.288 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:44:53.289 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-17T11:44:53.351 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:53.352 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:53.352 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:53.352 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:53.352 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:53.352 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:53.353 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:53.353 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:53.353 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:53.353 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:53.378 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-05-17T11:44:53.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-05-17T11:44:53.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-17T11:44:53.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-17T11:44:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:53.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:53.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-17T11:44:53.576 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:53.576 INFO:tasks.ceph:role: osd.6 2023-05-17T11:44:53.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:44:53.576 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-17T11:44:53.639 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:53.639 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:53.639 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:53.639 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:53.640 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:53.640 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:53.640 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:53.640 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:53.640 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:53.640 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:53.665 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-05-17T11:44:53.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-05-17T11:44:53.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-17T11:44:53.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-17T11:44:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:53.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:53.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-17T11:44:53.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T11:44:53.854 INFO:tasks.ceph:role: osd.7 2023-05-17T11:44:53.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:44:53.855 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-17T11:44:53.914 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T11:44:53.915 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T11:44:53.915 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T11:44:53.915 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T11:44:53.915 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T11:44:53.915 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-05-17T11:44:53.915 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T11:44:53.916 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T11:44:53.916 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T11:44:53.916 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T11:44:53.943 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-05-17T11:44:53.946 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-05-17T11:44:53.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-17T11:44:54.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-17T11:44:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2023-05-17T11:44:54.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:44:54.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:54.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:54.197+0000 7f8291b17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-17T11:44:54.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:54.197+0000 7f8291b17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-17T11:44:54.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:54.197+0000 7f8291b17640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T11:44:54.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:54.197+0000 7f8291b17640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T11:44:54.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:54.197+0000 7f8291b17640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T11:44:54.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:54.201+0000 7f8291b17640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-17T11:44:57.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-17T11:44:57.221 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:44:57.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:57.309+0000 7f744590b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-17T11:44:57.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:57.313+0000 7f744590b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-17T11:44:57.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:57.313+0000 7f744590b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T11:44:57.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:57.313+0000 7f744590b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T11:44:57.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:57.313+0000 7f744590b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T11:44:57.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:44:57.313+0000 7f744590b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-17T11:45:00.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-17T11:45:00.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:45:00.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:00.437+0000 7f98f8cb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-17T11:45:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:00.437+0000 7f98f8cb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-17T11:45:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:00.437+0000 7f98f8cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T11:45:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:00.437+0000 7f98f8cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T11:45:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:00.437+0000 7f98f8cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T11:45:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:00.437+0000 7f98f8cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-17T11:45:03.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-17T11:45:03.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:45:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:03.545+0000 7ff3533b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-17T11:45:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:03.545+0000 7ff3533b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-17T11:45:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:03.545+0000 7ff3533b6640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T11:45:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:03.545+0000 7ff3533b6640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T11:45:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:03.545+0000 7ff3533b6640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T11:45:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:03.545+0000 7ff3533b6640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-17T11:45:04.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:45:04.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:45:06.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-17T11:45:06.562 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-17T11:45:06.562 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-17T11:45:06.584 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-17T11:45:06.649 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-17T11:45:06.709 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.709 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-17T11:45:06.769 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-17T11:45:06.829 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-17T11:45:06.889 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:06.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-17T11:45:06.949 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:06.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-17T11:45:06.969 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:06.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-17T11:45:07.032 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-17T11:45:07.092 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-17T11:45:07.152 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-17T11:45:07.212 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-17T11:45:07.271 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-17T11:45:07.332 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:07.333 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-17T11:45:07.341 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:07.341 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-17T11:45:07.390 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.390 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-17T11:45:07.398 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:07.399 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-17T11:45:07.452 INFO:tasks.ceph:Adding keys to all mons... 2023-05-17T11:45:07.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-17T11:45:07.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-17T11:45:07.500 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2023-05-17T11:45:07.500 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAkvmRkxjYFLBAAwRWFpyCGp+EL7AANt+uVEg== 2023-05-17T11:45:07.500 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAkvmRk4XDrMxAAsLImZAurrBniACU6etzV2Q== 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c] 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAkvmRkwrHYOhAAeBG2UCUvXd5rAU1q8/BMJg== 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAovmRkcbh2JhAAFjspIn8MjDqt8XrrKncehg== 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQArvmRkncLuLBAAyXasMBqhBlx9e7YQvuvSGg== 2023-05-17T11:45:07.501 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAuvmRko7JlMxAAyoKJZUBQhM/k1JhivtwpMw== 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAxvmRk+/lYORAAPjMMWGhmHdk6XsQ2tu2PTA== 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAkvmRkXJnPLxAA+Rj+iNYCzQZ9FJOaROUjrw== 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-05-17T11:45:07.502 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAlvmRkGDQiBBAAABY/b3h0AnhBBh0JjX3DNg== 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d] 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAlvmRkAk8sCxAApujQkWzCNGkUTv5QML7tLw== 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA2vmRkED/4CxAArTb77kgjATtLGHbQEuuWRg== 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA5vmRkwhiyEhAArfsdbkcgXwg7Nkd19jJIIw== 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2023-05-17T11:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA8vmRklxAYGhAAFN94Ko8w7EnGPW32h5X/XA== 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA/vmRkFSGbIBAApDkCF5JhMHZM14gdXWqeYg== 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAlvmRkOo7kDhAAn+6FakgO0TNk9cKxUzc0ag== 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout:[client.2] 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAlvmRkgknHFxAAPaHKhhUsPk1vJ8Ea/nHxJA== 2023-05-17T11:45:07.504 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2023-05-17T11:45:07.505 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAlvmRkvYZHGxAAboaf4NuU5FZKCp0dZ1MTeQ== 2023-05-17T11:45:07.505 INFO:teuthology.orchestra.run.smithi003.stdout:[client.3] 2023-05-17T11:45:07.505 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAlvmRkUuB/IRAAssTl1yJXL7Zc4BrtJPc2uw== 2023-05-17T11:45:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2023-05-17T11:45:07.514 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAkvmRkxjYFLBAAwRWFpyCGp+EL7AANt+uVEg== 2023-05-17T11:45:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAkvmRk4XDrMxAAsLImZAurrBniACU6etzV2Q== 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAkvmRkwrHYOhAAeBG2UCUvXd5rAU1q8/BMJg== 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAovmRkcbh2JhAAFjspIn8MjDqt8XrrKncehg== 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQArvmRkncLuLBAAyXasMBqhBlx9e7YQvuvSGg== 2023-05-17T11:45:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAuvmRko7JlMxAAyoKJZUBQhM/k1JhivtwpMw== 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAxvmRk+/lYORAAPjMMWGhmHdk6XsQ2tu2PTA== 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAkvmRkXJnPLxAA+Rj+iNYCzQZ9FJOaROUjrw== 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-05-17T11:45:07.516 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlvmRkGDQiBBAAABY/b3h0AnhBBh0JjX3DNg== 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlvmRkAk8sCxAApujQkWzCNGkUTv5QML7tLw== 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA2vmRkED/4CxAArTb77kgjATtLGHbQEuuWRg== 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5vmRkwhiyEhAArfsdbkcgXwg7Nkd19jJIIw== 2023-05-17T11:45:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA8vmRklxAYGhAAFN94Ko8w7EnGPW32h5X/XA== 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA/vmRkFSGbIBAApDkCF5JhMHZM14gdXWqeYg== 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlvmRkOo7kDhAAn+6FakgO0TNk9cKxUzc0ag== 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:[client.2] 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlvmRkgknHFxAAPaHKhhUsPk1vJ8Ea/nHxJA== 2023-05-17T11:45:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2023-05-17T11:45:07.519 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlvmRkvYZHGxAAboaf4NuU5FZKCp0dZ1MTeQ== 2023-05-17T11:45:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:[client.3] 2023-05-17T11:45:07.519 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlvmRkUuB/IRAAssTl1yJXL7Zc4BrtJPc2uw== 2023-05-17T11:45:07.520 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T11:45:07.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T11:45:07.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:07.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:07.678 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:07.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:07.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.906 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:07.961 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T11:45:08.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T11:45:08.081 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:08.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:08.139 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:08.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T11:45:08.198 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.366 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T11:45:08.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.481 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T11:45:08.657 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-17T11:45:08.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-17T11:45:08.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T11:45:08.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-17T11:45:08.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-17T11:45:08.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T11:45:08.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-17T11:45:08.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-17T11:45:09.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T11:45:09.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-17T11:45:09.153 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:45:09.156 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-17T11:45:09.203 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-17T11:45:09.204 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-17T11:45:09.204 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-17T11:45:09.209 INFO:tasks.ceph.mon.a:Started 2023-05-17T11:45:09.209 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-17T11:45:09.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-17T11:45:09.251 INFO:tasks.ceph.mon.b:Started 2023-05-17T11:45:09.252 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-17T11:45:09.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-17T11:45:09.254 INFO:tasks.ceph.mon.c:Started 2023-05-17T11:45:09.255 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-17T11:45:09.255 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-17T11:45:09.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-17T11:45:09.258 INFO:tasks.ceph.mgr.y:Started 2023-05-17T11:45:09.259 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-17T11:45:09.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-17T11:45:09.262 INFO:tasks.ceph.mgr.x:Started 2023-05-17T11:45:09.262 INFO:tasks.ceph:Setting crush tunables to default 2023-05-17T11:45:09.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2023-05-17T11:45:09.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffff60640 1 Processor -- start 2023-05-17T11:45:09.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffff60640 1 -- start start 2023-05-17T11:45:09.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffff60640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 0x7f2ff80afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffff60640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff809bcb0 con 0x7f2ff815d3d0 2023-05-17T11:45:09.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffff60640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80ca130 con 0x7f2ff80cb4c0 2023-05-17T11:45:09.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffff60640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80cdf90 con 0x7f2ff80ad440 2023-05-17T11:45:09.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffdcfc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2ff815d3d0 0x7f2ff80ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50662/0 (socket says 172.21.15.3:50662) 2023-05-17T11:45:09.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/2613045540 learned_addr learned my addr 172.21.15.3:0/2613045540 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:09.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffd4fb640 1 --2- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 0x7f2ff80afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:09.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffd4fb640 1 -- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 msgr2=0x7f2ff80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-17T11:45:09.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffd4fb640 1 -- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 msgr2=0x7f2ff80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-17T11:45:09.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffd4fb640 1 --2- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 0x7f2ff80afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-17T11:45:09.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.391+0000 7f2ffd4fb640 1 --2- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 0x7f2ff80afdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-17T11:45:09.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.551+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015038406 0 0) 0x7f2ff809bcb0 con 0x7f2ff815d3d0 2023-05-17T11:45:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.551+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe4003530 con 0x7f2ff815d3d0 2023-05-17T11:45:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911052912 0 0) 0x7f2ff80ca130 con 0x7f2ff80cb4c0 2023-05-17T11:45:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff809bcb0 con 0x7f2ff80cb4c0 2023-05-17T11:45:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.1 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 158318223 0 0) 0x7f2ff809bcb0 con 0x7f2ff80cb4c0 2023-05-17T11:45:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 msgr2=0x7f2ff80afdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T11:45:09.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 --2- 172.21.15.3:0/2613045540 >> v2:172.21.15.60:3300/0 conn(0x7f2ff80ad440 0x7f2ff80afdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 >> v1:172.21.15.3:6789/0 conn(0x7f2ff815d3d0 legacy=0x7f2ff80ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80cd490 con 0x7f2ff80cb4c0 2023-05-17T11:45:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.1 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f2ff0001a00 con 0x7f2ff80cb4c0 2023-05-17T11:45:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 >> v1:172.21.15.60:6789/0 conn(0x7f2ff80cb4c0 legacy=0x7f2ff806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:09.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe4003b10 0x7f2fe4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fe40047d0 0x7f2fe4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe40052a0 0x7f2fe400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe400c1a0 con 0x7f2fe4003b10 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe400c310 con 0x7f2fe40047d0 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40108e0 con 0x7f2fe40052a0 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe4003b10 0x7f2fe4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffd4fb640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fe40047d0 0x7f2fe4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe40052a0 msgr2=0x7f2fe400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe40052a0 0x7f2fe400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fe40047d0 msgr2=0x7f2fe4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fe40047d0 0x7f2fe4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/2613045540 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff809bcb0 con 0x7f2fe4003b10 2023-05-17T11:45:09.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.555+0000 7f2ffe4fd640 1 -- 172.21.15.3:0/2613045540 reap_dead start 2023-05-17T11:45:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe4003b10 0x7f2fe4003f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4001a00 tx=0x7f2ff401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68cd2c3f49294cf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004ab0 con 0x7f2fe4003b10 2023-05-17T11:45:09.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff40a8070 con 0x7f2fe4003b10 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffccfa640 1 -- 172.21.15.3:0/2613045540 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004e50 con 0x7f2fe4003b10 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 -- 172.21.15.3:0/2613045540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe4003b10 msgr2=0x7f2fe4003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe4003b10 0x7f2fe4003f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4001a00 tx=0x7f2ff401c680 comp rx=0 tx=0).stop 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 -- 172.21.15.3:0/2613045540 shutdown_connections 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 --2- 172.21.15.3:0/2613045540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe4003b10 0x7f2fe4003f00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 -- 172.21.15.3:0/2613045540 >> 172.21.15.3:0/2613045540 conn(0x7f2ff806a740 msgr2=0x7f2ff80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:09.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 -- 172.21.15.3:0/2613045540 shutdown_connections 2023-05-17T11:45:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.559+0000 7f2ffff60640 1 -- 172.21.15.3:0/2613045540 wait complete. 2023-05-17T11:45:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 Processor -- start 2023-05-17T11:45:09.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 -- start start 2023-05-17T11:45:09.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 0x7f2ff8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ff8099420 0x7f2ff8098a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ff809af50 0x7f2ff809b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:09.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c2ae0 con 0x7f2ff809af50 2023-05-17T11:45:09.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c1e60 con 0x7f2ff8099420 2023-05-17T11:45:09.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffff60640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c2140 con 0x7f2fe4003b10 2023-05-17T11:45:09.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 0x7f2ff8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:09.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 0x7f2ff8159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:33110/0 (socket says 172.21.15.3:33110) 2023-05-17T11:45:09.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/4069865093 learned_addr learned my addr 172.21.15.3:0/4069865093 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:09.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffd4fb640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ff8099420 0x7f2ff8098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffe4fd640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ff809af50 0x7f2ff809b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ff8099420 msgr2=0x7f2ff8098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ff8099420 0x7f2ff8098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/4069865093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ff809af50 msgr2=0x7f2ff809b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ff809af50 0x7f2ff809b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 -- 172.21.15.3:0/4069865093 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff815d7a0 con 0x7f2fe4003b10 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffe4fd640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ff809af50 0x7f2ff809b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.563+0000 7f2ffdcfc640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 0x7f2ff8159400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ff401c6c0 tx=0x7f2ff4019420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004b70 con 0x7f2fe4003b10 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff4004cd0 con 0x7f2fe4003b10 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40072b0 con 0x7f2fe4003b10 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff80ca6b0 con 0x7f2fe4003b10 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80cd170 con 0x7f2fe4003b10 2023-05-17T11:45:09.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2ff40b7440 con 0x7f2fe4003b10 2023-05-17T11:45:09.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2ff40ad760 con 0x7f2fe4003b10 2023-05-17T11:45:09.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.567+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80c2d50 con 0x7f2fe4003b10 2023-05-17T11:45:09.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.579+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2ff40bc020 con 0x7f2fe4003b10 2023-05-17T11:45:09.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.667+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2ff804de80 con 0x7f2fe4003b10 2023-05-17T11:45:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.671+0000 7f2fee7fc640 1 -- 172.21.15.3:0/4069865093 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2ff4001620 con 0x7f2fe4003b10 2023-05-17T11:45:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2023-05-17T11:45:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 msgr2=0x7f2ff8159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 0x7f2ff8159400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ff401c6c0 tx=0x7f2ff4019420 comp rx=0 tx=0).stop 2023-05-17T11:45:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 shutdown_connections 2023-05-17T11:45:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ff809af50 0x7f2ff809b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ff8099420 0x7f2ff8098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 --2- 172.21.15.3:0/4069865093 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2fe4003b10 0x7f2ff8159400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 >> 172.21.15.3:0/4069865093 conn(0x7f2ff806a740 msgr2=0x7f2ff80c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 shutdown_connections 2023-05-17T11:45:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:09.675+0000 7f2ffff60640 1 -- 172.21.15.3:0/4069865093 wait complete. 2023-05-17T11:45:09.703 INFO:tasks.ceph:check_enable_crimson: False 2023-05-17T11:45:09.703 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-17T11:45:09.703 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:09.704 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-17T11:45:09.723 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:09.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-17T11:45:09.764 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:09.757+0000 7f8e3ca4b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-17T11:45:09.780 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:09.771+0000 7faf6aa57180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-17T11:45:09.786 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:09.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-17T11:45:09.845 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:45:09.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-17T11:45:09.904 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:09.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-17T11:45:09.924 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:09.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-17T11:45:09.983 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:09.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-17T11:45:10.043 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:45:10.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-17T11:45:10.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new 2f327564-3482-4c16-adc2-9cfaf32fbd12 0 2023-05-17T11:45:10.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.273+0000 7f179c97b640 1 Processor -- start 2023-05-17T11:45:10.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.273+0000 7f179c97b640 1 -- start start 2023-05-17T11:45:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.273+0000 7f179c97b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f179815c340 0x7f17980d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f179c97b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17980b16f0 0x7f17980d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f179c97b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1798066f00 con 0x7f17980b40b0 2023-05-17T11:45:10.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f179c97b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17980b0250 con 0x7f179815c340 2023-05-17T11:45:10.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f179c97b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17980af640 con 0x7f17980b16f0 2023-05-17T11:45:10.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f178ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f17980b40b0 0x7f17980b25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53312/0 (socket says 172.21.15.60:53312) 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f178ffff640 1 -- 172.21.15.60:0/2789114797 learned_addr learned my addr 172.21.15.60:0/2789114797 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1796d9d640 1 --2- 172.21.15.60:0/2789114797 >> v2:172.21.15.60:3300/0 conn(0x7f17980b16f0 0x7f17980d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f179659c640 1 --2- 172.21.15.60:0/2789114797 >> v2:172.21.15.3:3300/0 conn(0x7f179815c340 0x7f17980d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1796d9d640 1 -- 172.21.15.60:0/2789114797 >> v2:172.21.15.3:3300/0 conn(0x7f179815c340 msgr2=0x7f17980d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1796d9d640 1 --2- 172.21.15.60:0/2789114797 >> v2:172.21.15.3:3300/0 conn(0x7f179815c340 0x7f17980d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1796d9d640 1 -- 172.21.15.60:0/2789114797 >> v1:172.21.15.60:6789/0 conn(0x7f17980b40b0 legacy=0x7f17980b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1796d9d640 1 -- 172.21.15.60:0/2789114797 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980af920 con 0x7f17980b16f0 2023-05-17T11:45:10.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1795d9b640 1 -- 172.21.15.60:0/2789114797 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742323074 0 0) 0x7f1798066f00 con 0x7f17980b40b0 2023-05-17T11:45:10.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1796d9d640 1 --2- 172.21.15.60:0/2789114797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f17980d07c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17980d26f0 tx=0x7f179001c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf22cc932ec1c073 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:10.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1795d9b640 1 -- 172.21.15.60:0/2789114797 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900a5770 con 0x7f17980b16f0 2023-05-17T11:45:10.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1795d9b640 1 -- 172.21.15.60:0/2789114797 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17900a58d0 con 0x7f17980b16f0 2023-05-17T11:45:10.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.277+0000 7f1795d9b640 1 -- 172.21.15.60:0/2789114797 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900a5c60 con 0x7f17980b16f0 2023-05-17T11:45:10.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- 172.21.15.60:0/2789114797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 msgr2=0x7f17980d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 --2- 172.21.15.60:0/2789114797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f17980d07c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17980d26f0 tx=0x7f179001c880 comp rx=0 tx=0).stop 2023-05-17T11:45:10.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- 172.21.15.60:0/2789114797 shutdown_connections 2023-05-17T11:45:10.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 --2- 172.21.15.60:0/2789114797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f17980d07c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 --2- 172.21.15.60:0/2789114797 >> v2:172.21.15.3:3300/0 conn(0x7f179815c340 0x7f17980d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- 172.21.15.60:0/2789114797 >> 172.21.15.60:0/2789114797 conn(0x7f1798071b00 msgr2=0x7f179809bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:10.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- 172.21.15.60:0/2789114797 shutdown_connections 2023-05-17T11:45:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- 172.21.15.60:0/2789114797 wait complete. 2023-05-17T11:45:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 Processor -- start 2023-05-17T11:45:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- start start 2023-05-17T11:45:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f179815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f17980b40b0 0x7f179815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179815c340 0x7f1798151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17980b8150 con 0x7f179815c340 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179815cbf0 con 0x7f17980b16f0 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179c97b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17980b7820 con 0x7f17980b40b0 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f179815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f178ffff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f17980b40b0 0x7f179815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f179815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54748/0 (socket says 172.21.15.60:54748) 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f179659c640 1 -- 172.21.15.60:0/1782167286 learned_addr learned my addr 172.21.15.60:0/1782167286 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.281+0000 7f1796d9d640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179815c340 0x7f1798151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179659c640 1 -- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f17980b40b0 msgr2=0x7f179815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179659c640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f17980b40b0 0x7f179815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179659c640 1 -- 172.21.15.60:0/1782167286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179815c340 msgr2=0x7f1798151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179659c640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179815c340 0x7f1798151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179659c640 1 -- 172.21.15.60:0/1782167286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1790009a70 con 0x7f17980b16f0 2023-05-17T11:45:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f1796d9d640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179815c340 0x7f1798151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179659c640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f179815e930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f178800e9b0 tx=0x7f178800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788009670 con 0x7f17980b16f0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178800c9a0 con 0x7f17980b16f0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178800cd10 con 0x7f17980b16f0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17980b1e00 con 0x7f17980b16f0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17980af2d0 con 0x7f17980b16f0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1788013770 con 0x7f17980b16f0 2023-05-17T11:45:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f178801cc30 con 0x7f17980b16f0 2023-05-17T11:45:10.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.285+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17980b1f90 con 0x7f17980b16f0 2023-05-17T11:45:10.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.289+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f1788021060 con 0x7f17980b16f0 2023-05-17T11:45:10.324 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:10.315+0000 7faf6aa57180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T11:45:10.328 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:10.321+0000 7f8e3ca4b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T11:45:10.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.357+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f327564-3482-4c16-adc2-9cfaf32fbd12", "id": 0} v 0) v1 -- 0x7f179804de80 con 0x7f17980b16f0 2023-05-17T11:45:10.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.361+0000 7f178effd640 1 -- 172.21.15.60:0/1782167286 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f327564-3482-4c16-adc2-9cfaf32fbd12", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1788017070 con 0x7f17980b16f0 2023-05-17T11:45:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:0 2023-05-17T11:45:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 msgr2=0x7f179815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f179815e930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f178800e9b0 tx=0x7f178800ee70 comp rx=0 tx=0).stop 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 shutdown_connections 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179815c340 0x7f1798151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f17980b40b0 0x7f179815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 --2- 172.21.15.60:0/1782167286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17980b16f0 0x7f179815e930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 >> 172.21.15.60:0/1782167286 conn(0x7f1798071b00 msgr2=0x7f179806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 shutdown_connections 2023-05-17T11:45:10.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.365+0000 7f179c97b640 1 -- 172.21.15.60:0/1782167286 wait complete. 2023-05-17T11:45:10.388 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new 4f4f60b7-c63b-41d1-b575-7b361981285b 1 2023-05-17T11:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7dbd6d640 1 Processor -- start 2023-05-17T11:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7dbd6d640 1 -- start start 2023-05-17T11:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7dbd6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7d40d0990 0x7ff7d40b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7dbd6d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d4066f00 con 0x7ff7d415c340 2023-05-17T11:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7dbd6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d40b0250 con 0x7ff7d40b40b0 2023-05-17T11:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7dbd6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d40af640 con 0x7ff7d40d0990 2023-05-17T11:45:10.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d9308640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7d40d0990 0x7ff7d40b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d9308640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7d40d0990 0x7ff7d40b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54762/0 (socket says 172.21.15.60:54762) 2023-05-17T11:45:10.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d9308640 1 -- 172.21.15.60:0/4130916844 learned_addr learned my addr 172.21.15.60:0/4130916844 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:10.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d9308640 1 -- 172.21.15.60:0/4130916844 >> v1:172.21.15.60:6789/0 conn(0x7ff7d40b40b0 legacy=0x7ff7d40b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d9308640 1 -- 172.21.15.60:0/4130916844 >> v1:172.21.15.3:6789/0 conn(0x7ff7d415c340 legacy=0x7ff7d40d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d9308640 1 -- 172.21.15.60:0/4130916844 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40af920 con 0x7ff7d40d0990 2023-05-17T11:45:10.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.517+0000 7ff7d8b07640 1 -- 172.21.15.60:0/4130916844 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538401541 0 0) 0x7ff7d40b0250 con 0x7ff7d40b40b0 2023-05-17T11:45:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7d9308640 1 --2- 172.21.15.60:0/4130916844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d40b06e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009870 tx=0x7ff7c401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52faa9dc41624af4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7d8b07640 1 -- 172.21.15.60:0/4130916844 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40ab650 con 0x7ff7d40d0990 2023-05-17T11:45:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7d8b07640 1 -- 172.21.15.60:0/4130916844 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40ab7b0 con 0x7ff7d40d0990 2023-05-17T11:45:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7d8b07640 1 -- 172.21.15.60:0/4130916844 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40abb40 con 0x7ff7d40d0990 2023-05-17T11:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/4130916844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 msgr2=0x7ff7d40b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 --2- 172.21.15.60:0/4130916844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d40b06e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009870 tx=0x7ff7c401c540 comp rx=0 tx=0).stop 2023-05-17T11:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/4130916844 shutdown_connections 2023-05-17T11:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 --2- 172.21.15.60:0/4130916844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d40b06e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/4130916844 >> 172.21.15.60:0/4130916844 conn(0x7ff7d4071b00 msgr2=0x7ff7d409bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/4130916844 shutdown_connections 2023-05-17T11:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.521+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/4130916844 wait complete. 2023-05-17T11:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 Processor -- start 2023-05-17T11:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 -- start start 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff7d40b40b0 0x7ff7d4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7d415c340 0x7ff7d406c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40ced20 con 0x7ff7d415c340 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40cea40 con 0x7ff7d40d0990 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41571e0 con 0x7ff7d40b40b0 2023-05-17T11:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d406bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54778/0 (socket says 172.21.15.60:54778) 2023-05-17T11:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 -- 172.21.15.60:0/1678955669 learned_addr learned my addr 172.21.15.60:0/1678955669 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9b09640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff7d40b40b0 0x7ff7d4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7da30a640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7d415c340 0x7ff7d406c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.534 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:10.523+0000 7faf6aa57180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T11:45:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 -- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff7d40b40b0 msgr2=0x7ff7d4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff7d40b40b0 0x7ff7d4157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 -- 172.21.15.60:0/1678955669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7d415c340 msgr2=0x7ff7d406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7d415c340 0x7ff7d406c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 -- 172.21.15.60:0/1678955669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40094d0 con 0x7ff7d40d0990 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9b09640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff7d40b40b0 0x7ff7d4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7d9308640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d406bcf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ad040 tx=0x7ff7c40192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40abe70 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40b8070 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4004220 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d40b1e00 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.525+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d40af2d0 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.529+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff7c4003620 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.529+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff7c40beb60 con 0x7ff7d40d0990 2023-05-17T11:45:10.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.529+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d40b1f90 con 0x7ff7d40d0990 2023-05-17T11:45:10.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.529+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7ff7c40c3020 con 0x7ff7d40d0990 2023-05-17T11:45:10.541 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:10.533+0000 7f8e3ca4b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T11:45:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.601+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f4f60b7-c63b-41d1-b575-7b361981285b", "id": 1} v 0) v1 -- 0x7ff7d404de80 con 0x7ff7d40d0990 2023-05-17T11:45:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7ca7fc640 1 -- 172.21.15.60:0/1678955669 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f4f60b7-c63b-41d1-b575-7b361981285b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff7c40ba070 con 0x7ff7d40d0990 2023-05-17T11:45:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-05-17T11:45:10.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 msgr2=0x7ff7d406bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d406bcf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ad040 tx=0x7ff7c40192e0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 shutdown_connections 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7d415c340 0x7ff7d406c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7d40d0990 0x7ff7d406bcf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 --2- 172.21.15.60:0/1678955669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff7d40b40b0 0x7ff7d4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 >> 172.21.15.60:0/1678955669 conn(0x7ff7d4071b00 msgr2=0x7ff7d4154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 shutdown_connections 2023-05-17T11:45:10.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.609+0000 7ff7dbd6d640 1 -- 172.21.15.60:0/1678955669 wait complete. 2023-05-17T11:45:10.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new b19844ff-c2c7-4e4a-8bdd-8bc884d45b62 2 2023-05-17T11:45:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.761+0000 7f3e5b16d640 1 Processor -- start 2023-05-17T11:45:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e5b16d640 1 -- start start 2023-05-17T11:45:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e5b16d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e5415c340 0x7f3e540d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e5b16d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e54066f00 con 0x7f3e540b16f0 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e5b16d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e540b0250 con 0x7f3e540b40b0 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e5b16d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e540b3400 con 0x7f3e5415c340 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e58f09640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e5415c340 0x7f3e540d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e58f09640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e5415c340 0x7f3e540d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54788/0 (socket says 172.21.15.60:54788) 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e53fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3e540b40b0 0x7f3e540b25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53320/0 (socket says 172.21.15.60:53320) 2023-05-17T11:45:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e58f09640 1 -- 172.21.15.60:0/1210168235 learned_addr learned my addr 172.21.15.60:0/1210168235 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:10.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e58f09640 1 -- 172.21.15.60:0/1210168235 >> v1:172.21.15.60:6789/0 conn(0x7f3e540b40b0 legacy=0x7f3e540b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e58f09640 1 -- 172.21.15.60:0/1210168235 >> v1:172.21.15.3:6789/0 conn(0x7f3e540b16f0 legacy=0x7f3e540b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e58f09640 1 -- 172.21.15.60:0/1210168235 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540af640 con 0x7f3e5415c340 2023-05-17T11:45:10.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.765+0000 7f3e537fe640 1 -- 172.21.15.60:0/1210168235 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793778080 0 0) 0x7f3e540b0250 con 0x7f3e540b40b0 2023-05-17T11:45:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e58f09640 1 --2- 172.21.15.60:0/1210168235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e5415c340 0x7f3e540d0280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006fd0 tx=0x7f3e4801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d480d9e7dcc41f87 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e537fe640 1 -- 172.21.15.60:0/1210168235 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480ac600 con 0x7f3e5415c340 2023-05-17T11:45:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e537fe640 1 -- 172.21.15.60:0/1210168235 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480a8050 con 0x7f3e5415c340 2023-05-17T11:45:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e537fe640 1 -- 172.21.15.60:0/1210168235 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480ac980 con 0x7f3e5415c340 2023-05-17T11:45:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1210168235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e5415c340 msgr2=0x7f3e540d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 --2- 172.21.15.60:0/1210168235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e5415c340 0x7f3e540d0280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006fd0 tx=0x7f3e4801c490 comp rx=0 tx=0).stop 2023-05-17T11:45:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1210168235 shutdown_connections 2023-05-17T11:45:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 --2- 172.21.15.60:0/1210168235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e5415c340 0x7f3e540d0280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1210168235 >> 172.21.15.60:0/1210168235 conn(0x7f3e54071b00 msgr2=0x7f3e5409bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1210168235 shutdown_connections 2023-05-17T11:45:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.769+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1210168235 wait complete. 2023-05-17T11:45:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 Processor -- start 2023-05-17T11:45:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 -- start start 2023-05-17T11:45:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 0x7f3e5414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 0x7f3e54157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e5415c340 0x7f3e5406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540cd960 con 0x7f3e5415c340 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540ccce0 con 0x7f3e540b16f0 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540ccfc0 con 0x7f3e540b40b0 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 0x7f3e5414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 0x7f3e54157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 0x7f3e5414d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54796/0 (socket says 172.21.15.60:54796) 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 -- 172.21.15.60:0/1157268583 learned_addr learned my addr 172.21.15.60:0/1157268583 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 0x7f3e54157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.60:37340/0 (socket says 172.21.15.60:37340) 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5970a640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e5415c340 0x7f3e5406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 -- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 msgr2=0x7f3e54157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 0x7f3e54157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 -- 172.21.15.60:0/1157268583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e5415c340 msgr2=0x7f3e5406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e5415c340 0x7f3e5406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 -- 172.21.15.60:0/1157268583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e48009480 con 0x7f3e540b16f0 2023-05-17T11:45:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e53fff640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 0x7f3e54157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:10.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e58f09640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 0x7f3e5414d7a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006fd0 tx=0x7f3e48019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480bb070 con 0x7f3e540b16f0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480039f0 con 0x7f3e540b16f0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e540af2d0 con 0x7f3e540b16f0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48003da0 con 0x7f3e540b16f0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.773+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e540afee0 con 0x7f3e540b16f0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.777+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e480b3070 con 0x7f3e540b16f0 2023-05-17T11:45:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.777+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3e480b7b90 con 0x7f3e540b16f0 2023-05-17T11:45:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.777+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e540b1e00 con 0x7f3e540b16f0 2023-05-17T11:45:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.777+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f3e480b1070 con 0x7f3e540b16f0 2023-05-17T11:45:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.845+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b19844ff-c2c7-4e4a-8bdd-8bc884d45b62", "id": 2} v 0) v1 -- 0x7f3e5404de80 con 0x7f3e540b16f0 2023-05-17T11:45:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.853+0000 7f3e517fa640 1 -- 172.21.15.60:0/1157268583 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b19844ff-c2c7-4e4a-8bdd-8bc884d45b62", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e480ce0b0 con 0x7f3e540b16f0 2023-05-17T11:45:10.861 INFO:teuthology.orchestra.run.smithi060.stdout:2 2023-05-17T11:45:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 msgr2=0x7f3e5414d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:10.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 0x7f3e5414d7a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006fd0 tx=0x7f3e48019230 comp rx=0 tx=0).stop 2023-05-17T11:45:10.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 shutdown_connections 2023-05-17T11:45:10.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e5415c340 0x7f3e5406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e540b40b0 0x7f3e54157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 --2- 172.21.15.60:0/1157268583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e540b16f0 0x7f3e5414d7a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 >> 172.21.15.60:0/1157268583 conn(0x7f3e54071b00 msgr2=0x7f3e540b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 shutdown_connections 2023-05-17T11:45:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:10.857+0000 7f3e5b16d640 1 -- 172.21.15.60:0/1157268583 wait complete. 2023-05-17T11:45:10.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new 4466356c-5db6-42f9-ad9d-312db19fe8d1 3 2023-05-17T11:45:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 Processor -- start 2023-05-17T11:45:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 -- start start 2023-05-17T11:45:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f929815c340 0x7f92980d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 0x7f92980d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9298066f00 con 0x7f92980b40b0 2023-05-17T11:45:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980b0250 con 0x7f929815c340 2023-05-17T11:45:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.009+0000 7f929fb18640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980af640 con 0x7f92980b16f0 2023-05-17T11:45:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 0x7f92980d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 0x7f92980d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.60:37350/0 (socket says 172.21.15.60:37350) 2023-05-17T11:45:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 -- 172.21.15.60:0/2758570081 learned_addr learned my addr 172.21.15.60:0/2758570081 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929d8b4640 1 --2- 172.21.15.60:0/2758570081 >> v2:172.21.15.3:3300/0 conn(0x7f929815c340 0x7f92980d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 -- 172.21.15.60:0/2758570081 >> v2:172.21.15.3:3300/0 conn(0x7f929815c340 msgr2=0x7f92980d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 --2- 172.21.15.60:0/2758570081 >> v2:172.21.15.3:3300/0 conn(0x7f929815c340 0x7f92980d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 -- 172.21.15.60:0/2758570081 >> v1:172.21.15.3:6789/0 conn(0x7f92980b40b0 legacy=0x7f92980b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 -- 172.21.15.60:0/2758570081 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980af920 con 0x7f92980b16f0 2023-05-17T11:45:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929e0b5640 1 --2- 172.21.15.60:0/2758570081 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 0x7f92980d07c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e50 tx=0x7f929001c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a3def72276fdfb4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929c8b2640 1 -- 172.21.15.60:0/2758570081 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900a5670 con 0x7f92980b16f0 2023-05-17T11:45:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929c8b2640 1 -- 172.21.15.60:0/2758570081 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92900a57d0 con 0x7f92980b16f0 2023-05-17T11:45:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.013+0000 7f929c8b2640 1 -- 172.21.15.60:0/2758570081 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900a5b60 con 0x7f92980b16f0 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- 172.21.15.60:0/2758570081 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 msgr2=0x7f92980d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 --2- 172.21.15.60:0/2758570081 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 0x7f92980d07c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e50 tx=0x7f929001c980 comp rx=0 tx=0).stop 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- 172.21.15.60:0/2758570081 shutdown_connections 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 --2- 172.21.15.60:0/2758570081 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f92980b16f0 0x7f92980d07c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 --2- 172.21.15.60:0/2758570081 >> v2:172.21.15.3:3300/0 conn(0x7f929815c340 0x7f92980d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- 172.21.15.60:0/2758570081 >> 172.21.15.60:0/2758570081 conn(0x7f9298071b00 msgr2=0x7f929809bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- 172.21.15.60:0/2758570081 shutdown_connections 2023-05-17T11:45:11.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- 172.21.15.60:0/2758570081 wait complete. 2023-05-17T11:45:11.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 Processor -- start 2023-05-17T11:45:11.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- start start 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92980b16f0 0x7f92980c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92980b40b0 0x7f929814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 0x7f92981594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929814df00 con 0x7f92980b40b0 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92981525c0 con 0x7f92980b16f0 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929fb18640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980c6680 con 0x7f929815c340 2023-05-17T11:45:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929d8b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92980b16f0 0x7f92980c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929e0b5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 0x7f92981594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929e0b5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 0x7f92981594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.60:37364/0 (socket says 172.21.15.60:37364) 2023-05-17T11:45:11.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929e0b5640 1 -- 172.21.15.60:0/3306964538 learned_addr learned my addr 172.21.15.60:0/3306964538 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.017+0000 7f929d0b3640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92980b40b0 0x7f929814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929d8b4640 1 -- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 msgr2=0x7f92981594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929d8b4640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 0x7f92981594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929d8b4640 1 -- 172.21.15.60:0/3306964538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92980b40b0 msgr2=0x7f929814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929d8b4640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92980b40b0 0x7f929814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929d8b4640 1 -- 172.21.15.60:0/3306964538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009b30 con 0x7f92980b16f0 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929e0b5640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 0x7f92981594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929d8b4640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92980b16f0 0x7f92980c6b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f929400e880 tx=0x7f929400ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400c940 con 0x7f92980b16f0 2023-05-17T11:45:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400caa0 con 0x7f92980b16f0 2023-05-17T11:45:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980b1e00 con 0x7f92980b16f0 2023-05-17T11:45:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400ce10 con 0x7f92980b16f0 2023-05-17T11:45:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980af2d0 con 0x7f92980b16f0 2023-05-17T11:45:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9294005ca0 con 0x7f92980b16f0 2023-05-17T11:45:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f92940064b0 con 0x7f92980b16f0 2023-05-17T11:45:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.021+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92980b1f90 con 0x7f92980b16f0 2023-05-17T11:45:11.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.025+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f9294021060 con 0x7f92980b16f0 2023-05-17T11:45:11.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.093+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4466356c-5db6-42f9-ad9d-312db19fe8d1", "id": 3} v 0) v1 -- 0x7f929804de80 con 0x7f92980b16f0 2023-05-17T11:45:11.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f928e7fc640 1 -- 172.21.15.60:0/3306964538 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4466356c-5db6-42f9-ad9d-312db19fe8d1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9294029020 con 0x7f92980b16f0 2023-05-17T11:45:11.106 INFO:teuthology.orchestra.run.smithi060.stdout:3 2023-05-17T11:45:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92980b16f0 msgr2=0x7f92980c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92980b16f0 0x7f92980c6b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f929400e880 tx=0x7f929400ed40 comp rx=0 tx=0).stop 2023-05-17T11:45:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 shutdown_connections 2023-05-17T11:45:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f929815c340 0x7f92981594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92980b40b0 0x7f929814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 --2- 172.21.15.60:0/3306964538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92980b16f0 0x7f92980c6b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 >> 172.21.15.60:0/3306964538 conn(0x7f9298071b00 msgr2=0x7f92981565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 shutdown_connections 2023-05-17T11:45:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.101+0000 7f929fb18640 1 -- 172.21.15.60:0/3306964538 wait complete. 2023-05-17T11:45:11.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new 2121ec95-308e-4941-8c8f-8816f378719a 4 2023-05-17T11:45:11.187 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.179+0000 7faf6aa57180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T11:45:11.216 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.209+0000 7f8e3ca4b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T11:45:11.251 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.243+0000 7faf6aa57180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T11:45:11.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 Processor -- start 2023-05-17T11:45:11.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 -- start start 2023-05-17T11:45:11.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 0x7fd4040d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd4040b40b0 0x7fd4040d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd404066f00 con 0x7fd4040b25e0 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4040b0250 con 0x7fd4040b40b0 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4097cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040af640 con 0x7fd40415c340 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 0x7fd4040d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 0x7fd4040d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.60:37378/0 (socket says 172.21.15.60:37378) 2023-05-17T11:45:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 -- 172.21.15.60:0/3180601677 learned_addr learned my addr 172.21.15.60:0/3180601677 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd3fbfff640 1 --2- 172.21.15.60:0/3180601677 >> v2:172.21.15.3:3300/0 conn(0x7fd4040b40b0 0x7fd4040d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 -- 172.21.15.60:0/3180601677 >> v2:172.21.15.3:3300/0 conn(0x7fd4040b40b0 msgr2=0x7fd4040d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:11.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 --2- 172.21.15.60:0/3180601677 >> v2:172.21.15.3:3300/0 conn(0x7fd4040b40b0 0x7fd4040d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 -- 172.21.15.60:0/3180601677 >> v1:172.21.15.60:6789/0 conn(0x7fd4040b25e0 legacy=0x7fd4040b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd402ffd640 1 -- 172.21.15.60:0/3180601677 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040af920 con 0x7fd40415c340 2023-05-17T11:45:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.257+0000 7fd4027fc640 1 -- 172.21.15.60:0/3180601677 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228593932 0 0) 0x7fd404066f00 con 0x7fd4040b25e0 2023-05-17T11:45:11.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd402ffd640 1 --2- 172.21.15.60:0/3180601677 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 0x7fd4040d0280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006fd0 tx=0x7fd3f401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd9cb1f89eab1c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4027fc640 1 -- 172.21.15.60:0/3180601677 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40aa5f0 con 0x7fd40415c340 2023-05-17T11:45:11.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4027fc640 1 -- 172.21.15.60:0/3180601677 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f40aa750 con 0x7fd40415c340 2023-05-17T11:45:11.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4027fc640 1 -- 172.21.15.60:0/3180601677 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40aaae0 con 0x7fd40415c340 2023-05-17T11:45:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 -- 172.21.15.60:0/3180601677 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 msgr2=0x7fd4040d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 --2- 172.21.15.60:0/3180601677 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 0x7fd4040d0280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006fd0 tx=0x7fd3f401c490 comp rx=0 tx=0).stop 2023-05-17T11:45:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 -- 172.21.15.60:0/3180601677 shutdown_connections 2023-05-17T11:45:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 --2- 172.21.15.60:0/3180601677 >> v2:172.21.15.3:3300/0 conn(0x7fd4040b40b0 0x7fd4040d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 --2- 172.21.15.60:0/3180601677 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd40415c340 0x7fd4040d0280 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 -- 172.21.15.60:0/3180601677 >> 172.21.15.60:0/3180601677 conn(0x7fd404071b00 msgr2=0x7fd40409bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 -- 172.21.15.60:0/3180601677 shutdown_connections 2023-05-17T11:45:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.261+0000 7fd4097cb640 1 -- 172.21.15.60:0/3180601677 wait complete. 2023-05-17T11:45:11.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 Processor -- start 2023-05-17T11:45:11.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 -- start start 2023-05-17T11:45:11.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4040b25e0 0x7fd40414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4040b40b0 0x7fd4040c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 0x7fd40415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404157be0 con 0x7fd4040b25e0 2023-05-17T11:45:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404156f60 con 0x7fd40415c340 2023-05-17T11:45:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd404157240 con 0x7fd4040b40b0 2023-05-17T11:45:11.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 0x7fd40415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4040b40b0 0x7fd4040c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4040b25e0 0x7fd40414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 0x7fd40415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54814/0 (socket says 172.21.15.60:54814) 2023-05-17T11:45:11.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4037fe640 1 -- 172.21.15.60:0/1362386712 learned_addr learned my addr 172.21.15.60:0/1362386712 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 -- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 msgr2=0x7fd40415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 0x7fd40415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 -- 172.21.15.60:0/1362386712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4040b25e0 msgr2=0x7fd40414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4040b25e0 0x7fd40414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 -- 172.21.15.60:0/1362386712 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4009480 con 0x7fd4040b40b0 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4037fe640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 0x7fd40415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd402ffd640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4040b25e0 0x7fd40414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fbfff640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4040b40b0 0x7fd4040c84f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00e870 tx=0x7fd3ec00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0095d0 con 0x7fd4040b40b0 2023-05-17T11:45:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00c940 con 0x7fd4040b40b0 2023-05-17T11:45:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.265+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040b1e00 con 0x7fd4040b40b0 2023-05-17T11:45:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.269+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00ccb0 con 0x7fd4040b40b0 2023-05-17T11:45:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.269+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4040af2d0 con 0x7fd4040b40b0 2023-05-17T11:45:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.269+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd3ec005ca0 con 0x7fd4040b40b0 2023-05-17T11:45:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.269+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd3ec013980 con 0x7fd4040b40b0 2023-05-17T11:45:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.269+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4040b1f90 con 0x7fd4040b40b0 2023-05-17T11:45:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.269+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd3ec021060 con 0x7fd4040b40b0 2023-05-17T11:45:11.283 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.277+0000 7f8e3ca4b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T11:45:11.314 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.303+0000 7faf6aa57180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T11:45:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.337+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2121ec95-308e-4941-8c8f-8816f378719a", "id": 4} v 0) v1 -- 0x7fd404071fa0 con 0x7fd4040b40b0 2023-05-17T11:45:11.347 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.341+0000 7f8e3ca4b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T11:45:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.345+0000 7fd3fb7fe640 1 -- 172.21.15.60:0/1362386712 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2121ec95-308e-4941-8c8f-8816f378719a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3ec017070 con 0x7fd4040b40b0 2023-05-17T11:45:11.353 INFO:teuthology.orchestra.run.smithi060.stdout:4 2023-05-17T11:45:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4040b40b0 msgr2=0x7fd4040c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4040b40b0 0x7fd4040c84f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00e870 tx=0x7fd3ec00ed30 comp rx=0 tx=0).stop 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 shutdown_connections 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd40415c340 0x7fd40415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4040b40b0 0x7fd4040c84f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 --2- 172.21.15.60:0/1362386712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4040b25e0 0x7fd40414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 >> 172.21.15.60:0/1362386712 conn(0x7fd404071b00 msgr2=0x7fd404155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 shutdown_connections 2023-05-17T11:45:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.349+0000 7fd4097cb640 1 -- 172.21.15.60:0/1362386712 wait complete. 2023-05-17T11:45:11.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new 564d4297-058b-4128-9038-72e47135c28d 5 2023-05-17T11:45:11.406 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.395+0000 7faf6aa57180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T11:45:11.445 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.437+0000 7f8e3ca4b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T11:45:11.469 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.459+0000 7faf6aa57180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T11:45:11.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.501+0000 7fe6fb339640 1 Processor -- start 2023-05-17T11:45:11.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.501+0000 7fe6fb339640 1 -- start start 2023-05-17T11:45:11.509 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.505+0000 7f8e3ca4b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T11:45:11.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6fb339640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6f415c240 0x7fe6f40d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6fb339640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe6f40d2ba0 0x7fe6f40d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6fb339640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40b20c0 con 0x7fe6f40d0870 2023-05-17T11:45:11.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6fb339640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40d1060 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6fb339640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40b40e0 con 0x7fe6f415c240 2023-05-17T11:45:11.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6f415c240 0x7fe6f40d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6f415c240 0x7fe6f40d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54818/0 (socket says 172.21.15.60:54818) 2023-05-17T11:45:11.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 -- 172.21.15.60:0/2866044150 learned_addr learned my addr 172.21.15.60:0/2866044150 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f88d4640 1 --2- 172.21.15.60:0/2866044150 >> v2:172.21.15.3:3300/0 conn(0x7fe6f40d2ba0 0x7fe6f40d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 -- 172.21.15.60:0/2866044150 >> v2:172.21.15.3:3300/0 conn(0x7fe6f40d2ba0 msgr2=0x7fe6f40d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:11.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 --2- 172.21.15.60:0/2866044150 >> v2:172.21.15.3:3300/0 conn(0x7fe6f40d2ba0 0x7fe6f40d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 -- 172.21.15.60:0/2866044150 >> v1:172.21.15.3:6789/0 conn(0x7fe6f40d0870 legacy=0x7fe6f415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.505+0000 7fe6f90d5640 1 -- 172.21.15.60:0/2866044150 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40d2ff0 con 0x7fe6f415c240 2023-05-17T11:45:11.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6f90d5640 1 --2- 172.21.15.60:0/2866044150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f40d2660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6f408c9b0 tx=0x7fe6f001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5594908fc69977 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6ebfff640 1 -- 172.21.15.60:0/2866044150 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00ab5f0 con 0x7fe6f415c240 2023-05-17T11:45:11.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6ebfff640 1 -- 172.21.15.60:0/2866044150 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f00ab750 con 0x7fe6f415c240 2023-05-17T11:45:11.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6ebfff640 1 -- 172.21.15.60:0/2866044150 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00abae0 con 0x7fe6f415c240 2023-05-17T11:45:11.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 -- 172.21.15.60:0/2866044150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 msgr2=0x7fe6f40d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 --2- 172.21.15.60:0/2866044150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f40d2660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6f408c9b0 tx=0x7fe6f001c4d0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 -- 172.21.15.60:0/2866044150 shutdown_connections 2023-05-17T11:45:11.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 --2- 172.21.15.60:0/2866044150 >> v2:172.21.15.3:3300/0 conn(0x7fe6f40d2ba0 0x7fe6f40d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 --2- 172.21.15.60:0/2866044150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f40d2660 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 -- 172.21.15.60:0/2866044150 >> 172.21.15.60:0/2866044150 conn(0x7fe6f409bae0 msgr2=0x7fe6f408a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 -- 172.21.15.60:0/2866044150 shutdown_connections 2023-05-17T11:45:11.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 -- 172.21.15.60:0/2866044150 wait complete. 2023-05-17T11:45:11.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 Processor -- start 2023-05-17T11:45:11.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.509+0000 7fe6fb339640 1 -- start start 2023-05-17T11:45:11.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6f40d0870 0x7fe6f4154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe6f40d2ba0 0x7fe6f40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f4152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f415f0b0 con 0x7fe6f40d0870 2023-05-17T11:45:11.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f415edd0 con 0x7fe6f415c240 2023-05-17T11:45:11.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4153670 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f98d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f4152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe6f40d2ba0 0x7fe6f40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f90d5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6f40d0870 0x7fe6f4154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f98d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f4152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54826/0 (socket says 172.21.15.60:54826) 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f98d6640 1 -- 172.21.15.60:0/255817219 learned_addr learned my addr 172.21.15.60:0/255817219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 -- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 msgr2=0x7fe6f4152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f4152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 -- 172.21.15.60:0/255817219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6f40d0870 msgr2=0x7fe6f4154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6f40d0870 0x7fe6f4154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 -- 172.21.15.60:0/255817219 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00094d0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f90d5640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6f40d0870 0x7fe6f4154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f98d6640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f4152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6f88d4640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe6f40d2ba0 0x7fe6f40cbaa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e870 tx=0x7fe6e400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40095d0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400c940 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f40b2bb0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400ccb0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f40b28d0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe6e4005ca0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe6e40139f0 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.513+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40d0c70 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.517+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe6e4021060 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.560 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.551+0000 7faf6aa57180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T11:45:11.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.585+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd new", "uuid": "564d4297-058b-4128-9038-72e47135c28d", "id": 5} v 0) v1 -- 0x7fe6f4066e70 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6e9ffb640 1 -- 172.21.15.60:0/255817219 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "564d4297-058b-4128-9038-72e47135c28d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6e4029020 con 0x7fe6f40d2ba0 2023-05-17T11:45:11.599 INFO:teuthology.orchestra.run.smithi060.stdout:5 2023-05-17T11:45:11.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe6f40d2ba0 msgr2=0x7fe6f40cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe6f40d2ba0 0x7fe6f40cbaa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e870 tx=0x7fe6e400ed30 comp rx=0 tx=0).stop 2023-05-17T11:45:11.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 shutdown_connections 2023-05-17T11:45:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f415c240 0x7fe6f4152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe6f40d2ba0 0x7fe6f40cbaa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 --2- 172.21.15.60:0/255817219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6f40d0870 0x7fe6f4154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 >> 172.21.15.60:0/255817219 conn(0x7fe6f409bae0 msgr2=0x7fe6f40ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 shutdown_connections 2023-05-17T11:45:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.593+0000 7fe6fb339640 1 -- 172.21.15.60:0/255817219 wait complete. 2023-05-17T11:45:11.607 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.601+0000 7f8e3ca4b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T11:45:11.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b 6 2023-05-17T11:45:11.623 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.615+0000 7faf6aa57180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T11:45:11.671 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.665+0000 7f8e3ca4b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T11:45:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 Processor -- start 2023-05-17T11:45:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 -- start start 2023-05-17T11:45:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad480cf640 0x7fad480d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad4806b3d0 0x7fad480ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480cd0f0 con 0x7fad480b7dd0 2023-05-17T11:45:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815cd10 con 0x7fad4806b3d0 2023-05-17T11:45:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4f1a2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815d1d0 con 0x7fad480cf640 2023-05-17T11:45:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad480cf640 0x7fad480d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad480cf640 0x7fad480d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54834/0 (socket says 172.21.15.60:54834) 2023-05-17T11:45:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4e9a1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad4806b3d0 0x7fad480ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 -- 172.21.15.60:0/2752697846 learned_addr learned my addr 172.21.15.60:0/2752697846 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 -- 172.21.15.60:0/2752697846 >> v2:172.21.15.3:3300/0 conn(0x7fad4806b3d0 msgr2=0x7fad480ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 --2- 172.21.15.60:0/2752697846 >> v2:172.21.15.3:3300/0 conn(0x7fad4806b3d0 0x7fad480ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 -- 172.21.15.60:0/2752697846 >> v1:172.21.15.3:6789/0 conn(0x7fad480b7dd0 legacy=0x7fad480cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.749+0000 7fad4d99f640 1 -- 172.21.15.60:0/2752697846 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480cece0 con 0x7fad480cf640 2023-05-17T11:45:11.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4d99f640 1 --2- 172.21.15.60:0/2752697846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad480cf640 0x7fad480d1d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad48071de0 tx=0x7fad3801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8261f69c51856e60 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4d19e640 1 -- 172.21.15.60:0/2752697846 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380ab670 con 0x7fad480cf640 2023-05-17T11:45:11.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4d19e640 1 -- 172.21.15.60:0/2752697846 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380ab7d0 con 0x7fad480cf640 2023-05-17T11:45:11.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4d19e640 1 -- 172.21.15.60:0/2752697846 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380abb60 con 0x7fad480cf640 2023-05-17T11:45:11.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 -- 172.21.15.60:0/2752697846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad480cf640 msgr2=0x7fad480d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/2752697846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad480cf640 0x7fad480d1d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad48071de0 tx=0x7fad3801c470 comp rx=0 tx=0).stop 2023-05-17T11:45:11.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 -- 172.21.15.60:0/2752697846 shutdown_connections 2023-05-17T11:45:11.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/2752697846 >> v2:172.21.15.3:3300/0 conn(0x7fad4806b3d0 0x7fad480ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/2752697846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad480cf640 0x7fad480d1d10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 -- 172.21.15.60:0/2752697846 >> 172.21.15.60:0/2752697846 conn(0x7fad480711e0 msgr2=0x7fad480715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 -- 172.21.15.60:0/2752697846 shutdown_connections 2023-05-17T11:45:11.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.753+0000 7fad4f1a2640 1 -- 172.21.15.60:0/2752697846 wait complete. 2023-05-17T11:45:11.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 Processor -- start 2023-05-17T11:45:11.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 -- start start 2023-05-17T11:45:11.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad4806b3d0 0x7fad4814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 0x7fad480b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad480cf640 0x7fad480b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480b4ee0 con 0x7fad480cf640 2023-05-17T11:45:11.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48154240 con 0x7fad4806b3d0 2023-05-17T11:45:11.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad48158ca0 con 0x7fad480b7dd0 2023-05-17T11:45:11.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 0x7fad480b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4e1a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad4806b3d0 0x7fad4814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 0x7fad480b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.60:37422/0 (socket says 172.21.15.60:37422) 2023-05-17T11:45:11.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 -- 172.21.15.60:0/1739424536 learned_addr learned my addr 172.21.15.60:0/1739424536 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:11.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4e9a1640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad480cf640 0x7fad480b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 -- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad4806b3d0 msgr2=0x7fad4814cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad4806b3d0 0x7fad4814cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 -- 172.21.15.60:0/1739424536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad480cf640 msgr2=0x7fad480b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad480cf640 0x7fad480b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 -- 172.21.15.60:0/1739424536 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad380094d0 con 0x7fad480b7dd0 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4e1a0640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad4806b3d0 0x7fad4814cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4e9a1640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad480cf640 0x7fad480b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4d99f640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 0x7fad480b4090 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fad3801c950 tx=0x7fad3801acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380b4800 con 0x7fad480b7dd0 2023-05-17T11:45:11.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380b4980 con 0x7fad480b7dd0 2023-05-17T11:45:11.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380b4d30 con 0x7fad480b7dd0 2023-05-17T11:45:11.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480d0790 con 0x7fad480b7dd0 2023-05-17T11:45:11.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.757+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480d04b0 con 0x7fad480b7dd0 2023-05-17T11:45:11.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.761+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad380be6f0 con 0x7fad480b7dd0 2023-05-17T11:45:11.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.761+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fad380b33d0 con 0x7fad480b7dd0 2023-05-17T11:45:11.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.761+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48160310 con 0x7fad480b7dd0 2023-05-17T11:45:11.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.761+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fad380c4060 con 0x7fad480b7dd0 2023-05-17T11:45:11.784 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.775+0000 7faf6aa57180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T11:45:11.836 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.829+0000 7f8e3ca4b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T11:45:11.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.829+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b", "id": 6} v 0) v1 -- 0x7fad481540a0 con 0x7fad480b7dd0 2023-05-17T11:45:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.833+0000 7fad3effd640 1 -- 172.21.15.60:0/1739424536 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad481540a0 con 0x7fad480b7dd0 2023-05-17T11:45:11.841 INFO:teuthology.orchestra.run.smithi060.stdout:6 2023-05-17T11:45:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 msgr2=0x7fad480b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 0x7fad480b4090 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fad3801c950 tx=0x7fad3801acb0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 shutdown_connections 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad480cf640 0x7fad480b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fad480b7dd0 0x7fad480b4090 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 --2- 172.21.15.60:0/1739424536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad4806b3d0 0x7fad4814cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 >> 172.21.15.60:0/1739424536 conn(0x7fad480711e0 msgr2=0x7fad4806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 shutdown_connections 2023-05-17T11:45:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.837+0000 7fad4f1a2640 1 -- 172.21.15.60:0/1739424536 wait complete. 2023-05-17T11:45:11.855 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:11.847+0000 7faf6aa57180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T11:45:11.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd new 7ddc02d2-46ec-420c-aabb-5573379f1ea3 7 2023-05-17T11:45:11.910 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:11.905+0000 7f8e3ca4b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T11:45:11.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddb59e640 1 Processor -- start 2023-05-17T11:45:11.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddb59e640 1 -- start start 2023-05-17T11:45:11.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc0d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:11.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddb59e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc15d1d0 con 0x7f7ddc0b7dd0 2023-05-17T11:45:11.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddb59e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0cece0 con 0x7f7ddc0cf640 2023-05-17T11:45:11.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddb59e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc15cd10 con 0x7f7ddc06b3d0 2023-05-17T11:45:11.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc0d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:11.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7dd3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7ddc0cf640 0x7f7ddc15fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53344/0 (socket says 172.21.15.60:53344) 2023-05-17T11:45:11.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.989+0000 7f7dd3fff640 1 -- 172.21.15.60:0/4148132423 learned_addr learned my addr 172.21.15.60:0/4148132423 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-05-17T11:45:11.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996491732 0 0) 0x7f7ddc0cece0 con 0x7f7ddc0cf640 2023-05-17T11:45:11.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc8003530 con 0x7f7ddc0cf640 2023-05-17T11:45:11.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936139940 0 0) 0x7f7ddc15d1d0 con 0x7f7ddc0b7dd0 2023-05-17T11:45:11.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc0cece0 con 0x7f7ddc0b7dd0 2023-05-17T11:45:11.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7ddad9d640 1 -- 172.21.15.60:0/4148132423 >> v1:172.21.15.60:6789/0 conn(0x7f7ddc0cf640 legacy=0x7f7ddc15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:11.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7ddad9d640 1 -- 172.21.15.60:0/4148132423 >> v1:172.21.15.3:6789/0 conn(0x7f7ddc0b7dd0 legacy=0x7f7ddc0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7ddad9d640 1 -- 172.21.15.60:0/4148132423 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc15cef0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7ddad9d640 1 --2- 172.21.15.60:0/4148132423 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc0d1d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009dc0 tx=0x7f7dd401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e657527b4730d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40a59a0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd40a5b00 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.993+0000 7f7dd9d9b640 1 -- 172.21.15.60:0/4148132423 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40a5e90 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- 172.21.15.60:0/4148132423 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 msgr2=0x7f7ddc0d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 --2- 172.21.15.60:0/4148132423 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc0d1d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009dc0 tx=0x7f7dd401c8e0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- 172.21.15.60:0/4148132423 shutdown_connections 2023-05-17T11:45:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 --2- 172.21.15.60:0/4148132423 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc0d1d10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- 172.21.15.60:0/4148132423 >> 172.21.15.60:0/4148132423 conn(0x7f7ddc0711e0 msgr2=0x7f7ddc0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- 172.21.15.60:0/4148132423 shutdown_connections 2023-05-17T11:45:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- 172.21.15.60:0/4148132423 wait complete. 2023-05-17T11:45:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 Processor -- start 2023-05-17T11:45:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- start start 2023-05-17T11:45:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ddc0b7dd0 0x7f7ddc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ddc0cf640 0x7f7ddc0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b2500 con 0x7f7ddc0b7dd0 2023-05-17T11:45:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b2730 con 0x7f7ddc0cf640 2023-05-17T11:45:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddb59e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b2a10 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ddc0cf640 0x7f7ddc0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc1516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.60:37440/0 (socket says 172.21.15.60:37440) 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7dda59c640 1 -- 172.21.15.60:0/1978508884 learned_addr learned my addr 172.21.15.60:0/1978508884 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:11.997+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ddc0cf640 0x7f7ddc0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54852/0 (socket says 172.21.15.60:54852) 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dd3fff640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ddc0b7dd0 0x7f7ddc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dda59c640 1 -- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ddc0cf640 msgr2=0x7f7ddc0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dda59c640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ddc0cf640 0x7f7ddc0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dda59c640 1 -- 172.21.15.60:0/1978508884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ddc0b7dd0 msgr2=0x7f7ddc0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dda59c640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ddc0b7dd0 0x7f7ddc0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dda59c640 1 -- 172.21.15.60:0/1978508884 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4009a70 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dda59c640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc1516b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c490 tx=0x7f7dcc00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0052d0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc005430 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc012870 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc160620 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc0ccfc0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7dcc012cd0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7dcc011380 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.001+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc0d0790 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.005+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f7dcc003600 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.073+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ddc02d2-46ec-420c-aabb-5573379f1ea3", "id": 7} v 0) v1 -- 0x7f7ddc0616e0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7dd2ffd640 1 -- 172.21.15.60:0/1978508884 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ddc02d2-46ec-420c-aabb-5573379f1ea3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7dcc0037a0 con 0x7f7ddc06b3d0 2023-05-17T11:45:12.083 INFO:teuthology.orchestra.run.smithi060.stdout:7 2023-05-17T11:45:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 msgr2=0x7f7ddc1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc1516b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c490 tx=0x7f7dcc00c950 comp rx=0 tx=0).stop 2023-05-17T11:45:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 shutdown_connections 2023-05-17T11:45:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ddc0cf640 0x7f7ddc0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ddc0b7dd0 0x7f7ddc0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 --2- 172.21.15.60:0/1978508884 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7ddc06b3d0 0x7f7ddc1516b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 >> 172.21.15.60:0/1978508884 conn(0x7f7ddc0711e0 msgr2=0x7f7ddc0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 shutdown_connections 2023-05-17T11:45:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-05-17T11:45:12.077+0000 7f7ddb59e640 1 -- 172.21.15.60:0/1978508884 wait complete. 2023-05-17T11:45:12.101 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-17T11:45:12.102 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-17T11:45:12.105 INFO:tasks.ceph.osd.0:Started 2023-05-17T11:45:12.106 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-17T11:45:12.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-17T11:45:12.108 INFO:tasks.ceph.osd.1:Started 2023-05-17T11:45:12.109 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-17T11:45:12.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-17T11:45:12.112 INFO:tasks.ceph.osd.2:Started 2023-05-17T11:45:12.112 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-17T11:45:12.113 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-17T11:45:12.116 INFO:tasks.ceph.osd.3:Started 2023-05-17T11:45:12.117 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-17T11:45:12.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-17T11:45:12.120 INFO:tasks.ceph.osd.4:Started 2023-05-17T11:45:12.120 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-17T11:45:12.120 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-17T11:45:12.123 INFO:tasks.ceph.osd.5:Started 2023-05-17T11:45:12.123 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-17T11:45:12.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-17T11:45:12.126 INFO:tasks.ceph.osd.6:Started 2023-05-17T11:45:12.126 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-17T11:45:12.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-17T11:45:12.129 INFO:tasks.ceph.osd.7:Started 2023-05-17T11:45:12.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:12.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.323+0000 7fcdc2df3640 1 Processor -- start 2023-05-17T11:45:12.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.323+0000 7fcdc2df3640 1 -- start start 2023-05-17T11:45:12.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc2df3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcdbc0716d0 0x7fcdbc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc2df3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0c9fd0 0x7fcdbc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc2df3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc0ca490 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc2df3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdbc0cacf0 con 0x7fcdbc0716d0 2023-05-17T11:45:12.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc2df3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc070140 con 0x7fcdbc0c9fd0 2023-05-17T11:45:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcdbc0716d0 0x7fcdbc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcdbc0716d0 0x7fcdbc06fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34536/0 (socket says 172.21.15.3:34536) 2023-05-17T11:45:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 -- 172.21.15.3:0/272860887 learned_addr learned my addr 172.21.15.3:0/272860887 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdbbfff640 1 --1- 172.21.15.3:0/272860887 >> v1:172.21.15.3:6789/0 conn(0x7fcdbc15a2e0 0x7fcdbc071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50694/0 (socket says 172.21.15.3:50694) 2023-05-17T11:45:12.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc1390640 1 --2- 172.21.15.3:0/272860887 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0c9fd0 0x7fcdbc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 -- 172.21.15.3:0/272860887 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0c9fd0 msgr2=0x7fcdbc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 --2- 172.21.15.3:0/272860887 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0c9fd0 0x7fcdbc0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 -- 172.21.15.3:0/272860887 >> v1:172.21.15.3:6789/0 conn(0x7fcdbc15a2e0 legacy=0x7fcdbc071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.327+0000 7fcdc0b8f640 1 -- 172.21.15.3:0/272860887 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0ca730 con 0x7fcdbc0716d0 2023-05-17T11:45:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc0b8f640 1 --2- 172.21.15.3:0/272860887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc0716d0 0x7fcdbc06fc00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009870 tx=0x7fcdb001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecd8040b008c773 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:12.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdbb7fe640 1 -- 172.21.15.3:0/272860887 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00aa670 con 0x7fcdbc0716d0 2023-05-17T11:45:12.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdbb7fe640 1 -- 172.21.15.3:0/272860887 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb00aa7d0 con 0x7fcdbc0716d0 2023-05-17T11:45:12.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdbb7fe640 1 -- 172.21.15.3:0/272860887 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00aab60 con 0x7fcdbc0716d0 2023-05-17T11:45:12.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 -- 172.21.15.3:0/272860887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc0716d0 msgr2=0x7fcdbc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/272860887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc0716d0 0x7fcdbc06fc00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009870 tx=0x7fcdb001c510 comp rx=0 tx=0).stop 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 -- 172.21.15.3:0/272860887 shutdown_connections 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/272860887 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0c9fd0 0x7fcdbc0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/272860887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc0716d0 0x7fcdbc06fc00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 -- 172.21.15.3:0/272860887 >> 172.21.15.3:0/272860887 conn(0x7fcdbc0b0b30 msgr2=0x7fcdbc0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 -- 172.21.15.3:0/272860887 shutdown_connections 2023-05-17T11:45:12.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 -- 172.21.15.3:0/272860887 wait complete. 2023-05-17T11:45:12.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 Processor -- start 2023-05-17T11:45:12.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.331+0000 7fcdc2df3640 1 -- start start 2023-05-17T11:45:12.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 0x7fcdbc0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdbc0c9fd0 0x7fcdbc14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc15a2e0 0x7fcdbc15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:12.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc158c10 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc159140 con 0x7fcdbc0c9fd0 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc158e60 con 0x7fcdbc0716d0 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc0b8f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 0x7fcdbc0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc15a2e0 0x7fcdbc15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc0b8f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 0x7fcdbc0cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:33160/0 (socket says 172.21.15.3:33160) 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc0b8f640 1 -- 172.21.15.3:0/1889794921 learned_addr learned my addr 172.21.15.3:0/1889794921 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdbbfff640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdbc0c9fd0 0x7fcdbc14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 -- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 msgr2=0x7fcdbc0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 0x7fcdbc0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 -- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdbc0c9fd0 msgr2=0x7fcdbc14de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdbc0c9fd0 0x7fcdbc14de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 -- 172.21.15.3:0/1889794921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00094d0 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc0b8f640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 0x7fcdbc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:12.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc1390640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc15a2e0 0x7fcdbc15a6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400efc0 tx=0x7fcdb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:12.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4009c00 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400f040 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40146c0 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc166c20 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc0c8e80 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcdb4014b20 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcdb4014dd0 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.335+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc166db0 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.347+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fcdb403bb10 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdbc04de80 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdb97fa640 1 -- 172.21.15.3:0/1889794921 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcdb402a070 con 0x7fcdbc15a2e0 2023-05-17T11:45:12.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:12.416 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:12.074066+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:12.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc15a2e0 msgr2=0x7fcdbc15a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:12.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc15a2e0 0x7fcdbc15a6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400efc0 tx=0x7fcdb400c490 comp rx=0 tx=0).stop 2023-05-17T11:45:12.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 shutdown_connections 2023-05-17T11:45:12.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdbc15a2e0 0x7fcdbc15a6d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdbc0c9fd0 0x7fcdbc14de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 --2- 172.21.15.3:0/1889794921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdbc0716d0 0x7fcdbc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:12.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 >> 172.21.15.3:0/1889794921 conn(0x7fcdbc0b0b30 msgr2=0x7fcdbc0ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:12.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 shutdown_connections 2023-05-17T11:45:12.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:12.407+0000 7fcdc2df3640 1 -- 172.21.15.3:0/1889794921 wait complete. 2023-05-17T11:45:12.435 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-17T11:45:12.435 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-17T11:45:12.497 INFO:tasks.ceph.mgr.y.smithi003.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-17T11:45:12.497 INFO:tasks.ceph.mgr.y.smithi003.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-17T11:45:12.497 INFO:tasks.ceph.mgr.y.smithi003.stderr: from numpy import show_config as show_numpy_config 2023-05-17T11:45:12.541 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:12.531+0000 7faf6aa57180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T11:45:12.557 INFO:tasks.ceph.mgr.x.smithi060.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-17T11:45:12.558 INFO:tasks.ceph.mgr.x.smithi060.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-17T11:45:12.558 INFO:tasks.ceph.mgr.x.smithi060.stderr: from numpy import show_config as show_numpy_config 2023-05-17T11:45:12.619 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:12.613+0000 7f8e3ca4b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T11:45:12.680 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:12.671+0000 7faf6aa57180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T11:45:12.757 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:12.749+0000 7f8e3ca4b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T11:45:12.762 INFO:tasks.ceph.osd.5.smithi060.stderr:2023-05-17T11:45:12.757+0000 7f58a522b640 -1 Falling back to public interface 2023-05-17T11:45:12.774 INFO:tasks.ceph.osd.6.smithi060.stderr:2023-05-17T11:45:12.769+0000 7fd33642b640 -1 Falling back to public interface 2023-05-17T11:45:12.775 INFO:tasks.ceph.osd.4.smithi060.stderr:2023-05-17T11:45:12.769+0000 7f3dbd62b640 -1 Falling back to public interface 2023-05-17T11:45:12.790 INFO:tasks.ceph.osd.7.smithi060.stderr:2023-05-17T11:45:12.785+0000 7f320262e640 -1 Falling back to public interface 2023-05-17T11:45:12.820 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-05-17T11:45:12.811+0000 7fb5b585b640 -1 Falling back to public interface 2023-05-17T11:45:12.832 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-05-17T11:45:12.823+0000 7f01c61da640 -1 Falling back to public interface 2023-05-17T11:45:12.833 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-05-17T11:45:12.823+0000 7f7cdc451640 -1 Falling back to public interface 2023-05-17T11:45:12.833 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-05-17T11:45:12.823+0000 7f739a4e4640 -1 Falling back to public interface 2023-05-17T11:45:12.833 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-05-17T11:45:12.823+0000 7f01c519b640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6809/0: (98) Address already in use 2023-05-17T11:45:12.853 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:12.843+0000 7faf6aa57180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T11:45:12.928 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:12.919+0000 7faf6aa57180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T11:45:12.943 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:12.937+0000 7f8e3ca4b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T11:45:13.019 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:13.013+0000 7f8e3ca4b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T11:45:13.070 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:13.059+0000 7faf6aa57180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T11:45:13.163 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:13.157+0000 7f8e3ca4b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T11:45:13.241 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:13.368 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 Processor -- start 2023-05-17T11:45:13.368 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 -- start start 2023-05-17T11:45:13.370 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd50069ad0 0x7fcd50071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50070c10 0x7fcd50071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd50072000 con 0x7fcd500cafc0 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5015c520 con 0x7fcd50069ad0 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd54c41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50069f70 con 0x7fcd50070c10 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd50069ad0 0x7fcd50071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd50069ad0 0x7fcd50071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34554/0 (socket says 172.21.15.3:34554) 2023-05-17T11:45:13.371 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 -- 172.21.15.3:0/3563914565 learned_addr learned my addr 172.21.15.3:0/3563914565 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd4e59c640 1 --1- 172.21.15.3:0/3563914565 >> v1:172.21.15.60:6789/0 conn(0x7fcd500cafc0 0x7fcd5015cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:36400/0 (socket says 172.21.15.3:36400) 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd4ed9d640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50070c10 0x7fcd50071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 -- 172.21.15.3:0/3563914565 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50070c10 msgr2=0x7fcd50071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50070c10 0x7fcd50071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 -- 172.21.15.3:0/3563914565 >> v1:172.21.15.60:6789/0 conn(0x7fcd500cafc0 legacy=0x7fcd5015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd4dd9b640 1 -- 172.21.15.3:0/3563914565 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145127213 0 0) 0x7fcd50072000 con 0x7fcd500cafc0 2023-05-17T11:45:13.372 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd47fff640 1 -- 172.21.15.3:0/3563914565 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50071540 con 0x7fcd50069ad0 2023-05-17T11:45:13.373 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.359+0000 7fcd4ed9d640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50070c10 0x7fcd50071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:13.373 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd47fff640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50069ad0 0x7fcd50071ac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201972624ce3da8d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:13.374 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd4dd9b640 1 -- 172.21.15.3:0/3563914565 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380a9400 con 0x7fcd50069ad0 2023-05-17T11:45:13.374 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd4dd9b640 1 -- 172.21.15.3:0/3563914565 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380a9560 con 0x7fcd50069ad0 2023-05-17T11:45:13.374 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd4dd9b640 1 -- 172.21.15.3:0/3563914565 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380a98f0 con 0x7fcd50069ad0 2023-05-17T11:45:13.375 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 -- 172.21.15.3:0/3563914565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50069ad0 msgr2=0x7fcd50071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:13.375 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50069ad0 0x7fcd50071ac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3801c540 comp rx=0 tx=0).stop 2023-05-17T11:45:13.375 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 -- 172.21.15.3:0/3563914565 shutdown_connections 2023-05-17T11:45:13.375 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50070c10 0x7fcd50071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.375 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 --2- 172.21.15.3:0/3563914565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50069ad0 0x7fcd50071ac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.376 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 -- 172.21.15.3:0/3563914565 >> 172.21.15.3:0/3563914565 conn(0x7fcd5006b800 msgr2=0x7fcd5006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:13.376 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 -- 172.21.15.3:0/3563914565 shutdown_connections 2023-05-17T11:45:13.376 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.363+0000 7fcd54c41640 1 -- 172.21.15.3:0/3563914565 wait complete. 2023-05-17T11:45:13.376 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 Processor -- start 2023-05-17T11:45:13.376 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 -- start start 2023-05-17T11:45:13.378 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50069ad0 0x7fcd500afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:13.378 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 0x7fcd50147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:13.378 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cafc0 0x7fcd501f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:13.378 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50147d90 con 0x7fcd50070c10 2023-05-17T11:45:13.378 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b1040 con 0x7fcd500cafc0 2023-05-17T11:45:13.378 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd54c41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b0430 con 0x7fcd50069ad0 2023-05-17T11:45:13.379 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 0x7fcd50147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:13.379 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 0x7fcd50147850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34562/0 (socket says 172.21.15.3:34562) 2023-05-17T11:45:13.379 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd4e59c640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50069ad0 0x7fcd500afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:13.379 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 -- 172.21.15.3:0/1778796910 learned_addr learned my addr 172.21.15.3:0/1778796910 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:13.379 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd4ed9d640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cafc0 0x7fcd501f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:13.380 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 -- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50069ad0 msgr2=0x7fcd500afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:13.381 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50069ad0 0x7fcd500afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.381 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 -- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cafc0 msgr2=0x7fcd501f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:13.381 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cafc0 0x7fcd501f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.381 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 -- 172.21.15.3:0/1778796910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009a70 con 0x7fcd50070c10 2023-05-17T11:45:13.381 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd4e59c640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50069ad0 0x7fcd500afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:13.381 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd4ed9d640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cafc0 0x7fcd501f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.367+0000 7fcd47fff640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 0x7fcd50147850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd3801a170 tx=0x7fcd3801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380a9400 con 0x7fcd50070c10 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380b1800 con 0x7fcd50070c10 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380b1b90 con 0x7fcd50070c10 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd380094d0 con 0x7fcd50070c10 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500cb390 con 0x7fcd50070c10 2023-05-17T11:45:13.382 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd380bb6f0 con 0x7fcd50070c10 2023-05-17T11:45:13.383 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcd380baca0 con 0x7fcd50070c10 2023-05-17T11:45:13.383 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5015c730 con 0x7fcd50070c10 2023-05-17T11:45:13.383 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.371+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fcd380c0060 con 0x7fcd50070c10 2023-05-17T11:45:13.441 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd50160320 con 0x7fcd50070c10 2023-05-17T11:45:13.441 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd46ffd640 1 -- 172.21.15.3:0/1778796910 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcd380bae60 con 0x7fcd50070c10 2023-05-17T11:45:13.442 INFO:teuthology.misc.health.smithi003.stdout: 2023-05-17T11:45:13.442 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:12.074066+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:13.443 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 msgr2=0x7fcd50147850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:13.443 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 0x7fcd50147850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd3801a170 tx=0x7fcd3801ad80 comp rx=0 tx=0).stop 2023-05-17T11:45:13.443 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 shutdown_connections 2023-05-17T11:45:13.443 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cafc0 0x7fcd501f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.443 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd50070c10 0x7fcd50147850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.443 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 --2- 172.21.15.3:0/1778796910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcd50069ad0 0x7fcd500afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:13.444 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 >> 172.21.15.3:0/1778796910 conn(0x7fcd5006b800 msgr2=0x7fcd50071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:13.444 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 shutdown_connections 2023-05-17T11:45:13.444 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:13.431+0000 7fcd54c41640 1 -- 172.21.15.3:0/1778796910 wait complete. 2023-05-17T11:45:13.459 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-17T11:45:13.775 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:13.767+0000 7faf6aa57180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T11:45:13.858 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:13.853+0000 7f8e3ca4b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T11:45:13.865 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:13.855+0000 7faf6aa57180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T11:45:13.950 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:13.945+0000 7f8e3ca4b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T11:45:14.062 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:14.051+0000 7faf6aa57180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T11:45:14.149 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:14.141+0000 7f8e3ca4b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T11:45:14.150 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:14.139+0000 7faf6aa57180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-17T11:45:14.237 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:14.229+0000 7f8e3ca4b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-17T11:45:14.444 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:14.435+0000 7faf6aa57180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T11:45:14.517 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:14.507+0000 7faf6aa57180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T11:45:14.537 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:14.529+0000 7f8e3ca4b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T11:45:14.612 INFO:tasks.ceph.mgr.x.smithi060.stderr:2023-05-17T11:45:14.604+0000 7f8e3ca4b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T11:45:15.539 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:15.527+0000 7faf1198d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-17T11:45:15.539 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-05-17T11:45:15.531+0000 7faf1198d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-17T11:45:16.594 INFO:tasks.ceph.osd.7.smithi060.stderr:2023-05-17T11:45:16.588+0000 7f320262e640 -1 osd.7 0 log_to_monitors true 2023-05-17T11:45:16.667 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-05-17T11:45:16.659+0000 7f7cdc451640 -1 osd.1 0 log_to_monitors true 2023-05-17T11:45:16.714 INFO:tasks.ceph.osd.4.smithi060.stderr:2023-05-17T11:45:16.708+0000 7f3dbd62b640 -1 osd.4 0 log_to_monitors true 2023-05-17T11:45:16.753 INFO:tasks.ceph.osd.5.smithi060.stderr:2023-05-17T11:45:16.744+0000 7f58a522b640 -1 osd.5 0 log_to_monitors true 2023-05-17T11:45:16.773 INFO:tasks.ceph.osd.6.smithi060.stderr:2023-05-17T11:45:16.768+0000 7fd33642b640 -1 osd.6 0 log_to_monitors true 2023-05-17T11:45:16.815 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-05-17T11:45:16.807+0000 7f739a4e4640 -1 osd.2 0 log_to_monitors true 2023-05-17T11:45:16.838 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-05-17T11:45:16.827+0000 7fb5b585b640 -1 osd.0 0 log_to_monitors true 2023-05-17T11:45:16.840 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-05-17T11:45:16.831+0000 7f01c61da640 -1 osd.3 0 log_to_monitors true 2023-05-17T11:45:20.265 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:20.461 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.451+0000 7f87babe1640 1 Processor -- start 2023-05-17T11:45:20.461 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.451+0000 7f87babe1640 1 -- start start 2023-05-17T11:45:20.463 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87babe1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f87b40b3790 0x7f87b40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:20.464 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87babe1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b40b3b60 con 0x7f87b40c8a20 2023-05-17T11:45:20.464 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87babe1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b40c94e0 con 0x7f87b40b0560 2023-05-17T11:45:20.464 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87babe1640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b415a490 con 0x7f87b40b3790 2023-05-17T11:45:20.464 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b917e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f87b40b0560 0x7f87b40b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:56982/0 (socket says 172.21.15.3:56982) 2023-05-17T11:45:20.465 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b917e640 1 -- 172.21.15.3:0/604512370 learned_addr learned my addr 172.21.15.3:0/604512370 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:20.465 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b3fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f87b40c8a20 0x7f87b40afe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:43644/0 (socket says 172.21.15.3:43644) 2023-05-17T11:45:20.465 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b37fe640 1 -- 172.21.15.3:0/604512370 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507609311 0 0) 0x7f87b40c94e0 con 0x7f87b40b0560 2023-05-17T11:45:20.466 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b37fe640 1 -- 172.21.15.3:0/604512370 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a4003530 con 0x7f87b40b0560 2023-05-17T11:45:20.466 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b897d640 1 --2- 172.21.15.3:0/604512370 >> v2:172.21.15.3:3300/0 conn(0x7f87b40b3790 0x7f87b40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:20.466 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b897d640 1 -- 172.21.15.3:0/604512370 >> v1:172.21.15.60:6789/0 conn(0x7f87b40b0560 legacy=0x7f87b40b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.467 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b37fe640 1 -- 172.21.15.3:0/604512370 <== mon.1 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3233249889 0 0) 0x7f87a4003530 con 0x7f87b40b0560 2023-05-17T11:45:20.467 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b897d640 1 -- 172.21.15.3:0/604512370 >> v1:172.21.15.3:6789/0 conn(0x7f87b40c8a20 legacy=0x7f87b40afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.467 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.455+0000 7f87b897d640 1 -- 172.21.15.3:0/604512370 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40c97c0 con 0x7f87b40b3790 2023-05-17T11:45:20.471 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87b897d640 1 --2- 172.21.15.3:0/604512370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b40ca580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87a80097c0 tx=0x7f87a801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4fbf05d1d01a23 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:20.472 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87b37fe640 1 -- 172.21.15.3:0/604512370 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac001a00 con 0x7f87b40b3790 2023-05-17T11:45:20.472 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87b37fe640 1 -- 172.21.15.3:0/604512370 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a80a7050 con 0x7f87b40b3790 2023-05-17T11:45:20.473 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87b37fe640 1 -- 172.21.15.3:0/604512370 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80ab620 con 0x7f87b40b3790 2023-05-17T11:45:20.473 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 -- 172.21.15.3:0/604512370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 msgr2=0x7f87b40ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.473 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 --2- 172.21.15.3:0/604512370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b40ca580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87a80097c0 tx=0x7f87a801c2e0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.474 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 -- 172.21.15.3:0/604512370 shutdown_connections 2023-05-17T11:45:20.474 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 --2- 172.21.15.3:0/604512370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b40ca580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.474 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 -- 172.21.15.3:0/604512370 >> 172.21.15.3:0/604512370 conn(0x7f87b40cae50 msgr2=0x7f87b40cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:20.475 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 -- 172.21.15.3:0/604512370 shutdown_connections 2023-05-17T11:45:20.475 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.463+0000 7f87babe1640 1 -- 172.21.15.3:0/604512370 wait complete. 2023-05-17T11:45:20.479 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.471+0000 7f87babe1640 1 Processor -- start 2023-05-17T11:45:20.479 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.471+0000 7f87babe1640 1 -- start start 2023-05-17T11:45:20.482 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.471+0000 7f87babe1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 0x7f87b40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:20.483 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87babe1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b4153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:20.483 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b897d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 0x7f87b40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:20.484 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b897d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 0x7f87b40c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:54578/0 (socket says 172.21.15.3:54578) 2023-05-17T11:45:20.484 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87babe1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f87b40c8a20 0x7f87b41ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:20.484 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b4153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:20.484 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b4153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36456/0 (socket says 172.21.15.3:36456) 2023-05-17T11:45:20.485 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b897d640 1 -- 172.21.15.3:0/2752781873 learned_addr learned my addr 172.21.15.3:0/2752781873 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:20.485 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b917e640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f87b40c8a20 0x7f87b41ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:20.485 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b4154180 con 0x7f87b40b3790 2023-05-17T11:45:20.485 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40c73e0 con 0x7f87b40b0560 2023-05-17T11:45:20.486 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b41f3160 con 0x7f87b40c8a20 2023-05-17T11:45:20.486 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b917e640 1 -- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 msgr2=0x7f87b40c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.486 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b917e640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 0x7f87b40c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.487 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b917e640 1 -- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 msgr2=0x7f87b4153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.487 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b917e640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b4153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.487 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b917e640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009420 con 0x7f87b40c8a20 2023-05-17T11:45:20.487 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.475+0000 7f87b897d640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 0x7f87b40c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:20.488 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87b917e640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f87b40c8a20 0x7f87b41ef680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f87ac005c10 tx=0x7f87ac00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:20.488 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac00ce70 con 0x7f87b40c8a20 2023-05-17T11:45:20.488 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac012400 con 0x7f87b40c8a20 2023-05-17T11:45:20.488 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0127d0 con 0x7f87b40c8a20 2023-05-17T11:45:20.488 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b40c9d80 con 0x7f87b40c8a20 2023-05-17T11:45:20.488 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b40c9aa0 con 0x7f87b40c8a20 2023-05-17T11:45:20.489 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.479+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b40ca060 con 0x7f87b40c8a20 2023-05-17T11:45:20.491 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.483+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f87ac007070 con 0x7f87b40c8a20 2023-05-17T11:45:20.492 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.483+0000 7f87b17fa640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f879806a630 0x7f879806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:20.492 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.483+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f87ac082980 con 0x7f87b40c8a20 2023-05-17T11:45:20.492 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.483+0000 7f87b897d640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f879806a630 0x7f879806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:20.494 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.483+0000 7f87b897d640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f879806a630 0x7f879806cae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f87a8019f10 tx=0x7f87a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:20.502 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.491+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f87ac050f10 con 0x7f87b40c8a20 2023-05-17T11:45:20.566 INFO:tasks.ceph.osd.5.smithi060.stderr:2023-05-17T11:45:20.560+0000 7f589ff64640 -1 osd.5 0 waiting for initial osdmap 2023-05-17T11:45:20.571 INFO:tasks.ceph.osd.4.smithi060.stderr:2023-05-17T11:45:20.560+0000 7f3db824b640 -1 osd.4 0 waiting for initial osdmap 2023-05-17T11:45:20.593 INFO:tasks.ceph.osd.7.smithi060.stderr:2023-05-17T11:45:20.584+0000 7f31fd350640 -1 osd.7 0 waiting for initial osdmap 2023-05-17T11:45:20.614 INFO:tasks.ceph.osd.4.smithi060.stderr:2023-05-17T11:45:20.608+0000 7f3db0890640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:20.614 INFO:tasks.ceph.osd.5.smithi060.stderr:2023-05-17T11:45:20.608+0000 7f58985a9640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:20.621 INFO:tasks.ceph.osd.6.smithi060.stderr:2023-05-17T11:45:20.612+0000 7fd331164640 -1 osd.6 0 waiting for initial osdmap 2023-05-17T11:45:20.629 INFO:tasks.ceph.osd.7.smithi060.stderr:2023-05-17T11:45:20.624+0000 7f31f5995640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:20.670 INFO:tasks.ceph.osd.6.smithi060.stderr:2023-05-17T11:45:20.664+0000 7fd3297a9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:20.858 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.847+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87b4067e60 con 0x7f87b40c8a20 2023-05-17T11:45:20.858 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.847+0000 7f87b17fa640 1 -- 172.21.15.3:0/2752781873 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f87ac017020 con 0x7f87b40c8a20 2023-05-17T11:45:20.859 INFO:teuthology.misc.health.smithi003.stdout: 2023-05-17T11:45:20.859 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":12,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:18.534286+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:20.863 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f879806a630 msgr2=0x7f879806cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.863 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f879806a630 0x7f879806cae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f87a8019f10 tx=0x7f87a8008040 comp rx=0 tx=0).stop 2023-05-17T11:45:20.863 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f87b40c8a20 msgr2=0x7f87b41ef680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:20.864 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f87b40c8a20 0x7f87b41ef680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f87ac005c10 tx=0x7f87ac00a430 comp rx=0 tx=0).stop 2023-05-17T11:45:20.864 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 shutdown_connections 2023-05-17T11:45:20.864 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f879806a630 0x7f879806cae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.865 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f87b40c8a20 0x7f87b41ef680 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.865 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87b40b3790 0x7f87b4153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.865 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 --2- 172.21.15.3:0/2752781873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87b40b0560 0x7f87b40c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:20.865 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 >> 172.21.15.3:0/2752781873 conn(0x7f87b40cae50 msgr2=0x7f87b40ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:20.865 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 shutdown_connections 2023-05-17T11:45:20.865 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:20.855+0000 7f87babe1640 1 -- 172.21.15.3:0/2752781873 wait complete. 2023-05-17T11:45:20.891 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-17T11:45:21.018 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-05-17T11:45:21.007+0000 7f7cd7bd3640 -1 osd.1 0 waiting for initial osdmap 2023-05-17T11:45:21.028 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-05-17T11:45:21.019+0000 7fb5b0fdd640 -1 osd.0 0 waiting for initial osdmap 2023-05-17T11:45:21.067 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-05-17T11:45:21.059+0000 7f7cd0218640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:21.079 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-05-17T11:45:21.071+0000 7fb5a9622640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:21.156 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-05-17T11:45:21.147+0000 7f73974a1640 -1 osd.2 0 waiting for initial osdmap 2023-05-17T11:45:21.171 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-05-17T11:45:21.163+0000 7f01c195c640 -1 osd.3 0 waiting for initial osdmap 2023-05-17T11:45:21.183 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-05-17T11:45:21.175+0000 7f738e2ab640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:21.203 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-05-17T11:45:21.195+0000 7f01b9fa1640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T11:45:27.695 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:27.833 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 Processor -- start 2023-05-17T11:45:27.834 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 -- start start 2023-05-17T11:45:27.835 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f36300b3790 0x7f36300ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:27.835 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300c8a20 0x7f36300c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:27.835 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36300b3b60 con 0x7f36300afe50 2023-05-17T11:45:27.835 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363015a490 con 0x7f36300b3790 2023-05-17T11:45:27.835 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.823+0000 7f3636bcb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300c94e0 con 0x7f36300c8a20 2023-05-17T11:45:27.835 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f36300b3790 0x7f36300ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:27.836 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f36300b3790 0x7f36300ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43840/0 (socket says 172.21.15.3:43840) 2023-05-17T11:45:27.836 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 -- 172.21.15.3:0/798981408 learned_addr learned my addr 172.21.15.3:0/798981408 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:27.837 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f362ffff640 1 --2- 172.21.15.3:0/798981408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300c8a20 0x7f36300c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:27.837 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 -- 172.21.15.3:0/798981408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300c8a20 msgr2=0x7f36300c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:27.837 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 --2- 172.21.15.3:0/798981408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300c8a20 0x7f36300c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:27.837 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 -- 172.21.15.3:0/798981408 >> v1:172.21.15.60:6789/0 conn(0x7f36300afe50 legacy=0x7f36300b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:27.837 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 -- 172.21.15.3:0/798981408 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300c97c0 con 0x7f36300b3790 2023-05-17T11:45:27.838 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f3634967640 1 --2- 172.21.15.3:0/798981408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f36300ca580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3624009870 tx=0x7f362401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7589e1e40874b8b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:27.838 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f362f7fe640 1 -- 172.21.15.3:0/798981408 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240a8a30 con 0x7f36300b3790 2023-05-17T11:45:27.839 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f362f7fe640 1 -- 172.21.15.3:0/798981408 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36240a8b90 con 0x7f36300b3790 2023-05-17T11:45:27.839 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.827+0000 7f362f7fe640 1 -- 172.21.15.3:0/798981408 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240b0440 con 0x7f36300b3790 2023-05-17T11:45:27.839 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- 172.21.15.3:0/798981408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 msgr2=0x7f36300ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:27.840 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 --2- 172.21.15.3:0/798981408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f36300ca580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3624009870 tx=0x7f362401ed30 comp rx=0 tx=0).stop 2023-05-17T11:45:27.840 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- 172.21.15.3:0/798981408 shutdown_connections 2023-05-17T11:45:27.840 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 --2- 172.21.15.3:0/798981408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300c8a20 0x7f36300c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:27.840 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 --2- 172.21.15.3:0/798981408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f36300ca580 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:27.840 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- 172.21.15.3:0/798981408 >> 172.21.15.3:0/798981408 conn(0x7f36300cae50 msgr2=0x7f36300cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:27.840 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- 172.21.15.3:0/798981408 shutdown_connections 2023-05-17T11:45:27.841 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- 172.21.15.3:0/798981408 wait complete. 2023-05-17T11:45:27.841 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 Processor -- start 2023-05-17T11:45:27.841 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- start start 2023-05-17T11:45:27.842 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300afe50 0x7f36300c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:27.842 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f363015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:27.843 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300c8a20 0x7f363014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:27.843 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363014b170 con 0x7f36300b3790 2023-05-17T11:45:27.843 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36301558f0 con 0x7f36300c8a20 2023-05-17T11:45:27.843 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.831+0000 7f3636bcb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36301537b0 con 0x7f36300afe50 2023-05-17T11:45:27.844 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f363015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:27.844 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f363015b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43852/0 (socket says 172.21.15.3:43852) 2023-05-17T11:45:27.844 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 -- 172.21.15.3:0/3144079219 learned_addr learned my addr 172.21.15.3:0/3144079219 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f3634967640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300afe50 0x7f36300c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f3635168640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300c8a20 0x7f363014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 -- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300afe50 msgr2=0x7f36300c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300afe50 0x7f36300c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 -- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300c8a20 msgr2=0x7f363014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300c8a20 0x7f363014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 -- 172.21.15.3:0/3144079219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240094d0 con 0x7f36300b3790 2023-05-17T11:45:27.845 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f3635168640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300c8a20 0x7f363014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:27.846 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362ffff640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f363015b1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f361c00d620 tx=0x7f361c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:27.846 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00b620 con 0x7f36300b3790 2023-05-17T11:45:27.846 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c00b7a0 con 0x7f36300b3790 2023-05-17T11:45:27.846 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36300c9d80 con 0x7f36300b3790 2023-05-17T11:45:27.846 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00bb50 con 0x7f36300b3790 2023-05-17T11:45:27.846 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36300c9aa0 con 0x7f36300b3790 2023-05-17T11:45:27.847 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300ca060 con 0x7f36300b3790 2023-05-17T11:45:27.847 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.835+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f361c00bcb0 con 0x7f36300b3790 2023-05-17T11:45:27.847 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.839+0000 7f362d7fa640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3614066280 0x7f3614068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:27.847 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.839+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f361c083cf0 con 0x7f36300b3790 2023-05-17T11:45:27.848 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.839+0000 7f3634967640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3614066280 0x7f3614068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:27.848 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.839+0000 7f3634967640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3614066280 0x7f3614068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36240b2000 tx=0x7f3624009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:27.851 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:27.843+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f361c051610 con 0x7f36300b3790 2023-05-17T11:45:28.018 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.007+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3630067e60 con 0x7f36300b3790 2023-05-17T11:45:28.019 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f362d7fa640 1 -- 172.21.15.3:0/3144079219 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f361c054c30 con 0x7f36300b3790 2023-05-17T11:45:28.020 INFO:teuthology.misc.health.smithi003.stdout: 2023-05-17T11:45:28.020 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":16,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:24.606627+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:28.021 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3614066280 msgr2=0x7f3614068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.021 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3614066280 0x7f3614068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36240b2000 tx=0x7f3624009040 comp rx=0 tx=0).stop 2023-05-17T11:45:28.021 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 msgr2=0x7f363015b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.021 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f363015b1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f361c00d620 tx=0x7f361c00dae0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.022 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 shutdown_connections 2023-05-17T11:45:28.022 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3614066280 0x7f3614068730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.023 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300c8a20 0x7f363014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.023 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36300b3790 0x7f363015b1f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.023 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 --2- 172.21.15.3:0/3144079219 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f36300afe50 0x7f36300c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.023 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 >> 172.21.15.3:0/3144079219 conn(0x7f36300cae50 msgr2=0x7f36300addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:28.023 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 shutdown_connections 2023-05-17T11:45:28.023 INFO:teuthology.misc.health.smithi003.stderr:2023-05-17T11:45:28.011+0000 7f3636bcb640 1 -- 172.21.15.3:0/3144079219 wait complete. 2023-05-17T11:45:28.038 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-17T11:45:28.039 INFO:tasks.ceph:Creating RBD pool 2023-05-17T11:45:28.039 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-17T11:45:28.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe574c74640 1 Processor -- start 2023-05-17T11:45:28.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe574c74640 1 -- start start 2023-05-17T11:45:28.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe574c74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe570070310 0x7fe5700cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe574c74640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570070780 con 0x7fe5700cb0b0 2023-05-17T11:45:28.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe574c74640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57015fd30 con 0x7fe57015c0b0 2023-05-17T11:45:28.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe574c74640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57015d540 con 0x7fe570070310 2023-05-17T11:45:28.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe5700cb0b0 0x7fe5701601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50336/0 (socket says 172.21.15.3:50336) 2023-05-17T11:45:28.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 -- 172.21.15.3:0/2041360953 learned_addr learned my addr 172.21.15.3:0/2041360953 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:28.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56dd9b640 1 --2- 172.21.15.3:0/2041360953 >> v2:172.21.15.60:3300/0 conn(0x7fe570070310 0x7fe5700cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809735987 0 0) 0x7fe5680014a0 con 0x7fe5700cb0b0 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe558003530 con 0x7fe5700cb0b0 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378473485 0 0) 0x7fe558003530 con 0x7fe5700cb0b0 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 >> v2:172.21.15.60:3300/0 conn(0x7fe570070310 msgr2=0x7fe5700cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 --2- 172.21.15.3:0/2041360953 >> v2:172.21.15.60:3300/0 conn(0x7fe570070310 0x7fe5700cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 >> v1:172.21.15.60:6789/0 conn(0x7fe57015c0b0 legacy=0x7fe57015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57015cca0 con 0x7fe5700cb0b0 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fe568001b90 con 0x7fe5700cb0b0 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 >> v1:172.21.15.3:6789/0 conn(0x7fe5700cb0b0 legacy=0x7fe5701601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe558003980 0x7fe558003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe5580047d0 0x7fe558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe558005180 0x7fe55800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57015d540 con 0x7fe558005180 2023-05-17T11:45:28.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55800c000 con 0x7fe558003980 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55800c1c0 con 0x7fe5580047d0 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe558005180 0x7fe55800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56e59c640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe558003980 0x7fe558003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56dd9b640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe5580047d0 0x7fe558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 -- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe5580047d0 msgr2=0x7fe558004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe5580047d0 0x7fe558004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 -- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe558003980 msgr2=0x7fe558003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:28.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe558003980 0x7fe558003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.167+0000 7fe56ed9d640 1 -- 172.21.15.3:0/2041360953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558003530 con 0x7fe558005180 2023-05-17T11:45:28.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe56ed9d640 1 -- 172.21.15.3:0/2041360953 reap_dead start 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe56ed9d640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe558005180 0x7fe55800b990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe56800a830 tx=0x7fe56801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d791f6aa03588c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680ad630 con 0x7fe558005180 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5680a8070 con 0x7fe558005180 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe56d59a640 1 -- 172.21.15.3:0/2041360953 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680ad9f0 con 0x7fe558005180 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 -- 172.21.15.3:0/2041360953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe558005180 msgr2=0x7fe55800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe558005180 0x7fe55800b990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe56800a830 tx=0x7fe56801d340 comp rx=0 tx=0).stop 2023-05-17T11:45:28.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 -- 172.21.15.3:0/2041360953 shutdown_connections 2023-05-17T11:45:28.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 --2- 172.21.15.3:0/2041360953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe558005180 0x7fe55800b990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 -- 172.21.15.3:0/2041360953 >> 172.21.15.3:0/2041360953 conn(0x7fe5700d05b0 msgr2=0x7fe5700d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:28.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 -- 172.21.15.3:0/2041360953 shutdown_connections 2023-05-17T11:45:28.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.171+0000 7fe574c74640 1 -- 172.21.15.3:0/2041360953 wait complete. 2023-05-17T11:45:28.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 Processor -- start 2023-05-17T11:45:28.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 -- start start 2023-05-17T11:45:28.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe558005180 0x7fe5701499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 0x7fe5700c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5700c4b20 0x7fe5700c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700c9490 con 0x7fe5700c46b0 2023-05-17T11:45:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700c6c70 con 0x7fe5700c4b20 2023-05-17T11:45:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700c8570 con 0x7fe558005180 2023-05-17T11:45:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 0x7fe5700c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 0x7fe5700c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43882/0 (socket says 172.21.15.3:43882) 2023-05-17T11:45:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 -- 172.21.15.3:0/732526253 learned_addr learned my addr 172.21.15.3:0/732526253 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 -- 172.21.15.3:0/732526253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe558005180 msgr2=0x7fe5701499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe558005180 0x7fe5701499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 -- 172.21.15.3:0/732526253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5700c4b20 msgr2=0x7fe5700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5700c4b20 0x7fe5700c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 -- 172.21.15.3:0/732526253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57015d260 con 0x7fe5700c46b0 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe56dd9b640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 0x7fe5700c61f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe564011960 tx=0x7fe564011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400fa90 con 0x7fe5700c46b0 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400fbf0 con 0x7fe5700c46b0 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564014440 con 0x7fe5700c46b0 2023-05-17T11:45:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57015cf80 con 0x7fe5700c46b0 2023-05-17T11:45:28.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.175+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5700cab70 con 0x7fe5700c46b0 2023-05-17T11:45:28.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.179+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57004de80 con 0x7fe5700c46b0 2023-05-17T11:45:28.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.179+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5640145a0 con 0x7fe5700c46b0 2023-05-17T11:45:28.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.179+0000 7fe55effd640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe550066280 0x7fe550068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.179+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe5640840b0 con 0x7fe5700c46b0 2023-05-17T11:45:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.179+0000 7fe56e59c640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe550066280 0x7fe550068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.179+0000 7fe56e59c640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe550066280 0x7fe550068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe560007fd0 tx=0x7fe560009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:28.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.183+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe564051940 con 0x7fe5700c46b0 2023-05-17T11:45:28.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:28.339+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe57006fca0 con 0x7fe5700c46b0 2023-05-17T11:45:29.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.075+0000 7fe55effd640 1 -- 172.21.15.3:0/732526253 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe564054f60 con 0x7fe5700c46b0 2023-05-17T11:45:29.084 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'rbd' created 2023-05-17T11:45:29.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe550066280 msgr2=0x7fe550068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:29.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe550066280 0x7fe550068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe560007fd0 tx=0x7fe560009040 comp rx=0 tx=0).stop 2023-05-17T11:45:29.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 msgr2=0x7fe5700c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:29.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 0x7fe5700c61f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe564011960 tx=0x7fe564011e20 comp rx=0 tx=0).stop 2023-05-17T11:45:29.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 shutdown_connections 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe550066280 0x7fe550068730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5700c4b20 0x7fe5700c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5700c46b0 0x7fe5700c61f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 --2- 172.21.15.3:0/732526253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe558005180 0x7fe5701499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 >> 172.21.15.3:0/732526253 conn(0x7fe5700d05b0 msgr2=0x7fe570156610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 shutdown_connections 2023-05-17T11:45:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.079+0000 7fe574c74640 1 -- 172.21.15.3:0/732526253 wait complete. 2023-05-17T11:45:29.110 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-17T11:45:29.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 Processor -- start 2023-05-17T11:45:29.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 -- start start 2023-05-17T11:45:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc410160590 0x7fc4100c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc4100ad3b0 0x7fc4100c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:29.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4100adb90 con 0x7fc4100cdcb0 2023-05-17T11:45:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100b05a0 con 0x7fc4100ad3b0 2023-05-17T11:45:29.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc41808c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc410160960 con 0x7fc410160590 2023-05-17T11:45:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc4100ad3b0 0x7fc4100c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc4100ad3b0 0x7fc4100c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43884/0 (socket says 172.21.15.3:43884) 2023-05-17T11:45:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 -- 172.21.15.3:0/1483986170 learned_addr learned my addr 172.21.15.3:0/1483986170 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:29.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc415e28640 1 --2- 172.21.15.3:0/1483986170 >> v2:172.21.15.60:3300/0 conn(0x7fc410160590 0x7fc4100c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 -- 172.21.15.3:0/1483986170 >> v2:172.21.15.60:3300/0 conn(0x7fc410160590 msgr2=0x7fc4100c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 --2- 172.21.15.3:0/1483986170 >> v2:172.21.15.60:3300/0 conn(0x7fc410160590 0x7fc4100c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 -- 172.21.15.3:0/1483986170 >> v1:172.21.15.60:6789/0 conn(0x7fc4100cdcb0 legacy=0x7fc4100cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:29.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.243+0000 7fc416629640 1 -- 172.21.15.3:0/1483986170 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100ad8b0 con 0x7fc4100ad3b0 2023-05-17T11:45:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc416629640 1 --2- 172.21.15.3:0/1483986170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4100ad3b0 0x7fc4100c1840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc41006b330 tx=0x7fc40801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4860ab2463c3c0e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc414e26640 1 -- 172.21.15.3:0/1483986170 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080a5740 con 0x7fc4100ad3b0 2023-05-17T11:45:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc414e26640 1 -- 172.21.15.3:0/1483986170 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4080a58a0 con 0x7fc4100ad3b0 2023-05-17T11:45:29.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc414e26640 1 -- 172.21.15.3:0/1483986170 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080a5c30 con 0x7fc4100ad3b0 2023-05-17T11:45:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 -- 172.21.15.3:0/1483986170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4100ad3b0 msgr2=0x7fc4100c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 --2- 172.21.15.3:0/1483986170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4100ad3b0 0x7fc4100c1840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc41006b330 tx=0x7fc40801c880 comp rx=0 tx=0).stop 2023-05-17T11:45:29.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 -- 172.21.15.3:0/1483986170 shutdown_connections 2023-05-17T11:45:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 --2- 172.21.15.3:0/1483986170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4100ad3b0 0x7fc4100c1840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 --2- 172.21.15.3:0/1483986170 >> v2:172.21.15.60:3300/0 conn(0x7fc410160590 0x7fc4100c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 -- 172.21.15.3:0/1483986170 >> 172.21.15.3:0/1483986170 conn(0x7fc41006a740 msgr2=0x7fc4100cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 -- 172.21.15.3:0/1483986170 shutdown_connections 2023-05-17T11:45:29.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.247+0000 7fc41808c640 1 -- 172.21.15.3:0/1483986170 wait complete. 2023-05-17T11:45:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 Processor -- start 2023-05-17T11:45:29.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 -- start start 2023-05-17T11:45:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4100ad3b0 0x7fc410157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 0x7fc4100aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc4100aefc0 0x7fc410158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:29.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100af440 con 0x7fc410160590 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410070910 con 0x7fc4100ad3b0 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc410070bf0 con 0x7fc4100aefc0 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 0x7fc4100aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 0x7fc4100aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43896/0 (socket says 172.21.15.3:43896) 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 -- 172.21.15.3:0/1153947860 learned_addr learned my addr 172.21.15.3:0/1153947860 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415e28640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4100ad3b0 0x7fc410157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:29.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc416629640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc4100aefc0 0x7fc410158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:29.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 -- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc4100aefc0 msgr2=0x7fc410158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc4100aefc0 0x7fc410158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 -- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4100ad3b0 msgr2=0x7fc410157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4100ad3b0 0x7fc410157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 -- 172.21.15.3:0/1153947860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408009b30 con 0x7fc410160590 2023-05-17T11:45:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc415627640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 0x7fc4100aea80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c3c0 tx=0x7fc40000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:29.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4000052d0 con 0x7fc410160590 2023-05-17T11:45:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc400005430 con 0x7fc410160590 2023-05-17T11:45:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400003840 con 0x7fc410160590 2023-05-17T11:45:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41016d550 con 0x7fc410160590 2023-05-17T11:45:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.251+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41016d3c0 con 0x7fc410160590 2023-05-17T11:45:29.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.255+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41016d6e0 con 0x7fc410160590 2023-05-17T11:45:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.255+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4000039a0 con 0x7fc410160590 2023-05-17T11:45:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.255+0000 7fc4067fc640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc3f4066280 0x7fc3f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.255+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fc400082e80 con 0x7fc410160590 2023-05-17T11:45:29.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.255+0000 7fc415e28640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc3f4066280 0x7fc3f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:29.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.255+0000 7fc415e28640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc3f4066280 0x7fc3f4068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009b60 tx=0x7fc40c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:29.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.259+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc400050670 con 0x7fc410160590 2023-05-17T11:45:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:29.419+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc41004de80 con 0x7fc410160590 2023-05-17T11:45:30.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc4067fc640 1 -- 172.21.15.3:0/1153947860 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc400053c90 con 0x7fc410160590 2023-05-17T11:45:30.088 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-17T11:45:30.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc3f4066280 msgr2=0x7fc3f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc3f4066280 0x7fc3f4068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009b60 tx=0x7fc40c009190 comp rx=0 tx=0).stop 2023-05-17T11:45:30.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 msgr2=0x7fc4100aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 0x7fc4100aea80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c3c0 tx=0x7fc40000c880 comp rx=0 tx=0).stop 2023-05-17T11:45:30.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 shutdown_connections 2023-05-17T11:45:30.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc3f4066280 0x7fc3f4068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc4100aefc0 0x7fc410158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410160590 0x7fc4100aea80 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c3c0 tx=0x7fc40000c880 comp rx=0 tx=0).stop 2023-05-17T11:45:30.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 --2- 172.21.15.3:0/1153947860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4100ad3b0 0x7fc410157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.079+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 >> 172.21.15.3:0/1153947860 conn(0x7fc41006a740 msgr2=0x7fc41006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:30.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.083+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 shutdown_connections 2023-05-17T11:45:30.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.083+0000 7fc41808c640 1 -- 172.21.15.3:0/1153947860 wait complete. 2023-05-17T11:45:30.116 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-17T11:45:30.117 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T11:45:30.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T11:45:30.120 INFO:tasks.ceph.mds.a:Started 2023-05-17T11:45:30.120 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T11:45:30.121 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T11:45:30.123 INFO:tasks.ceph.mds.c:Started 2023-05-17T11:45:30.124 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T11:45:30.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T11:45:30.127 INFO:tasks.ceph.mds.b:Started 2023-05-17T11:45:30.127 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T11:45:30.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T11:45:30.130 INFO:tasks.ceph.mds.d:Started 2023-05-17T11:45:30.131 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-17T11:45:30.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:30.217 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-05-17T11:45:30.217 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-05-17T11:45:30.231 INFO:tasks.ceph.mds.b.smithi060.stdout:starting mds.b at 2023-05-17T11:45:30.234 INFO:tasks.ceph.mds.d.smithi060.stdout:starting mds.d at 2023-05-17T11:45:30.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 Processor -- start 2023-05-17T11:45:30.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 -- start start 2023-05-17T11:45:30.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f33840d01d0 0x7f33840d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f33840cf010 0x7f33840cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840d0900 con 0x7f338415be40 2023-05-17T11:45:30.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840cf9d0 con 0x7f33840d01d0 2023-05-17T11:45:30.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3389fb0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33840d0be0 con 0x7f33840cf010 2023-05-17T11:45:30.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3388fae640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f338415be40 0x7f33840ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50350/0 (socket says 172.21.15.3:50350) 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3388fae640 1 -- 172.21.15.3:0/2968285453 learned_addr learned my addr 172.21.15.3:0/2968285453 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33897af640 1 --2- 172.21.15.3:0/2968285453 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f33840cf010 0x7f33840cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f3383fff640 1 --2- 172.21.15.3:0/2968285453 >> v2:172.21.15.3:3300/0 conn(0x7f33840d01d0 0x7f33840d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33837fe640 1 -- 172.21.15.3:0/2968285453 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353524690 0 0) 0x7f33840d0900 con 0x7f338415be40 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33837fe640 1 -- 172.21.15.3:0/2968285453 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003530 con 0x7f338415be40 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33897af640 1 -- 172.21.15.3:0/2968285453 >> v2:172.21.15.3:3300/0 conn(0x7f33840d01d0 msgr2=0x7f33840d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33897af640 1 --2- 172.21.15.3:0/2968285453 >> v2:172.21.15.3:3300/0 conn(0x7f33840d01d0 0x7f33840d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33897af640 1 -- 172.21.15.3:0/2968285453 >> v1:172.21.15.3:6789/0 conn(0x7f338415be40 legacy=0x7f33840ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.271+0000 7f33897af640 1 -- 172.21.15.3:0/2968285453 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840d0ec0 con 0x7f33840cf010 2023-05-17T11:45:30.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f33897af640 1 --2- 172.21.15.3:0/2968285453 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f33840cf010 0x7f33840cf490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f337c009d90 tx=0x7f337c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ad8ada123a1617 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f33837fe640 1 -- 172.21.15.3:0/2968285453 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0af600 con 0x7f33840cf010 2023-05-17T11:45:30.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f33837fe640 1 -- 172.21.15.3:0/2968285453 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c0ab050 con 0x7f33840cf010 2023-05-17T11:45:30.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f33837fe640 1 -- 172.21.15.3:0/2968285453 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0af980 con 0x7f33840cf010 2023-05-17T11:45:30.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 -- 172.21.15.3:0/2968285453 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f33840cf010 msgr2=0x7f33840cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 --2- 172.21.15.3:0/2968285453 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f33840cf010 0x7f33840cf490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f337c009d90 tx=0x7f337c01f130 comp rx=0 tx=0).stop 2023-05-17T11:45:30.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 -- 172.21.15.3:0/2968285453 shutdown_connections 2023-05-17T11:45:30.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 --2- 172.21.15.3:0/2968285453 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f33840cf010 0x7f33840cf490 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 --2- 172.21.15.3:0/2968285453 >> v2:172.21.15.3:3300/0 conn(0x7f33840d01d0 0x7f33840d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 -- 172.21.15.3:0/2968285453 >> 172.21.15.3:0/2968285453 conn(0x7f3384065a90 msgr2=0x7f33840711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:30.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 -- 172.21.15.3:0/2968285453 shutdown_connections 2023-05-17T11:45:30.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 -- 172.21.15.3:0/2968285453 wait complete. 2023-05-17T11:45:30.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 Processor -- start 2023-05-17T11:45:30.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.275+0000 7f3389fb0640 1 -- start start 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840cf010 0x7f33840b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 0x7f3384156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f338415be40 0x7f3384156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338414c5a0 con 0x7f33840d01d0 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338415ea20 con 0x7f33840cf010 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384155f30 con 0x7f338415be40 2023-05-17T11:45:30.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 0x7f3384156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 0x7f3384156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43956/0 (socket says 172.21.15.3:43956) 2023-05-17T11:45:30.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 -- 172.21.15.3:0/3847556053 learned_addr learned my addr 172.21.15.3:0/3847556053 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f33897af640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f338415be40 0x7f3384156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3388fae640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840cf010 0x7f33840b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 -- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f338415be40 msgr2=0x7f3384156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f338415be40 0x7f3384156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 -- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840cf010 msgr2=0x7f33840b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840cf010 0x7f33840b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 -- 172.21.15.3:0/3847556053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c009a70 con 0x7f33840d01d0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3383fff640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 0x7f3384156920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f337000e930 tx=0x7f337000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370009690 con 0x7f33840d01d0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337000ca00 con 0x7f33840d01d0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337000cd70 con 0x7f33840d01d0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33840d1480 con 0x7f33840d01d0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33840d11a0 con 0x7f33840d01d0 2023-05-17T11:45:30.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33840d0600 con 0x7f33840d01d0 2023-05-17T11:45:30.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.279+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3370013470 con 0x7f33840d01d0 2023-05-17T11:45:30.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.283+0000 7f33817fa640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3368066280 0x7f3368068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.283+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3370083ff0 con 0x7f33840d01d0 2023-05-17T11:45:30.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.283+0000 7f3388fae640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3368066280 0x7f3368068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.283+0000 7f3388fae640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3368066280 0x7f3368068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3378005890 tx=0x7f3378009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.287+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f33700518d0 con 0x7f33840d01d0 2023-05-17T11:45:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.443+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f338415f5f0 con 0x7f33840d01d0 2023-05-17T11:45:30.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.443+0000 7f33817fa640 1 -- 172.21.15.3:0/3847556053 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14541 (secure 0 0 0) 0x7f3370054ef0 con 0x7f33840d01d0 2023-05-17T11:45:30.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:30.454 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:30.074147+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3368066280 msgr2=0x7f3368068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3368066280 0x7f3368068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3378005890 tx=0x7f3378009040 comp rx=0 tx=0).stop 2023-05-17T11:45:30.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 msgr2=0x7f3384156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 0x7f3384156920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f337000e930 tx=0x7f337000edf0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 shutdown_connections 2023-05-17T11:45:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3368066280 0x7f3368068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f338415be40 0x7f3384156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33840d01d0 0x7f3384156920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 --2- 172.21.15.3:0/3847556053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840cf010 0x7f33840b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 >> 172.21.15.3:0/3847556053 conn(0x7f3384065a90 msgr2=0x7f338415a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 shutdown_connections 2023-05-17T11:45:30.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.447+0000 7f3389fb0640 1 -- 172.21.15.3:0/3847556053 wait complete. 2023-05-17T11:45:30.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:45:30.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:45:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.603+0000 7fead28f9640 1 Processor -- start 2023-05-17T11:45:30.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.603+0000 7fead28f9640 1 -- start start 2023-05-17T11:45:30.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead28f9640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0b2950 0x7feacc09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead28f9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feacc0ad760 0x7feacc0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead28f9640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc06d020 con 0x7feacc0cddf0 2023-05-17T11:45:30.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead28f9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc0b2d20 con 0x7feacc0ad760 2023-05-17T11:45:30.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead28f9640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc1591b0 con 0x7feacc0b2950 2023-05-17T11:45:30.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead0e96640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7feacc0cddf0 0x7feacc0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50364/0 (socket says 172.21.15.3:50364) 2023-05-17T11:45:30.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7fead0e96640 1 -- 172.21.15.3:0/2990220451 learned_addr learned my addr 172.21.15.3:0/2990220451 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:30.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacbfff640 1 --2- 172.21.15.3:0/2990220451 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0b2950 0x7feacc09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacb7fe640 1 --2- 172.21.15.3:0/2990220451 >> v2:172.21.15.60:3300/0 conn(0x7feacc0ad760 0x7feacc0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacaffd640 1 -- 172.21.15.3:0/2990220451 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369684088 0 0) 0x7feacc06d020 con 0x7feacc0cddf0 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacaffd640 1 -- 172.21.15.3:0/2990220451 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab4003530 con 0x7feacc0cddf0 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacbfff640 1 -- 172.21.15.3:0/2990220451 >> v2:172.21.15.60:3300/0 conn(0x7feacc0ad760 msgr2=0x7feacc0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacbfff640 1 --2- 172.21.15.3:0/2990220451 >> v2:172.21.15.60:3300/0 conn(0x7feacc0ad760 0x7feacc0cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacbfff640 1 -- 172.21.15.3:0/2990220451 >> v1:172.21.15.3:6789/0 conn(0x7feacc0cddf0 legacy=0x7feacc0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacaffd640 1 -- 172.21.15.3:0/2990220451 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1855325542 0 0) 0x7feab4003530 con 0x7feacc0cddf0 2023-05-17T11:45:30.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.607+0000 7feacbfff640 1 -- 172.21.15.3:0/2990220451 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0adb90 con 0x7feacc0b2950 2023-05-17T11:45:30.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7feacbfff640 1 --2- 172.21.15.3:0/2990220451 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0b2950 0x7feacc09bd90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feabc0097c0 tx=0x7feabc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5bfdbd4571bd35 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7feacaffd640 1 -- 172.21.15.3:0/2990220451 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4001a00 con 0x7feacc0b2950 2023-05-17T11:45:30.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7feacaffd640 1 -- 172.21.15.3:0/2990220451 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc0a7050 con 0x7feacc0b2950 2023-05-17T11:45:30.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7feacaffd640 1 -- 172.21.15.3:0/2990220451 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0ab620 con 0x7feacc0b2950 2023-05-17T11:45:30.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 -- 172.21.15.3:0/2990220451 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0b2950 msgr2=0x7feacc09bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 --2- 172.21.15.3:0/2990220451 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0b2950 0x7feacc09bd90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feabc0097c0 tx=0x7feabc01c370 comp rx=0 tx=0).stop 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 -- 172.21.15.3:0/2990220451 shutdown_connections 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 --2- 172.21.15.3:0/2990220451 >> v2:172.21.15.60:3300/0 conn(0x7feacc0ad760 0x7feacc0cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 --2- 172.21.15.3:0/2990220451 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0b2950 0x7feacc09bd90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 -- 172.21.15.3:0/2990220451 >> 172.21.15.3:0/2990220451 conn(0x7feacc06a740 msgr2=0x7feacc0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 -- 172.21.15.3:0/2990220451 shutdown_connections 2023-05-17T11:45:30.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.611+0000 7fead28f9640 1 -- 172.21.15.3:0/2990220451 wait complete. 2023-05-17T11:45:30.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 Processor -- start 2023-05-17T11:45:30.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- start start 2023-05-17T11:45:30.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0ad760 0x7feacc0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 0x7feacc15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feacc0cddf0 0x7feacc15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0c5b50 con 0x7feacc0b2950 2023-05-17T11:45:30.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0c5820 con 0x7feacc0cddf0 2023-05-17T11:45:30.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0adec0 con 0x7feacc0ad760 2023-05-17T11:45:30.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 0x7feacc15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 0x7feacc15a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43962/0 (socket says 172.21.15.3:43962) 2023-05-17T11:45:30.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 -- 172.21.15.3:0/2148286868 learned_addr learned my addr 172.21.15.3:0/2148286868 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:30.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 -- 172.21.15.3:0/2148286868 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0ad760 msgr2=0x7feacc0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0ad760 0x7feacc0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 -- 172.21.15.3:0/2148286868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feacc0cddf0 msgr2=0x7feacc15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feacc0cddf0 0x7feacc15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 -- 172.21.15.3:0/2148286868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc009420 con 0x7feacc0b2950 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feacb7fe640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 0x7feacc15a3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feac000e930 tx=0x7feac000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0009690 con 0x7feacc0b2950 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac000ca00 con 0x7feacc0b2950 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000cd70 con 0x7feacc0b2950 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc0cc380 con 0x7feacc0b2950 2023-05-17T11:45:30.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc06d4b0 con 0x7feacc0b2950 2023-05-17T11:45:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.615+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc0cb8d0 con 0x7feacc0b2950 2023-05-17T11:45:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.619+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feac0013470 con 0x7feacc0b2950 2023-05-17T11:45:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.619+0000 7feac8ff9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7feab8066280 0x7feab8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.619+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feac0083cd0 con 0x7feacc0b2950 2023-05-17T11:45:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.619+0000 7feacbfff640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7feab8066280 0x7feab8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.619+0000 7feacbfff640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7feab8066280 0x7feab8068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feabc0ad000 tx=0x7feabc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.623+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feac00514c0 con 0x7feacc0b2950 2023-05-17T11:45:30.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.779+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feacc0c5990 con 0x7feacc0b2950 2023-05-17T11:45:30.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.779+0000 7feac8ff9640 1 -- 172.21.15.3:0/2148286868 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7feacc0c5990 con 0x7feacc0b2950 2023-05-17T11:45:30.790 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:45:30.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7feab8066280 msgr2=0x7feab8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7feab8066280 0x7feab8068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feabc0ad000 tx=0x7feabc008040 comp rx=0 tx=0).stop 2023-05-17T11:45:30.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 msgr2=0x7feacc15a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 0x7feacc15a3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feac000e930 tx=0x7feac000edf0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 shutdown_connections 2023-05-17T11:45:30.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7feab8066280 0x7feab8068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feacc0cddf0 0x7feacc15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feacc0b2950 0x7feacc15a3d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 --2- 172.21.15.3:0/2148286868 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feacc0ad760 0x7feacc0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 >> 172.21.15.3:0/2148286868 conn(0x7feacc06a740 msgr2=0x7feacc06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:30.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 shutdown_connections 2023-05-17T11:45:30.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.783+0000 7fead28f9640 1 -- 172.21.15.3:0/2148286868 wait complete. 2023-05-17T11:45:30.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:45:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.939+0000 7f85f0525640 1 Processor -- start 2023-05-17T11:45:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.939+0000 7f85f0525640 1 -- start start 2023-05-17T11:45:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85f0525640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e815d3d0 0x7f85e80ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85f0525640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f85e80b04c0 0x7f85e806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85f0525640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e809bcb0 con 0x7f85e80cd2c0 2023-05-17T11:45:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85f0525640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80cdf90 con 0x7f85e80b04c0 2023-05-17T11:45:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85f0525640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80ca130 con 0x7f85e815d3d0 2023-05-17T11:45:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85edac0640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f85e80cd2c0 0x7f85e80afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50366/0 (socket says 172.21.15.3:50366) 2023-05-17T11:45:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85eeac2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f85e80b04c0 0x7f85e806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85edac0640 1 -- 172.21.15.3:0/1073037366 learned_addr learned my addr 172.21.15.3:0/1073037366 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85ee2c1640 1 --2- 172.21.15.3:0/1073037366 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e815d3d0 0x7f85e80ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85eeac2640 1 -- 172.21.15.3:0/1073037366 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e815d3d0 msgr2=0x7f85e80ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:30.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85eeac2640 1 --2- 172.21.15.3:0/1073037366 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e815d3d0 0x7f85e80ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85eeac2640 1 -- 172.21.15.3:0/1073037366 >> v1:172.21.15.3:6789/0 conn(0x7f85e80cd2c0 legacy=0x7f85e80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85eeac2640 1 -- 172.21.15.3:0/1073037366 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e809bf00 con 0x7f85e80b04c0 2023-05-17T11:45:30.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.943+0000 7f85ed2bf640 1 -- 172.21.15.3:0/1073037366 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503785811 0 0) 0x7f85e809bcb0 con 0x7f85e80cd2c0 2023-05-17T11:45:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85eeac2640 1 --2- 172.21.15.3:0/1073037366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e80b04c0 0x7f85e806fb20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009d90 tx=0x7f85e001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17935acd380fc1bd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85ed2bf640 1 -- 172.21.15.3:0/1073037366 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00a5870 con 0x7f85e80b04c0 2023-05-17T11:45:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85ed2bf640 1 -- 172.21.15.3:0/1073037366 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00a59d0 con 0x7f85e80b04c0 2023-05-17T11:45:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85ed2bf640 1 -- 172.21.15.3:0/1073037366 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00a5d60 con 0x7f85e80b04c0 2023-05-17T11:45:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 -- 172.21.15.3:0/1073037366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e80b04c0 msgr2=0x7f85e806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 --2- 172.21.15.3:0/1073037366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e80b04c0 0x7f85e806fb20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009d90 tx=0x7f85e001c8c0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 -- 172.21.15.3:0/1073037366 shutdown_connections 2023-05-17T11:45:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 --2- 172.21.15.3:0/1073037366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e80b04c0 0x7f85e806fb20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 --2- 172.21.15.3:0/1073037366 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e815d3d0 0x7f85e80ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 -- 172.21.15.3:0/1073037366 >> 172.21.15.3:0/1073037366 conn(0x7f85e806a740 msgr2=0x7f85e80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 -- 172.21.15.3:0/1073037366 shutdown_connections 2023-05-17T11:45:30.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 -- 172.21.15.3:0/1073037366 wait complete. 2023-05-17T11:45:30.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 Processor -- start 2023-05-17T11:45:30.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.947+0000 7f85f0525640 1 -- start start 2023-05-17T11:45:30.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e80b04c0 0x7f85e8155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85e80cd2c0 0x7f85e80c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 0x7f85e80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8152c70 con 0x7f85e815d3d0 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8153150 con 0x7f85e80cd2c0 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8151ff0 con 0x7f85e80b04c0 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 0x7f85e80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 0x7f85e80c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43982/0 (socket says 172.21.15.3:43982) 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 -- 172.21.15.3:0/804238077 learned_addr learned my addr 172.21.15.3:0/804238077 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85ee2c1640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e80b04c0 0x7f85e8155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85edac0640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85e80cd2c0 0x7f85e80c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 -- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e80b04c0 msgr2=0x7f85e8155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e80b04c0 0x7f85e8155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 -- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85e80cd2c0 msgr2=0x7f85e80c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85e80cd2c0 0x7f85e80c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 -- 172.21.15.3:0/804238077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009a70 con 0x7f85e815d3d0 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85ee2c1640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e80b04c0 0x7f85e8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85edac0640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85e80cd2c0 0x7f85e80c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85eeac2640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 0x7f85e80c9620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85e001a4f0 tx=0x7f85e0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00ad640 con 0x7f85e815d3d0 2023-05-17T11:45:30.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00ad7a0 con 0x7f85e815d3d0 2023-05-17T11:45:30.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00adb10 con 0x7f85e815d3d0 2023-05-17T11:45:30.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e8070060 con 0x7f85e815d3d0 2023-05-17T11:45:30.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e815d7a0 con 0x7f85e815d3d0 2023-05-17T11:45:30.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80701f0 con 0x7f85e815d3d0 2023-05-17T11:45:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.951+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85e00b4070 con 0x7f85e815d3d0 2023-05-17T11:45:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.955+0000 7f85deffd640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85cc066280 0x7f85cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.955+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f85e011e530 con 0x7f85e815d3d0 2023-05-17T11:45:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.955+0000 7f85ee2c1640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85cc066280 0x7f85cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.955+0000 7f85ee2c1640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85cc066280 0x7f85cc068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009b10 tx=0x7f85e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:30.959+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f85e00ef790 con 0x7f85e815d3d0 2023-05-17T11:45:31.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.115+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85e8157490 con 0x7f85e815d3d0 2023-05-17T11:45:31.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.115+0000 7f85deffd640 1 -- 172.21.15.3:0/804238077 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85e00ef320 con 0x7f85e815d3d0 2023-05-17T11:45:31.126 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:45:31.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85cc066280 msgr2=0x7f85cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85cc066280 0x7f85cc068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009b10 tx=0x7f85e4008040 comp rx=0 tx=0).stop 2023-05-17T11:45:31.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 msgr2=0x7f85e80c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 0x7f85e80c9620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85e001a4f0 tx=0x7f85e0019660 comp rx=0 tx=0).stop 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 shutdown_connections 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85cc066280 0x7f85cc068730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85e815d3d0 0x7f85e80c9620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85e80cd2c0 0x7f85e80c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 --2- 172.21.15.3:0/804238077 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85e80b04c0 0x7f85e8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 >> 172.21.15.3:0/804238077 conn(0x7f85e806a740 msgr2=0x7f85e81568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 shutdown_connections 2023-05-17T11:45:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.119+0000 7f85f0525640 1 -- 172.21.15.3:0/804238077 wait complete. 2023-05-17T11:45:31.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:45:31.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.275+0000 7f30f256d640 1 Processor -- start 2023-05-17T11:45:31.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.275+0000 7f30f256d640 1 -- start start 2023-05-17T11:45:31.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30f256d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30ec15f4a0 0x7f30ec1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30f256d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30f256d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec160b20 con 0x7f30ec0ce190 2023-05-17T11:45:31.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30f256d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec0cfc90 con 0x7f30ec15f4a0 2023-05-17T11:45:31.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30f256d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec0cff70 con 0x7f30ec0b2750 2023-05-17T11:45:31.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30ec15f4a0 0x7f30ec1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30ec15f4a0 0x7f30ec1605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43996/0 (socket says 172.21.15.3:43996) 2023-05-17T11:45:31.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 -- 172.21.15.3:0/772706721 learned_addr learned my addr 172.21.15.3:0/772706721 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:31.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30f0b0a640 1 --2- 172.21.15.3:0/772706721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 -- 172.21.15.3:0/772706721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 msgr2=0x7f30ec0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:31.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 --2- 172.21.15.3:0/772706721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 -- 172.21.15.3:0/772706721 >> v1:172.21.15.60:6789/0 conn(0x7f30ec0ce190 legacy=0x7f30ec0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 -- 172.21.15.3:0/772706721 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0d0250 con 0x7f30ec15f4a0 2023-05-17T11:45:31.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30ebfff640 1 --2- 172.21.15.3:0/772706721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec15f4a0 0x7f30ec1605e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009870 tx=0x7f30dc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d44c79cc8088110 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.279+0000 7f30eaffd640 1 -- 172.21.15.3:0/772706721 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0a7070 con 0x7f30ec15f4a0 2023-05-17T11:45:31.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30eaffd640 1 -- 172.21.15.3:0/772706721 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc0ab430 con 0x7f30ec15f4a0 2023-05-17T11:45:31.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30eaffd640 1 -- 172.21.15.3:0/772706721 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0ab7c0 con 0x7f30ec15f4a0 2023-05-17T11:45:31.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- 172.21.15.3:0/772706721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec15f4a0 msgr2=0x7f30ec1605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 --2- 172.21.15.3:0/772706721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec15f4a0 0x7f30ec1605e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009870 tx=0x7f30dc01c540 comp rx=0 tx=0).stop 2023-05-17T11:45:31.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- 172.21.15.3:0/772706721 shutdown_connections 2023-05-17T11:45:31.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 --2- 172.21.15.3:0/772706721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 --2- 172.21.15.3:0/772706721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec15f4a0 0x7f30ec1605e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- 172.21.15.3:0/772706721 >> 172.21.15.3:0/772706721 conn(0x7f30ec06eac0 msgr2=0x7f30ec0cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:31.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- 172.21.15.3:0/772706721 shutdown_connections 2023-05-17T11:45:31.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- 172.21.15.3:0/772706721 wait complete. 2023-05-17T11:45:31.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 Processor -- start 2023-05-17T11:45:31.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- start start 2023-05-17T11:45:31.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 0x7f30ec06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec15f4a0 0x7f30ec06bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec0c7a30 con 0x7f30ec0ce190 2023-05-17T11:45:31.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec15bd80 con 0x7f30ec15f4a0 2023-05-17T11:45:31.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30f256d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec0c9f90 con 0x7f30ec0b2750 2023-05-17T11:45:31.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30eb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 0x7f30ec06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30eb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 0x7f30ec06b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44000/0 (socket says 172.21.15.3:44000) 2023-05-17T11:45:31.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.283+0000 7f30eb7fe640 1 -- 172.21.15.3:0/3375445086 learned_addr learned my addr 172.21.15.3:0/3375445086 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:31.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30ebfff640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30f0b0a640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec15f4a0 0x7f30ec06bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30eb7fe640 1 -- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 msgr2=0x7f30ec15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30eb7fe640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30eb7fe640 1 -- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec15f4a0 msgr2=0x7f30ec06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30eb7fe640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec15f4a0 0x7f30ec06bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30eb7fe640 1 -- 172.21.15.3:0/3375445086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0094d0 con 0x7f30ec0ce190 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30f0b0a640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec15f4a0 0x7f30ec06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:31.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30eb7fe640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 0x7f30ec06b960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c420 tx=0x7f30e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00052d0 con 0x7f30ec0ce190 2023-05-17T11:45:31.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0005430 con 0x7f30ec0ce190 2023-05-17T11:45:31.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec15f870 con 0x7f30ec0ce190 2023-05-17T11:45:31.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0007260 con 0x7f30ec0ce190 2023-05-17T11:45:31.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec0ce590 con 0x7f30ec0ce190 2023-05-17T11:45:31.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec0cc200 con 0x7f30ec0ce190 2023-05-17T11:45:31.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30e00073c0 con 0x7f30ec0ce190 2023-05-17T11:45:31.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30e8ff9640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f30d8066280 0x7f30d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f30e0082cd0 con 0x7f30ec0ce190 2023-05-17T11:45:31.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.287+0000 7f30ebfff640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f30d8066280 0x7f30d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.291+0000 7f30ebfff640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f30d8066280 0x7f30d8068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0af000 tx=0x7f30dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.291+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f30e0050400 con 0x7f30ec0ce190 2023-05-17T11:45:31.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30ec160b20 con 0x7f30ec0ce190 2023-05-17T11:45:31.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30e8ff9640 1 -- 172.21.15.3:0/3375445086 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7f30ec160b20 con 0x7f30ec0ce190 2023-05-17T11:45:31.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:31.492 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-17T11:45:31.493 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 3 2023-05-17T11:45:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f30d8066280 msgr2=0x7f30d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f30d8066280 0x7f30d8068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0af000 tx=0x7f30dc008040 comp rx=0 tx=0).stop 2023-05-17T11:45:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 msgr2=0x7f30ec06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 0x7f30ec06b960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c420 tx=0x7f30e000c8e0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 shutdown_connections 2023-05-17T11:45:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f30d8066280 0x7f30d8068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec15f4a0 0x7f30ec06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30ec0ce190 0x7f30ec06b960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 --2- 172.21.15.3:0/3375445086 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f30ec0b2750 0x7f30ec15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 >> 172.21.15.3:0/3375445086 conn(0x7f30ec06eac0 msgr2=0x7f30ec0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:31.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 shutdown_connections 2023-05-17T11:45:31.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.483+0000 7f30f256d640 1 -- 172.21.15.3:0/3375445086 wait complete. 2023-05-17T11:45:31.513 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:31.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.639+0000 7f10f5df0640 1 Processor -- start 2023-05-17T11:45:31.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.639+0000 7f10f5df0640 1 -- start start 2023-05-17T11:45:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10f5df0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f10f015c5c0 0x7f10f0065980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10f5df0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10f006cd50 0x7f10f006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10f5df0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f0161010 con 0x7f10f0160ac0 2023-05-17T11:45:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10f5df0640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f0069b50 con 0x7f10f015c5c0 2023-05-17T11:45:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10f5df0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f015c990 con 0x7f10f006cd50 2023-05-17T11:45:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f10f015c5c0 0x7f10f0065980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f10f015c5c0 0x7f10f0065980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44014/0 (socket says 172.21.15.3:44014) 2023-05-17T11:45:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 -- 172.21.15.3:0/4127721595 learned_addr learned my addr 172.21.15.3:0/4127721595 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10effff640 1 --2- 172.21.15.3:0/4127721595 >> v2:172.21.15.60:3300/0 conn(0x7f10f006cd50 0x7f10f006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 -- 172.21.15.3:0/4127721595 >> v2:172.21.15.60:3300/0 conn(0x7f10f006cd50 msgr2=0x7f10f006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 --2- 172.21.15.3:0/4127721595 >> v2:172.21.15.60:3300/0 conn(0x7f10f006cd50 0x7f10f006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 -- 172.21.15.3:0/4127721595 >> v1:172.21.15.60:6789/0 conn(0x7f10f0160ac0 legacy=0x7f10f006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.643+0000 7f10ef7fe640 1 -- 172.21.15.3:0/4127721595 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00c9320 con 0x7f10f015c5c0 2023-05-17T11:45:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10ef7fe640 1 --2- 172.21.15.3:0/4127721595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f0065980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10f0073610 tx=0x7f10e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc83819b89597c21 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10ee7fc640 1 -- 172.21.15.3:0/4127721595 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00aa430 con 0x7f10f015c5c0 2023-05-17T11:45:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10ee7fc640 1 -- 172.21.15.3:0/4127721595 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00aa590 con 0x7f10f015c5c0 2023-05-17T11:45:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10ee7fc640 1 -- 172.21.15.3:0/4127721595 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00aa920 con 0x7f10f015c5c0 2023-05-17T11:45:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- 172.21.15.3:0/4127721595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 msgr2=0x7f10f0065980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 --2- 172.21.15.3:0/4127721595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f0065980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10f0073610 tx=0x7f10e001c4d0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- 172.21.15.3:0/4127721595 shutdown_connections 2023-05-17T11:45:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 --2- 172.21.15.3:0/4127721595 >> v2:172.21.15.60:3300/0 conn(0x7f10f006cd50 0x7f10f006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 --2- 172.21.15.3:0/4127721595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f0065980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- 172.21.15.3:0/4127721595 >> 172.21.15.3:0/4127721595 conn(0x7f10f00b1530 msgr2=0x7f10f00cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- 172.21.15.3:0/4127721595 shutdown_connections 2023-05-17T11:45:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- 172.21.15.3:0/4127721595 wait complete. 2023-05-17T11:45:31.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 Processor -- start 2023-05-17T11:45:31.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- start start 2023-05-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10f006cd50 0x7f10f00709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0160ac0 0x7f10f014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f014fbb0 con 0x7f10f015c5c0 2023-05-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0150a10 con 0x7f10f0160ac0 2023-05-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10f5df0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c69f0 con 0x7f10f006cd50 2023-05-17T11:45:31.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10eeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.647+0000 7f10eeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44020/0 (socket says 172.21.15.3:44020) 2023-05-17T11:45:31.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 -- 172.21.15.3:0/2111393573 learned_addr learned my addr 172.21.15.3:0/2111393573 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:31.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10ef7fe640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10f006cd50 0x7f10f00709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10effff640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0160ac0 0x7f10f014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 -- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10f006cd50 msgr2=0x7f10f00709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10f006cd50 0x7f10f00709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 -- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0160ac0 msgr2=0x7f10f014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0160ac0 0x7f10f014ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 -- 172.21.15.3:0/2111393573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00094d0 con 0x7f10f015c5c0 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10eeffd640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f015b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c530 tx=0x7f10e400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4005220 con 0x7f10f015c5c0 2023-05-17T11:45:31.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4005380 con 0x7f10f015c5c0 2023-05-17T11:45:31.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4007270 con 0x7f10f015c5c0 2023-05-17T11:45:31.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f00cd050 con 0x7f10f015c5c0 2023-05-17T11:45:31.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f00ce910 con 0x7f10f015c5c0 2023-05-17T11:45:31.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f00cd1e0 con 0x7f10f015c5c0 2023-05-17T11:45:31.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10e40073d0 con 0x7f10f015c5c0 2023-05-17T11:45:31.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10d7fff640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10dc066280 0x7f10dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.651+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f10e40832f0 con 0x7f10f015c5c0 2023-05-17T11:45:31.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.655+0000 7f10ef7fe640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10dc066280 0x7f10dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.655+0000 7f10ef7fe640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10dc066280 0x7f10dc068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ae000 tx=0x7f10e00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.655+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f10e4050ab0 con 0x7f10f015c5c0 2023-05-17T11:45:31.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.811+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10f004de80 con 0x7f10f015c5c0 2023-05-17T11:45:31.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.811+0000 7f10d7fff640 1 -- 172.21.15.3:0/2111393573 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14528 (secure 0 0 0) 0x7f10e40540d0 con 0x7f10f015c5c0 2023-05-17T11:45:31.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:31.822 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:31.085871+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:31.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10dc066280 msgr2=0x7f10dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10dc066280 0x7f10dc068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ae000 tx=0x7f10e00a7000 comp rx=0 tx=0).stop 2023-05-17T11:45:31.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 msgr2=0x7f10f015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f015b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c530 tx=0x7f10e400c9f0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 shutdown_connections 2023-05-17T11:45:31.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10dc066280 0x7f10dc068730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0160ac0 0x7f10f014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10f015c5c0 0x7f10f015b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 --2- 172.21.15.3:0/2111393573 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10f006cd50 0x7f10f00709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 >> 172.21.15.3:0/2111393573 conn(0x7f10f00b1530 msgr2=0x7f10f015fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:31.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 shutdown_connections 2023-05-17T11:45:31.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.815+0000 7f10f5df0640 1 -- 172.21.15.3:0/2111393573 wait complete. 2023-05-17T11:45:31.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:45:31.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:45:31.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 Processor -- start 2023-05-17T11:45:31.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 -- start start 2023-05-17T11:45:31.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbbe015c340 0x7fbbe00d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbe00b40b0 0x7fbbe00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe0066f00 con 0x7fbbe00b25e0 2023-05-17T11:45:31.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00b0250 con 0x7fbbe015c340 2023-05-17T11:45:31.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe7b98640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00af640 con 0x7fbbe00b40b0 2023-05-17T11:45:31.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbbe015c340 0x7fbbe00d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbbe015c340 0x7fbbe00d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44022/0 (socket says 172.21.15.3:44022) 2023-05-17T11:45:31.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 -- 172.21.15.3:0/1273259342 learned_addr learned my addr 172.21.15.3:0/1273259342 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:31.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5133640 1 --2- 172.21.15.3:0/1273259342 >> v2:172.21.15.60:3300/0 conn(0x7fbbe00b40b0 0x7fbbe00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 -- 172.21.15.3:0/1273259342 >> v2:172.21.15.60:3300/0 conn(0x7fbbe00b40b0 msgr2=0x7fbbe00d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:31.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 --2- 172.21.15.3:0/1273259342 >> v2:172.21.15.60:3300/0 conn(0x7fbbe00b40b0 0x7fbbe00d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 -- 172.21.15.3:0/1273259342 >> v1:172.21.15.60:6789/0 conn(0x7fbbe00b25e0 legacy=0x7fbbe00b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.975+0000 7fbbe5934640 1 -- 172.21.15.3:0/1273259342 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00af920 con 0x7fbbe015c340 2023-05-17T11:45:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe5934640 1 --2- 172.21.15.3:0/1273259342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe015c340 0x7fbbe00d0280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbe008ca80 tx=0x7fbbdc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360619fa3d0f6ca0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe4932640 1 -- 172.21.15.3:0/1273259342 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0ab670 con 0x7fbbe015c340 2023-05-17T11:45:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe4932640 1 -- 172.21.15.3:0/1273259342 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0ab7d0 con 0x7fbbe015c340 2023-05-17T11:45:31.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe4932640 1 -- 172.21.15.3:0/1273259342 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0abb60 con 0x7fbbe015c340 2023-05-17T11:45:31.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1273259342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe015c340 msgr2=0x7fbbe00d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1273259342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe015c340 0x7fbbe00d0280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbe008ca80 tx=0x7fbbdc01c470 comp rx=0 tx=0).stop 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1273259342 shutdown_connections 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1273259342 >> v2:172.21.15.60:3300/0 conn(0x7fbbe00b40b0 0x7fbbe00d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1273259342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe015c340 0x7fbbe00d0280 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1273259342 >> 172.21.15.3:0/1273259342 conn(0x7fbbe0071b00 msgr2=0x7fbbe009bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1273259342 shutdown_connections 2023-05-17T11:45:31.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.979+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1273259342 wait complete. 2023-05-17T11:45:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 Processor -- start 2023-05-17T11:45:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 -- start start 2023-05-17T11:45:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbe00b25e0 0x7fbbe01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 0x7fbbe00ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbbe015c340 0x7fbbe014fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00ce720 con 0x7fbbe00b40b0 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00cdd50 con 0x7fbbe00b25e0 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00cd030 con 0x7fbbe015c340 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 0x7fbbe00ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 0x7fbbe00ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44032/0 (socket says 172.21.15.3:44032) 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 -- 172.21.15.3:0/1704442282 learned_addr learned my addr 172.21.15.3:0/1704442282 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5934640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbe00b25e0 0x7fbbe01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe6135640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbbe015c340 0x7fbbe014fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 -- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbbe015c340 msgr2=0x7fbbe014fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbbe015c340 0x7fbbe014fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 -- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbe00b25e0 msgr2=0x7fbbe01519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbe00b25e0 0x7fbbe01519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 -- 172.21.15.3:0/1704442282 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009480 con 0x7fbbe00b40b0 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5934640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbe00b25e0 0x7fbbe01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe5133640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 0x7fbbe00ce1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000e930 tx=0x7fbbd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:31.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0009690 con 0x7fbbe00b40b0 2023-05-17T11:45:31.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000ca00 con 0x7fbbe00b40b0 2023-05-17T11:45:31.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000cd70 con 0x7fbbe00b40b0 2023-05-17T11:45:31.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe00b1e00 con 0x7fbbe00b40b0 2023-05-17T11:45:31.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.983+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe00af2d0 con 0x7fbbe00b40b0 2023-05-17T11:45:31.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.987+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe00b1f90 con 0x7fbbe00b40b0 2023-05-17T11:45:31.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.987+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbd0013470 con 0x7fbbe00b40b0 2023-05-17T11:45:31.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.987+0000 7fbbd67fc640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbbc4066280 0x7fbbc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:31.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.987+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbbd0083d20 con 0x7fbbe00b40b0 2023-05-17T11:45:31.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.987+0000 7fbbe5934640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbbc4066280 0x7fbbc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:31.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.987+0000 7fbbe5934640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbbc4066280 0x7fbbc4068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0af000 tx=0x7fbbdc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:31.991+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbbd0051510 con 0x7fbbe00b40b0 2023-05-17T11:45:32.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbe00cd560 con 0x7fbbe00b40b0 2023-05-17T11:45:32.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbd67fc640 1 -- 172.21.15.3:0/1704442282 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbe00cd560 con 0x7fbbe00b40b0 2023-05-17T11:45:32.157 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:45:32.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbbc4066280 msgr2=0x7fbbc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbbc4066280 0x7fbbc4068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0af000 tx=0x7fbbdc0a7000 comp rx=0 tx=0).stop 2023-05-17T11:45:32.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 msgr2=0x7fbbe00ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 0x7fbbe00ce1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000e930 tx=0x7fbbd000edf0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 shutdown_connections 2023-05-17T11:45:32.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbbc4066280 0x7fbbc4068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbbe015c340 0x7fbbe014fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbe00b40b0 0x7fbbe00ce1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 --2- 172.21.15.3:0/1704442282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbe00b25e0 0x7fbbe01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 >> 172.21.15.3:0/1704442282 conn(0x7fbbe0071b00 msgr2=0x7fbbe0159680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:32.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 shutdown_connections 2023-05-17T11:45:32.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.147+0000 7fbbe7b98640 1 -- 172.21.15.3:0/1704442282 wait complete. 2023-05-17T11:45:32.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:45:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a9dcb640 1 Processor -- start 2023-05-17T11:45:32.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a9dcb640 1 -- start start 2023-05-17T11:45:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a9dcb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f39a4159190 0x7f39a40cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a9dcb640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a415a4d0 con 0x7f39a40ce1a0 2023-05-17T11:45:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a9dcb640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a4159710 con 0x7f39a40ae150 2023-05-17T11:45:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a9dcb640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a40ce790 con 0x7f39a4159190 2023-05-17T11:45:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a37fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f39a4159190 0x7f39a40cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a2ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f39a40ce1a0 0x7f39a40ada40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50370/0 (socket says 172.21.15.3:50370) 2023-05-17T11:45:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a2ffd640 1 -- 172.21.15.3:0/2843532378 learned_addr learned my addr 172.21.15.3:0/2843532378 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a37fe640 1 -- 172.21.15.3:0/2843532378 >> v1:172.21.15.60:6789/0 conn(0x7f39a40ae150 legacy=0x7f39a40cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a37fe640 1 -- 172.21.15.3:0/2843532378 >> v1:172.21.15.3:6789/0 conn(0x7f39a40ce1a0 legacy=0x7f39a40ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a27fc640 1 -- 172.21.15.3:0/2843532378 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123668023 0 0) 0x7f39a415a4d0 con 0x7f39a40ce1a0 2023-05-17T11:45:32.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.307+0000 7f39a37fe640 1 -- 172.21.15.3:0/2843532378 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a41599f0 con 0x7f39a4159190 2023-05-17T11:45:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a37fe640 1 --2- 172.21.15.3:0/2843532378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a4159190 0x7f39a40cdc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39940097c0 tx=0x7f399401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6616c6c2aa4cacaf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a27fc640 1 -- 172.21.15.3:0/2843532378 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940ad660 con 0x7f39a4159190 2023-05-17T11:45:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a27fc640 1 -- 172.21.15.3:0/2843532378 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39940ad7c0 con 0x7f39a4159190 2023-05-17T11:45:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a27fc640 1 -- 172.21.15.3:0/2843532378 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940adb50 con 0x7f39a4159190 2023-05-17T11:45:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2843532378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a4159190 msgr2=0x7f39a40cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2843532378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a4159190 0x7f39a40cdc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39940097c0 tx=0x7f399401c450 comp rx=0 tx=0).stop 2023-05-17T11:45:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2843532378 shutdown_connections 2023-05-17T11:45:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2843532378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a4159190 0x7f39a40cdc60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2843532378 >> 172.21.15.3:0/2843532378 conn(0x7f39a40b0650 msgr2=0x7f39a40b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2843532378 shutdown_connections 2023-05-17T11:45:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.311+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2843532378 wait complete. 2023-05-17T11:45:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 Processor -- start 2023-05-17T11:45:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 -- start start 2023-05-17T11:45:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a40ae150 0x7f39a4152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f39a40ce1a0 0x7f39a406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 0x7f39a40ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40b1bc0 con 0x7f39a40ab8e0 2023-05-17T11:45:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a406cfe0 con 0x7f39a40ae150 2023-05-17T11:45:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a406d220 con 0x7f39a40ce1a0 2023-05-17T11:45:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 0x7f39a40ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 0x7f39a40ac160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44044/0 (socket says 172.21.15.3:44044) 2023-05-17T11:45:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 -- 172.21.15.3:0/2398883299 learned_addr learned my addr 172.21.15.3:0/2398883299 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a2ffd640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f39a40ce1a0 0x7f39a406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a37fe640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a40ae150 0x7f39a4152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 -- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f39a40ce1a0 msgr2=0x7f39a406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f39a40ce1a0 0x7f39a406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 -- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a40ae150 msgr2=0x7f39a4152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a40ae150 0x7f39a4152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 -- 172.21.15.3:0/2398883299 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994009420 con 0x7f39a40ab8e0 2023-05-17T11:45:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a3fff640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 0x7f39a40ac160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c770 tx=0x7f399c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c003b80 con 0x7f39a40ab8e0 2023-05-17T11:45:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c003ce0 con 0x7f39a40ab8e0 2023-05-17T11:45:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00aa30 con 0x7f39a40ab8e0 2023-05-17T11:45:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a40cd510 con 0x7f39a40ab8e0 2023-05-17T11:45:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.315+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a40c4720 con 0x7f39a40ab8e0 2023-05-17T11:45:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.319+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a40cd6a0 con 0x7f39a40ab8e0 2023-05-17T11:45:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.319+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f399c00ab90 con 0x7f39a40ab8e0 2023-05-17T11:45:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.319+0000 7f398bfff640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f39900662b0 0x7f3990068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.319+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f399c083710 con 0x7f39a40ab8e0 2023-05-17T11:45:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.319+0000 7f39a37fe640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f39900662b0 0x7f3990068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.319+0000 7f39a37fe640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f39900662b0 0x7f3990068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39940af000 tx=0x7f39940a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.323+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f399c050ef0 con 0x7f39a40ab8e0 2023-05-17T11:45:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39a404de80 con 0x7f39a40ab8e0 2023-05-17T11:45:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f398bfff640 1 -- 172.21.15.3:0/2398883299 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f399c054510 con 0x7f39a40ab8e0 2023-05-17T11:45:32.485 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:45:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f39900662b0 msgr2=0x7f3990068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f39900662b0 0x7f3990068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39940af000 tx=0x7f39940a7000 comp rx=0 tx=0).stop 2023-05-17T11:45:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 msgr2=0x7f39a40ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 0x7f39a40ac160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c770 tx=0x7f399c00cc30 comp rx=0 tx=0).stop 2023-05-17T11:45:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 shutdown_connections 2023-05-17T11:45:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f39900662b0 0x7f3990068760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39a40ab8e0 0x7f39a40ac160 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f39a40ce1a0 0x7f39a406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 --2- 172.21.15.3:0/2398883299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a40ae150 0x7f39a4152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.475+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 >> 172.21.15.3:0/2398883299 conn(0x7f39a40b0650 msgr2=0x7f39a40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.479+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 shutdown_connections 2023-05-17T11:45:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.479+0000 7f39a9dcb640 1 -- 172.21.15.3:0/2398883299 wait complete. 2023-05-17T11:45:32.505 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T11:45:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 Processor -- start 2023-05-17T11:45:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 -- start start 2023-05-17T11:45:32.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5de015c180 0x7f5de00d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d0b20 0x7f5de00b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de00af450 con 0x7f5de00d33f0 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de00af730 con 0x7f5de015c180 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5de490a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00afa10 con 0x7f5de00d0b20 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5de015c180 0x7f5de00d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5de015c180 0x7f5de00d2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44056/0 (socket says 172.21.15.3:44056) 2023-05-17T11:45:32.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 -- 172.21.15.3:0/1351005799 learned_addr learned my addr 172.21.15.3:0/1351005799 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dded9d640 1 --2- 172.21.15.3:0/1351005799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d0b20 0x7f5de00b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 -- 172.21.15.3:0/1351005799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d0b20 msgr2=0x7f5de00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 --2- 172.21.15.3:0/1351005799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d0b20 0x7f5de00b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 -- 172.21.15.3:0/1351005799 >> v1:172.21.15.60:6789/0 conn(0x7f5de00d33f0 legacy=0x7f5de00d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.635+0000 7f5dde59c640 1 -- 172.21.15.3:0/1351005799 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00afcf0 con 0x7f5de015c180 2023-05-17T11:45:32.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5dde59c640 1 --2- 172.21.15.3:0/1351005799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00d2400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009870 tx=0x7f5dd001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3255a550605e073 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5ddd59a640 1 -- 172.21.15.3:0/1351005799 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00ab620 con 0x7f5de015c180 2023-05-17T11:45:32.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5ddd59a640 1 -- 172.21.15.3:0/1351005799 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd00ab780 con 0x7f5de015c180 2023-05-17T11:45:32.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5ddd59a640 1 -- 172.21.15.3:0/1351005799 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00abb10 con 0x7f5de015c180 2023-05-17T11:45:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 -- 172.21.15.3:0/1351005799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 msgr2=0x7f5de00d2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 --2- 172.21.15.3:0/1351005799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00d2400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009870 tx=0x7f5dd001c510 comp rx=0 tx=0).stop 2023-05-17T11:45:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 -- 172.21.15.3:0/1351005799 shutdown_connections 2023-05-17T11:45:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 --2- 172.21.15.3:0/1351005799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d0b20 0x7f5de00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 --2- 172.21.15.3:0/1351005799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00d2400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 -- 172.21.15.3:0/1351005799 >> 172.21.15.3:0/1351005799 conn(0x7f5de0071b00 msgr2=0x7f5de009bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:32.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 -- 172.21.15.3:0/1351005799 shutdown_connections 2023-05-17T11:45:32.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 -- 172.21.15.3:0/1351005799 wait complete. 2023-05-17T11:45:32.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 Processor -- start 2023-05-17T11:45:32.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.639+0000 7f5de490a640 1 -- start start 2023-05-17T11:45:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5de00d0b20 0x7f5de00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d33f0 0x7f5de014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00b6570 con 0x7f5de015c180 2023-05-17T11:45:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00b6840 con 0x7f5de00d0b20 2023-05-17T11:45:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00b6b20 con 0x7f5de00d33f0 2023-05-17T11:45:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44064/0 (socket says 172.21.15.3:44064) 2023-05-17T11:45:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 -- 172.21.15.3:0/3809501427 learned_addr learned my addr 172.21.15.3:0/3809501427 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dde59c640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5de00d0b20 0x7f5de00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dddd9b640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d33f0 0x7f5de014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 -- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d33f0 msgr2=0x7f5de014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d33f0 0x7f5de014dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 -- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5de00d0b20 msgr2=0x7f5de00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5de00d0b20 0x7f5de00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 -- 172.21.15.3:0/3809501427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00094d0 con 0x7f5de015c180 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dded9d640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00b6030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8007e30 tx=0x7f5dd800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8014620 con 0x7f5de015c180 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800ee90 con 0x7f5de015c180 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80149c0 con 0x7f5de015c180 2023-05-17T11:45:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de015c6e0 con 0x7f5de015c180 2023-05-17T11:45:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de015c550 con 0x7f5de015c180 2023-05-17T11:45:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.643+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de00b1240 con 0x7f5de015c180 2023-05-17T11:45:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.647+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5dd8014b20 con 0x7f5de015c180 2023-05-17T11:45:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.647+0000 7f5dceffd640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5dc0066280 0x7f5dc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.647+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5dd80842a0 con 0x7f5de015c180 2023-05-17T11:45:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.647+0000 7f5dde59c640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5dc0066280 0x7f5dc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.647+0000 7f5dde59c640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5dc0066280 0x7f5dc0068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00af000 tx=0x7f5dd00b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.651+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5dd8051a80 con 0x7f5de015c180 2023-05-17T11:45:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.803+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5de004de80 con 0x7f5de015c180 2023-05-17T11:45:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5dceffd640 1 -- 172.21.15.3:0/3809501427 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5dd80550a0 con 0x7f5de015c180 2023-05-17T11:45:32.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:32.815 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-05-17T11:45:32.815 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 2, 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": "rbd" 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:45:32.816 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-05-17T11:45:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5dc0066280 msgr2=0x7f5dc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5dc0066280 0x7f5dc0068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00af000 tx=0x7f5dd00b6040 comp rx=0 tx=0).stop 2023-05-17T11:45:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 msgr2=0x7f5de00b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00b6030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8007e30 tx=0x7f5dd800e4b0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 shutdown_connections 2023-05-17T11:45:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5dc0066280 0x7f5dc0068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5de015c180 0x7f5de00b6030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5de00d33f0 0x7f5de014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 --2- 172.21.15.3:0/3809501427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5de00d0b20 0x7f5de00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 >> 172.21.15.3:0/3809501427 conn(0x7f5de0071b00 msgr2=0x7f5de00c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 shutdown_connections 2023-05-17T11:45:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.807+0000 7f5de490a640 1 -- 172.21.15.3:0/3809501427 wait complete. 2023-05-17T11:45:32.835 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T11:45:32.836 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-17T11:45:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa3a0ed1640 1 Processor -- start 2023-05-17T11:45:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa3a0ed1640 1 -- start start 2023-05-17T11:45:32.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa3a0ed1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa39c15f940 0x7fa39c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa3a0ed1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c08c8e0 con 0x7fa39c0c94d0 2023-05-17T11:45:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa3a0ed1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c0cf120 con 0x7fa39c0cde90 2023-05-17T11:45:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa3a0ed1640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0cfca0 con 0x7fa39c15f940 2023-05-17T11:45:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa39a59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa39c15f940 0x7fa39c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa393fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa39c0c94d0 0x7fa39c0c6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50378/0 (socket says 172.21.15.3:50378) 2023-05-17T11:45:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa393fff640 1 -- 172.21.15.3:0/3798468400 learned_addr learned my addr 172.21.15.3:0/3798468400 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa39a59c640 1 -- 172.21.15.3:0/3798468400 >> v1:172.21.15.60:6789/0 conn(0x7fa39c0cde90 legacy=0x7fa39c0c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa39a59c640 1 -- 172.21.15.3:0/3798468400 >> v1:172.21.15.3:6789/0 conn(0x7fa39c0c94d0 legacy=0x7fa39c0c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa39a59c640 1 -- 172.21.15.3:0/3798468400 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0cf400 con 0x7fa39c15f940 2023-05-17T11:45:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.967+0000 7fa399d9b640 1 -- 172.21.15.3:0/3798468400 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312997436 0 0) 0x7fa39c08c8e0 con 0x7fa39c0c94d0 2023-05-17T11:45:32.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa39a59c640 1 --2- 172.21.15.3:0/3798468400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0097a0 tx=0x7fa38c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ded2af4838bf5b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa399d9b640 1 -- 172.21.15.3:0/3798468400 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0ab600 con 0x7fa39c15f940 2023-05-17T11:45:32.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa399d9b640 1 -- 172.21.15.3:0/3798468400 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c0a7050 con 0x7fa39c15f940 2023-05-17T11:45:32.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa399d9b640 1 -- 172.21.15.3:0/3798468400 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0ab980 con 0x7fa39c15f940 2023-05-17T11:45:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/3798468400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 msgr2=0x7fa39c0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/3798468400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0097a0 tx=0x7fa38c01c390 comp rx=0 tx=0).stop 2023-05-17T11:45:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/3798468400 shutdown_connections 2023-05-17T11:45:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/3798468400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/3798468400 >> 172.21.15.3:0/3798468400 conn(0x7fa39c09bae0 msgr2=0x7fa39c0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/3798468400 shutdown_connections 2023-05-17T11:45:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.971+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/3798468400 wait complete. 2023-05-17T11:45:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 Processor -- start 2023-05-17T11:45:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 -- start start 2023-05-17T11:45:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa39c0c94d0 0x7fa39c157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa39c0cde90 0x7fa39c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c15cce0 con 0x7fa39c15f940 2023-05-17T11:45:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b27e0 con 0x7fa39c0c94d0 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b2ac0 con 0x7fa39c0cde90 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44078/0 (socket says 172.21.15.3:44078) 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 -- 172.21.15.3:0/4064487985 learned_addr learned my addr 172.21.15.3:0/4064487985 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39a59c640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa39c0c94d0 0x7fa39c157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa393fff640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa39c0cde90 0x7fa39c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 -- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa39c0cde90 msgr2=0x7fa39c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa39c0cde90 0x7fa39c0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 -- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa39c0c94d0 msgr2=0x7fa39c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:32.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa39c0c94d0 0x7fa39c157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:32.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 -- 172.21.15.3:0/4064487985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0093b0 con 0x7fa39c15f940 2023-05-17T11:45:32.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa393fff640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa39c0cde90 0x7fa39c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:32.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa39ad9d640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c780 tx=0x7fa39400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394004b70 con 0x7fa39c15f940 2023-05-17T11:45:32.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400ce90 con 0x7fa39c15f940 2023-05-17T11:45:32.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400a850 con 0x7fa39c15f940 2023-05-17T11:45:32.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c15fd10 con 0x7fa39c15f940 2023-05-17T11:45:32.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.975+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c0c7990 con 0x7fa39c15f940 2023-05-17T11:45:32.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.979+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c0ced70 con 0x7fa39c15f940 2023-05-17T11:45:32.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.979+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa39400a9b0 con 0x7fa39c15f940 2023-05-17T11:45:32.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.979+0000 7fa392ffd640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa37c066280 0x7fa37c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:32.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.979+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa394083ab0 con 0x7fa39c15f940 2023-05-17T11:45:32.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.979+0000 7fa39a59c640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa37c066280 0x7fa37c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.979+0000 7fa39a59c640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa37c066280 0x7fa37c068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0ad000 tx=0x7fa38c0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:32.983+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa394054d00 con 0x7fa39c15f940 2023-05-17T11:45:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:33.139+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa39c04de80 con 0x7fa39c15f940 2023-05-17T11:45:34.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.107+0000 7fa392ffd640 1 -- 172.21.15.3:0/4064487985 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa394054890 con 0x7fa39c15f940 2023-05-17T11:45:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-05-17T11:45:34.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.115+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa37c066280 msgr2=0x7fa37c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:34.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.115+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa37c066280 0x7fa37c068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0ad000 tx=0x7fa38c0a6000 comp rx=0 tx=0).stop 2023-05-17T11:45:34.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.115+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 msgr2=0x7fa39c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:34.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.115+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c780 tx=0x7fa39400cc40 comp rx=0 tx=0).stop 2023-05-17T11:45:34.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 shutdown_connections 2023-05-17T11:45:34.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa37c066280 0x7fa37c068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa39c15f940 0x7fa39c0d0fc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa39c0cde90 0x7fa39c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 --2- 172.21.15.3:0/4064487985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa39c0c94d0 0x7fa39c157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 >> 172.21.15.3:0/4064487985 conn(0x7fa39c09bae0 msgr2=0x7fa39c15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:34.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 shutdown_connections 2023-05-17T11:45:34.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.119+0000 7fa3a0ed1640 1 -- 172.21.15.3:0/4064487985 wait complete. 2023-05-17T11:45:34.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T11:45:34.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 Processor -- start 2023-05-17T11:45:34.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 -- start start 2023-05-17T11:45:34.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fda10070310 0x7fda100cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:34.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:34.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda10070780 con 0x7fda1015c0b0 2023-05-17T11:45:34.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1015d540 con 0x7fda10070310 2023-05-17T11:45:34.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda15339640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1015fd30 con 0x7fda100cb0b0 2023-05-17T11:45:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda07fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fda10070310 0x7fda100cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda07fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fda10070310 0x7fda100cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44084/0 (socket says 172.21.15.3:44084) 2023-05-17T11:45:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda07fff640 1 -- 172.21.15.3:0/4037293146 learned_addr learned my addr 172.21.15.3:0/4037293146 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:34.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.291+0000 7fda0f7fe640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:34.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda07fff640 1 -- 172.21.15.3:0/4037293146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 msgr2=0x7fda101601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:34.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda07fff640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda07fff640 1 -- 172.21.15.3:0/4037293146 >> v1:172.21.15.60:6789/0 conn(0x7fda1015c0b0 legacy=0x7fda1015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:34.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda07fff640 1 -- 172.21.15.3:0/4037293146 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1015cca0 con 0x7fda10070310 2023-05-17T11:45:34.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda0f7fe640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda07fff640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda100cab70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009870 tx=0x7fd9f801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b09e6d3e1fb92ab server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda0e7fc640 1 -- 172.21.15.3:0/4037293146 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80ab620 con 0x7fda10070310 2023-05-17T11:45:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda0e7fc640 1 -- 172.21.15.3:0/4037293146 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80ab780 con 0x7fda10070310 2023-05-17T11:45:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda0e7fc640 1 -- 172.21.15.3:0/4037293146 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80abb10 con 0x7fda10070310 2023-05-17T11:45:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 -- 172.21.15.3:0/4037293146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 msgr2=0x7fda100cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda100cab70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009870 tx=0x7fd9f801c510 comp rx=0 tx=0).stop 2023-05-17T11:45:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 -- 172.21.15.3:0/4037293146 shutdown_connections 2023-05-17T11:45:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 --2- 172.21.15.3:0/4037293146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda100cab70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 -- 172.21.15.3:0/4037293146 >> 172.21.15.3:0/4037293146 conn(0x7fda100d05b0 msgr2=0x7fda100d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.295+0000 7fda15339640 1 -- 172.21.15.3:0/4037293146 shutdown_connections 2023-05-17T11:45:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 -- 172.21.15.3:0/4037293146 wait complete. 2023-05-17T11:45:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 Processor -- start 2023-05-17T11:45:34.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 -- start start 2023-05-17T11:45:34.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda1014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda1015c0b0 0x7fda1006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100b5290 con 0x7fda10070310 2023-05-17T11:45:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100b4e00 con 0x7fda1015c0b0 2023-05-17T11:45:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda15339640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1014ec30 con 0x7fda100cb0b0 2023-05-17T11:45:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda1014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda1014e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44090/0 (socket says 172.21.15.3:44090) 2023-05-17T11:45:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 -- 172.21.15.3:0/144892408 learned_addr learned my addr 172.21.15.3:0/144892408 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda07fff640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0f7fe640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda1015c0b0 0x7fda1006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:34.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 -- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 msgr2=0x7fda101534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:34.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 -- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda1015c0b0 msgr2=0x7fda1006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda1015c0b0 0x7fda1006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 -- 172.21.15.3:0/144892408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80094d0 con 0x7fda10070310 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.299+0000 7fda0effd640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda1014e6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c7f0 tx=0x7fda0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00003b80 con 0x7fda10070310 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00003ce0 con 0x7fda10070310 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000aa90 con 0x7fda10070310 2023-05-17T11:45:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda10169030 con 0x7fda10070310 2023-05-17T11:45:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda10168ea0 con 0x7fda10070310 2023-05-17T11:45:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda101691c0 con 0x7fda10070310 2023-05-17T11:45:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda0000abf0 con 0x7fda10070310 2023-05-17T11:45:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda077fe640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd9f00662b0 0x7fd9f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:34.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fda00084230 con 0x7fda10070310 2023-05-17T11:45:34.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.303+0000 7fda07fff640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd9f00662b0 0x7fd9f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:34.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.307+0000 7fda07fff640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd9f00662b0 0x7fd9f0068760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80af000 tx=0x7fd9f80b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.307+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fda00051920 con 0x7fda10070310 2023-05-17T11:45:34.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:34.463+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fda10070780 con 0x7fda10070310 2023-05-17T11:45:34.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:45:34.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:45:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.111+0000 7fda077fe640 1 -- 172.21.15.3:0/144892408 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fda10070780 con 0x7fda10070310 2023-05-17T11:45:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-05-17T11:45:35.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd9f00662b0 msgr2=0x7fd9f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd9f00662b0 0x7fd9f0068760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80af000 tx=0x7fd9f80b6040 comp rx=0 tx=0).stop 2023-05-17T11:45:35.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 msgr2=0x7fda1014e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda1014e6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c7f0 tx=0x7fda0000ccb0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 shutdown_connections 2023-05-17T11:45:35.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd9f00662b0 0x7fd9f0068760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda1015c0b0 0x7fda1006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fda100cb0b0 0x7fda101534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 --2- 172.21.15.3:0/144892408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda10070310 0x7fda1014e6f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.119+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 >> 172.21.15.3:0/144892408 conn(0x7fda100d05b0 msgr2=0x7fda100cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:35.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.123+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 shutdown_connections 2023-05-17T11:45:35.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.123+0000 7fda15339640 1 -- 172.21.15.3:0/144892408 wait complete. 2023-05-17T11:45:35.166 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T11:45:35.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f55b98640 1 Processor -- start 2023-05-17T11:45:35.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f55b98640 1 -- start start 2023-05-17T11:45:35.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f55b98640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500ad440 0x7f8f500afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f55b98640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5009bcb0 con 0x7f8f5015d3d0 2023-05-17T11:45:35.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f55b98640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f500ca130 con 0x7f8f500cb4c0 2023-05-17T11:45:35.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f55b98640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f500cdf90 con 0x7f8f500ad440 2023-05-17T11:45:35.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8f5015d3d0 0x7f8f500ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50382/0 (socket says 172.21.15.3:50382) 2023-05-17T11:45:35.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/1722323743 learned_addr learned my addr 172.21.15.3:0/1722323743 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:35.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94202947 0 0) 0x7f8f5009bcb0 con 0x7f8f5015d3d0 2023-05-17T11:45:35.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f38003530 con 0x7f8f5015d3d0 2023-05-17T11:45:35.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4effd640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500ad440 0x7f8f500afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263387794 0 0) 0x7f8f38003530 con 0x7f8f5015d3d0 2023-05-17T11:45:35.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500ad440 msgr2=0x7f8f500afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:35.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500ad440 0x7f8f500afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 >> v1:172.21.15.60:6789/0 conn(0x7f8f500cb4c0 legacy=0x7f8f5006fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f500cd490 con 0x7f8f5015d3d0 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f8f40001680 con 0x7f8f5015d3d0 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 >> v1:172.21.15.3:6789/0 conn(0x7f8f5015d3d0 legacy=0x7f8f500ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f380047d0 0x7f8f38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f380052a0 0x7f8f3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3800c130 con 0x7f8f380039b0 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3800c2a0 con 0x7f8f380052a0 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3800c460 con 0x7f8f380047d0 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4effd640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500ad440 0x7f8f500afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4ffff640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f380052a0 0x7f8f3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4effd640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f380047d0 0x7f8f38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f380047d0 msgr2=0x7f8f38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f380047d0 0x7f8f38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f380052a0 msgr2=0x7f8f3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f380052a0 0x7f8f3800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/1722323743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38003530 con 0x7f8f380039b0 2023-05-17T11:45:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.299+0000 7f8f4ffff640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f380052a0 0x7f8f3800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:35.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f38003dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c210 tx=0x7f8f4001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c6c4b3401dc5fd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:35.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40005ae0 con 0x7f8f380039b0 2023-05-17T11:45:35.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40005c40 con 0x7f8f380039b0 2023-05-17T11:45:35.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f4e7fc640 1 -- 172.21.15.3:0/1722323743 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f400a57f0 con 0x7f8f380039b0 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f55b98640 1 -- 172.21.15.3:0/1722323743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 msgr2=0x7f8f38003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f55b98640 1 --2- 172.21.15.3:0/1722323743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f38003dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c210 tx=0x7f8f4001cc20 comp rx=0 tx=0).stop 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f4ffff640 1 -- 172.21.15.3:0/1722323743 reap_dead start 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f55b98640 1 -- 172.21.15.3:0/1722323743 shutdown_connections 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f55b98640 1 -- 172.21.15.3:0/1722323743 >> 172.21.15.3:0/1722323743 conn(0x7f8f5006a740 msgr2=0x7f8f500cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f55b98640 1 -- 172.21.15.3:0/1722323743 shutdown_connections 2023-05-17T11:45:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.303+0000 7f8f55b98640 1 -- 172.21.15.3:0/1722323743 wait complete. 2023-05-17T11:45:35.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 Processor -- start 2023-05-17T11:45:35.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 -- start start 2023-05-17T11:45:35.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f500c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f50159b20 0x7f8f500aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500c9c00 0x7f8f5015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50163470 con 0x7f8f380039b0 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f500aea90 con 0x7f8f50159b20 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f500c5940 con 0x7f8f500c9c00 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f500c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f500c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44094/0 (socket says 172.21.15.3:44094) 2023-05-17T11:45:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/2571863746 learned_addr learned my addr 172.21.15.3:0/2571863746 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4ffff640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500c9c00 0x7f8f5015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500c9c00 msgr2=0x7f8f5015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500c9c00 0x7f8f5015b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f50159b20 msgr2=0x7f8f500aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4effd640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f50159b20 0x7f8f500aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f50159b20 0x7f8f500aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 -- 172.21.15.3:0/2571863746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5015d7a0 con 0x7f8f380039b0 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4effd640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f50159b20 0x7f8f500aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f4f7fe640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f500c5400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f40001940 tx=0x7f8f38005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b4070 con 0x7f8f380039b0 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40001440 con 0x7f8f380039b0 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f500ca6b0 con 0x7f8f380039b0 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f400a57f0 con 0x7f8f380039b0 2023-05-17T11:45:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.307+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50165b30 con 0x7f8f380039b0 2023-05-17T11:45:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.311+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5004de80 con 0x7f8f380039b0 2023-05-17T11:45:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.311+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f400a5950 con 0x7f8f380039b0 2023-05-17T11:45:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.311+0000 7f8f37fff640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8f3c0662b0 0x7f8f3c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.311+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8f4011d820 con 0x7f8f380039b0 2023-05-17T11:45:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.311+0000 7f8f4effd640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8f3c0662b0 0x7f8f3c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.311+0000 7f8f4effd640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8f3c0662b0 0x7f8f3c068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f5015c920 tx=0x7f8f44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.315+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8f400eac70 con 0x7f8f380039b0 2023-05-17T11:45:35.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.503+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f5006c640 con 0x7f8f380039b0 2023-05-17T11:45:35.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.511+0000 7f8f37fff640 1 -- 172.21.15.3:0/2571863746 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f400ee290 con 0x7f8f380039b0 2023-05-17T11:45:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 3 and data pool 4 2023-05-17T11:45:35.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.519+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8f3c0662b0 msgr2=0x7f8f3c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.519+0000 7f8f55b98640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8f3c0662b0 0x7f8f3c068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f5015c920 tx=0x7f8f44008040 comp rx=0 tx=0).stop 2023-05-17T11:45:35.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.519+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 msgr2=0x7f8f500c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.519+0000 7f8f55b98640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f500c5400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f40001940 tx=0x7f8f38005800 comp rx=0 tx=0).stop 2023-05-17T11:45:35.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 shutdown_connections 2023-05-17T11:45:35.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8f3c0662b0 0x7f8f3c068760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8f500c9c00 0x7f8f5015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f50159b20 0x7f8f500aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 --2- 172.21.15.3:0/2571863746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f380039b0 0x7f8f500c5400 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 >> 172.21.15.3:0/2571863746 conn(0x7f8f5006a740 msgr2=0x7f8f5006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:35.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 shutdown_connections 2023-05-17T11:45:35.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.523+0000 7f8f55b98640 1 -- 172.21.15.3:0/2571863746 wait complete. 2023-05-17T11:45:35.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:35.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 Processor -- start 2023-05-17T11:45:35.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 -- start start 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200b5af0 0x7f82200ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f82200ce6d0 0x7f822015df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82200b5ec0 con 0x7f82200cac10 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822015db00 con 0x7f82200ce6d0 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.695+0000 7f8225a74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200ce020 con 0x7f82200b5af0 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f8217fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f82200ce6d0 0x7f822015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f821ffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f82200cac10 0x7f82200cc360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50396/0 (socket says 172.21.15.3:50396) 2023-05-17T11:45:35.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f821ffff640 1 -- 172.21.15.3:0/1155249809 learned_addr learned my addr 172.21.15.3:0/1155249809 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:35.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f821f7fe640 1 --2- 172.21.15.3:0/1155249809 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200b5af0 0x7f82200ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f8217fff640 1 -- 172.21.15.3:0/1155249809 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200b5af0 msgr2=0x7f82200ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:35.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f8217fff640 1 --2- 172.21.15.3:0/1155249809 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200b5af0 0x7f82200ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f8217fff640 1 -- 172.21.15.3:0/1155249809 >> v1:172.21.15.3:6789/0 conn(0x7f82200cac10 legacy=0x7f82200cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f8217fff640 1 -- 172.21.15.3:0/1155249809 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200d0370 con 0x7f82200ce6d0 2023-05-17T11:45:35.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f8217fff640 1 --2- 172.21.15.3:0/1155249809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f822015df00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82200d0560 tx=0x7f820801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c63f5a75bbaeac server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:35.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f821effd640 1 -- 172.21.15.3:0/1155249809 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080ab600 con 0x7f82200ce6d0 2023-05-17T11:45:35.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f821effd640 1 -- 172.21.15.3:0/1155249809 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080a7050 con 0x7f82200ce6d0 2023-05-17T11:45:35.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.699+0000 7f821effd640 1 -- 172.21.15.3:0/1155249809 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080ab980 con 0x7f82200ce6d0 2023-05-17T11:45:35.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- 172.21.15.3:0/1155249809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 msgr2=0x7f822015df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 --2- 172.21.15.3:0/1155249809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f822015df00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82200d0560 tx=0x7f820801c360 comp rx=0 tx=0).stop 2023-05-17T11:45:35.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- 172.21.15.3:0/1155249809 shutdown_connections 2023-05-17T11:45:35.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 --2- 172.21.15.3:0/1155249809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f822015df00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 --2- 172.21.15.3:0/1155249809 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200b5af0 0x7f82200ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- 172.21.15.3:0/1155249809 >> 172.21.15.3:0/1155249809 conn(0x7f822006eac0 msgr2=0x7f82200cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:35.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- 172.21.15.3:0/1155249809 shutdown_connections 2023-05-17T11:45:35.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- 172.21.15.3:0/1155249809 wait complete. 2023-05-17T11:45:35.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 Processor -- start 2023-05-17T11:45:35.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- start start 2023-05-17T11:45:35.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82200b5af0 0x7f82200b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200cac10 0x7f8220163a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f82200b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822015a1a0 con 0x7f82200ce6d0 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822006b3b0 con 0x7f82200b5af0 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8225a74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8220159ec0 con 0x7f82200cac10 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f82200b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f82200b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44118/0 (socket says 172.21.15.3:44118) 2023-05-17T11:45:35.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 -- 172.21.15.3:0/3872181073 learned_addr learned my addr 172.21.15.3:0/3872181073 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821f7fe640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82200b5af0 0x7f82200b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8217fff640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200cac10 0x7f8220163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 -- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200cac10 msgr2=0x7f8220163a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200cac10 0x7f8220163a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 -- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82200b5af0 msgr2=0x7f82200b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82200b5af0 0x7f82200b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f821ffff640 1 -- 172.21.15.3:0/3872181073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009420 con 0x7f82200ce6d0 2023-05-17T11:45:35.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.703+0000 7f8217fff640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200cac10 0x7f8220163a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:35.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821ffff640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f82200b42f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f821800cbc0 tx=0x7f821800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:35.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800ad40 con 0x7f82200ce6d0 2023-05-17T11:45:35.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218012400 con 0x7f82200ce6d0 2023-05-17T11:45:35.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800aea0 con 0x7f82200ce6d0 2023-05-17T11:45:35.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82200cf780 con 0x7f82200ce6d0 2023-05-17T11:45:35.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82200d0090 con 0x7f82200ce6d0 2023-05-17T11:45:35.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822015e440 con 0x7f82200ce6d0 2023-05-17T11:45:35.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8218007070 con 0x7f82200ce6d0 2023-05-17T11:45:35.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821cff9640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8200066280 0x7f8200068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:35.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8218083bd0 con 0x7f82200ce6d0 2023-05-17T11:45:35.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.707+0000 7f821f7fe640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8200066280 0x7f8200068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:35.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.711+0000 7f821f7fe640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8200066280 0x7f8200068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8210007a60 tx=0x7f8210008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:35.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.711+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f82180510f0 con 0x7f82200ce6d0 2023-05-17T11:45:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.867+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f822006abc0 con 0x7f82200ce6d0 2023-05-17T11:45:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f821cff9640 1 -- 172.21.15.3:0/3872181073 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18184 (secure 0 0 0) 0x7f822006abc0 con 0x7f82200ce6d0 2023-05-17T11:45:35.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:35.880 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":22,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:35.507742+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:35.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8200066280 msgr2=0x7f8200068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8200066280 0x7f8200068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8210007a60 tx=0x7f8210008040 comp rx=0 tx=0).stop 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 msgr2=0x7f82200b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f82200b42f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f821800cbc0 tx=0x7f821800a430 comp rx=0 tx=0).stop 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 shutdown_connections 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8200066280 0x7f8200068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82200ce6d0 0x7f82200b42f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f82200cac10 0x7f8220163a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 --2- 172.21.15.3:0/3872181073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82200b5af0 0x7f82200b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:35.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 >> 172.21.15.3:0/3872181073 conn(0x7f822006eac0 msgr2=0x7f8220156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:35.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 shutdown_connections 2023-05-17T11:45:35.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:35.871+0000 7f8225a74640 1 -- 172.21.15.3:0/3872181073 wait complete. 2023-05-17T11:45:35.900 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:36.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 Processor -- start 2023-05-17T11:45:36.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 -- start start 2023-05-17T11:45:36.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8cf015a2e0 0x7f8cf0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cf00c9fd0 0x7f8cf00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00ca490 con 0x7f8cf00716d0 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00cacf0 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cf5874640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf0071fe0 con 0x7f8cf015a2e0 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.027+0000 7f8cef7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cf00c9fd0 0x7f8cf00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cf00c9fd0 0x7f8cf00b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44134/0 (socket says 172.21.15.3:44134) 2023-05-17T11:45:36.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 -- 172.21.15.3:0/1842090242 learned_addr learned my addr 172.21.15.3:0/1842090242 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:36.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8ce7fff640 1 --2- 172.21.15.3:0/1842090242 >> v2:172.21.15.60:3300/0 conn(0x7f8cf015a2e0 0x7f8cf0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 -- 172.21.15.3:0/1842090242 >> v2:172.21.15.60:3300/0 conn(0x7f8cf015a2e0 msgr2=0x7f8cf0071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:36.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 --2- 172.21.15.3:0/1842090242 >> v2:172.21.15.60:3300/0 conn(0x7f8cf015a2e0 0x7f8cf0071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 -- 172.21.15.3:0/1842090242 >> v1:172.21.15.60:6789/0 conn(0x7f8cf00716d0 legacy=0x7f8cf006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:36.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 -- 172.21.15.3:0/1842090242 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00ca730 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8ce7fff640 1 --2- 172.21.15.3:0/1842090242 >> v2:172.21.15.60:3300/0 conn(0x7f8cf015a2e0 0x7f8cf0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:36.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cef7fe640 1 --2- 172.21.15.3:0/1842090242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf00b1200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cf006fa70 tx=0x7f8ce801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3709a98ddac7503 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:36.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cee7fc640 1 -- 172.21.15.3:0/1842090242 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80a5820 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cee7fc640 1 -- 172.21.15.3:0/1842090242 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce80a5980 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cee7fc640 1 -- 172.21.15.3:0/1842090242 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80a5d10 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cf5874640 1 -- 172.21.15.3:0/1842090242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 msgr2=0x7f8cf00b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.031+0000 7f8cf5874640 1 --2- 172.21.15.3:0/1842090242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf00b1200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cf006fa70 tx=0x7f8ce801c960 comp rx=0 tx=0).stop 2023-05-17T11:45:36.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- 172.21.15.3:0/1842090242 shutdown_connections 2023-05-17T11:45:36.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 --2- 172.21.15.3:0/1842090242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf00b1200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 --2- 172.21.15.3:0/1842090242 >> v2:172.21.15.60:3300/0 conn(0x7f8cf015a2e0 0x7f8cf0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- 172.21.15.3:0/1842090242 >> 172.21.15.3:0/1842090242 conn(0x7f8cf00b0b30 msgr2=0x7f8cf00cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:36.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- 172.21.15.3:0/1842090242 shutdown_connections 2023-05-17T11:45:36.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- 172.21.15.3:0/1842090242 wait complete. 2023-05-17T11:45:36.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 Processor -- start 2023-05-17T11:45:36.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- start start 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8cf00716d0 0x7f8cf00cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf006be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf015a2e0 0x7f8cf00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00acac0 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00cc740 con 0x7f8cf015a2e0 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cf5874640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00abeb0 con 0x7f8cf00716d0 2023-05-17T11:45:36.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf006be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf006be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44136/0 (socket says 172.21.15.3:44136) 2023-05-17T11:45:36.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 -- 172.21.15.3:0/4286092920 learned_addr learned my addr 172.21.15.3:0/4286092920 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:36.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ceeffd640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8cf00716d0 0x7f8cf00cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8cef7fe640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf015a2e0 0x7f8cf00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 -- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8cf00716d0 msgr2=0x7f8cf00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8cf00716d0 0x7f8cf00cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 -- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf015a2e0 msgr2=0x7f8cf00cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf015a2e0 0x7f8cf00cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 -- 172.21.15.3:0/4286092920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8009b30 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.035+0000 7f8ce7fff640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf006be90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800c7f0 tx=0x7f8cd800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8004220 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8004380 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8003840 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf0166c20 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf00c8e80 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf0166db0 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8cd8003bb0 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cecff9640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8cd0066300 0x7f8cd00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cd8083cc0 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.039+0000 7f8ceeffd640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8cd0066300 0x7f8cd00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.043+0000 7f8ceeffd640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8cd0066300 0x7f8cd00687b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0007fd0 tx=0x7f8ce0007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:36.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.043+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8cd808a080 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf004de80 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cecff9640 1 -- 172.21.15.3:0/4286092920 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18184 (secure 0 0 0) 0x7f8cd801e020 con 0x7f8cf00c9fd0 2023-05-17T11:45:36.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":22,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:35.507742+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:36.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8cd0066300 msgr2=0x7f8cd00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8cd0066300 0x7f8cd00687b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0007fd0 tx=0x7f8ce0007e40 comp rx=0 tx=0).stop 2023-05-17T11:45:36.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 msgr2=0x7f8cf006be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf006be90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800c7f0 tx=0x7f8cd800ccb0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 shutdown_connections 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8cd0066300 0x7f8cd00687b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf015a2e0 0x7f8cf00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf00c9fd0 0x7f8cf006be90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 --2- 172.21.15.3:0/4286092920 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8cf00716d0 0x7f8cf00cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 >> 172.21.15.3:0/4286092920 conn(0x7f8cf00b0b30 msgr2=0x7f8cf01594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 shutdown_connections 2023-05-17T11:45:36.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.203+0000 7f8cf5874640 1 -- 172.21.15.3:0/4286092920 wait complete. 2023-05-17T11:45:36.233 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T11:45:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 Processor -- start 2023-05-17T11:45:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 -- start start 2023-05-17T11:45:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50a80b2950 0x7f50a809bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80ad760 0x7f50a80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f50a80cddf0 0x7f50a80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a806d020 con 0x7f50a80cddf0 2023-05-17T11:45:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80b2d20 con 0x7f50a80b2950 2023-05-17T11:45:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ae2c4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81591b0 con 0x7f50a80ad760 2023-05-17T11:45:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.363+0000 7f50ac861640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f50a80cddf0 0x7f50a80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a77fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80ad760 0x7f50a80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50a80b2950 0x7f50a809bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50a80b2950 0x7f50a809bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56172/0 (socket says 172.21.15.3:56172) 2023-05-17T11:45:36.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a7fff640 1 -- 172.21.15.3:0/3665380253 learned_addr learned my addr 172.21.15.3:0/3665380253 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:36.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a77fe640 1 --2- 172.21.15.3:0/3665380253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80ad760 0x7f50a80cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53606/0 (socket says 172.21.15.3:53606) 2023-05-17T11:45:36.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50ac861640 1 -- 172.21.15.3:0/3665380253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80ad760 msgr2=0x7f50a80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:36.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50ac861640 1 --2- 172.21.15.3:0/3665380253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80ad760 0x7f50a80cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50ac861640 1 -- 172.21.15.3:0/3665380253 >> v2:172.21.15.60:3300/0 conn(0x7f50a80b2950 msgr2=0x7f50a809bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:36.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50ac861640 1 --2- 172.21.15.3:0/3665380253 >> v2:172.21.15.60:3300/0 conn(0x7f50a80b2950 0x7f50a809bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50ac861640 1 -- 172.21.15.3:0/3665380253 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80adb90 con 0x7f50a80cddf0 2023-05-17T11:45:36.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50ac861640 1 --2- 172.21.15.3:0/3665380253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80cddf0 0x7f50a80c8980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50a806f530 tx=0x7f50a001c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf25eedcaa34f425 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:36.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a6ffd640 1 -- 172.21.15.3:0/3665380253 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a00a66b0 con 0x7f50a80cddf0 2023-05-17T11:45:36.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a6ffd640 1 -- 172.21.15.3:0/3665380253 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a00a6810 con 0x7f50a80cddf0 2023-05-17T11:45:36.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.367+0000 7f50a6ffd640 1 -- 172.21.15.3:0/3665380253 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a00a6ba0 con 0x7f50a80cddf0 2023-05-17T11:45:36.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- 172.21.15.3:0/3665380253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80cddf0 msgr2=0x7f50a80c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/3665380253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80cddf0 0x7f50a80c8980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50a806f530 tx=0x7f50a001c620 comp rx=0 tx=0).stop 2023-05-17T11:45:36.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- 172.21.15.3:0/3665380253 shutdown_connections 2023-05-17T11:45:36.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/3665380253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80cddf0 0x7f50a80c8980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/3665380253 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80ad760 0x7f50a80cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/3665380253 >> v2:172.21.15.60:3300/0 conn(0x7f50a80b2950 0x7f50a809bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- 172.21.15.3:0/3665380253 >> 172.21.15.3:0/3665380253 conn(0x7f50a806a740 msgr2=0x7f50a80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:36.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- 172.21.15.3:0/3665380253 shutdown_connections 2023-05-17T11:45:36.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- 172.21.15.3:0/3665380253 wait complete. 2023-05-17T11:45:36.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 Processor -- start 2023-05-17T11:45:36.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- start start 2023-05-17T11:45:36.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 0x7f50a815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80b2950 0x7f50a81510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50a80cddf0 0x7f50a80af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8151620 con 0x7f50a80ad760 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81595f0 con 0x7f50a80cddf0 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ae2c4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80c24e0 con 0x7f50a80b2950 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 0x7f50a815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 0x7f50a815c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51390/0 (socket says 172.21.15.3:51390) 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 -- 172.21.15.3:0/4178342305 learned_addr learned my addr 172.21.15.3:0/4178342305 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50ac861640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50a80cddf0 0x7f50a80af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a77fe640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80b2950 0x7f50a81510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 -- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80b2950 msgr2=0x7f50a81510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80b2950 0x7f50a81510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 -- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50a80cddf0 msgr2=0x7f50a80af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:36.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50a80cddf0 0x7f50a80af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:36.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 -- 172.21.15.3:0/4178342305 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0009a70 con 0x7f50a80ad760 2023-05-17T11:45:36.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.371+0000 7f50a7fff640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 0x7f50a815c050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f509800e890 tx=0x7f509800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:36.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098009620 con 0x7f50a80ad760 2023-05-17T11:45:36.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509800c940 con 0x7f50a80ad760 2023-05-17T11:45:36.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a806d490 con 0x7f50a80ad760 2023-05-17T11:45:36.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800ccf0 con 0x7f50a80ad760 2023-05-17T11:45:36.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a80cc380 con 0x7f50a80ad760 2023-05-17T11:45:36.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a80cb8d0 con 0x7f50a80ad760 2023-05-17T11:45:36.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5098013470 con 0x7f50a80ad760 2023-05-17T11:45:36.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a4ff9640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5094066280 0x7f5094068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:36.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5098083f50 con 0x7f50a80ad760 2023-05-17T11:45:36.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.375+0000 7f50a77fe640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5094066280 0x7f5094068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:36.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.379+0000 7f50a77fe640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5094066280 0x7f5094068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50a81521d0 tx=0x7f509c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:36.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.379+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5098051330 con 0x7f50a80ad760 2023-05-17T11:45:36.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:36.571+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f50a80b0030 con 0x7f50a80ad760 2023-05-17T11:45:37.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.519+0000 7f50a4ff9640 1 -- 172.21.15.3:0/4178342305 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f50980170b0 con 0x7f50a80ad760 2023-05-17T11:45:37.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5094066280 msgr2=0x7f5094068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:37.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5094066280 0x7f5094068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50a81521d0 tx=0x7f509c008040 comp rx=0 tx=0).stop 2023-05-17T11:45:37.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 msgr2=0x7f50a815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 0x7f50a815c050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f509800e890 tx=0x7f509800ed50 comp rx=0 tx=0).stop 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 shutdown_connections 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5094066280 0x7f5094068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50a80cddf0 0x7f50a80af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50a80b2950 0x7f50a81510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 --2- 172.21.15.3:0/4178342305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a80ad760 0x7f50a815c050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 >> 172.21.15.3:0/4178342305 conn(0x7f50a806a740 msgr2=0x7f50a80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:37.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 shutdown_connections 2023-05-17T11:45:37.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.523+0000 7f50ae2c4640 1 -- 172.21.15.3:0/4178342305 wait complete. 2023-05-17T11:45:37.554 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-17T11:45:37.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T11:45:37.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 Processor -- start 2023-05-17T11:45:37.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 -- start start 2023-05-17T11:45:37.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff004070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:37.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff00415c480 0x7ff0040cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:37.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00415fd30 con 0x7ff0040cb0b0 2023-05-17T11:45:37.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00415d540 con 0x7ff00415c480 2023-05-17T11:45:37.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.691+0000 7ff00898f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00415cca0 con 0x7ff00415c0b0 2023-05-17T11:45:37.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7feffbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff00415c480 0x7ff0040cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:37.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff002d9d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff0040cb0b0 0x7ff0041601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46740/0 (socket says 172.21.15.3:46740) 2023-05-17T11:45:37.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff002d9d640 1 -- 172.21.15.3:0/1508641976 learned_addr learned my addr 172.21.15.3:0/1508641976 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:37.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff00259c640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff004070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:37.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7feffbfff640 1 -- 172.21.15.3:0/1508641976 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 msgr2=0x7ff004070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:37.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7feffbfff640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff004070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7feffbfff640 1 -- 172.21.15.3:0/1508641976 >> v1:172.21.15.3:6789/0 conn(0x7ff0040cb0b0 legacy=0x7ff0041601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:37.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7feffbfff640 1 -- 172.21.15.3:0/1508641976 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00415cf80 con 0x7ff00415c480 2023-05-17T11:45:37.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff001d9b640 1 -- 172.21.15.3:0/1508641976 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538157220 0 0) 0x7ff00415fd30 con 0x7ff0040cb0b0 2023-05-17T11:45:37.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff00259c640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff004070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:37.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7feffbfff640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cab70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefec0097c0 tx=0x7fefec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47de5bc78f3eee7c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:37.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff001d9b640 1 -- 172.21.15.3:0/1508641976 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0ad660 con 0x7ff00415c480 2023-05-17T11:45:37.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff001d9b640 1 -- 172.21.15.3:0/1508641976 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec0ad7c0 con 0x7ff00415c480 2023-05-17T11:45:37.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.695+0000 7ff001d9b640 1 -- 172.21.15.3:0/1508641976 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0adb50 con 0x7ff00415c480 2023-05-17T11:45:37.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- 172.21.15.3:0/1508641976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 msgr2=0x7ff0040cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:37.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cab70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefec0097c0 tx=0x7fefec01c450 comp rx=0 tx=0).stop 2023-05-17T11:45:37.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- 172.21.15.3:0/1508641976 shutdown_connections 2023-05-17T11:45:37.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cab70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 --2- 172.21.15.3:0/1508641976 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff004070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- 172.21.15.3:0/1508641976 >> 172.21.15.3:0/1508641976 conn(0x7ff0040d05b0 msgr2=0x7ff0040d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:37.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- 172.21.15.3:0/1508641976 shutdown_connections 2023-05-17T11:45:37.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- 172.21.15.3:0/1508641976 wait complete. 2023-05-17T11:45:37.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 Processor -- start 2023-05-17T11:45:37.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- start start 2023-05-17T11:45:37.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0040cb0b0 0x7ff0040b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:37.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff0040ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:37.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:37.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff004148270 con 0x7ff00415c480 2023-05-17T11:45:37.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041f7fd0 con 0x7ff0040cb0b0 2023-05-17T11:45:37.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00898f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041f82b0 con 0x7ff00415c0b0 2023-05-17T11:45:37.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:37.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51408/0 (socket says 172.21.15.3:51408) 2023-05-17T11:45:37.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 -- 172.21.15.3:0/183858148 learned_addr learned my addr 172.21.15.3:0/183858148 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:37.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00259c640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0040cb0b0 0x7ff0040b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:37.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7feffbfff640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff0040ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:37.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 -- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 msgr2=0x7ff0040ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff0040ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 -- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0040cb0b0 msgr2=0x7ff0040b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0040cb0b0 0x7ff0040b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff002d9d640 1 -- 172.21.15.3:0/183858148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec009420 con 0x7ff00415c480 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7feffbfff640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff0040ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.699+0000 7ff00259c640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0040cb0b0 0x7ff0040b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7ff002d9d640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cd4e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feffc001570 tx=0x7feffc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:37.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc00a640 con 0x7ff00415c480 2023-05-17T11:45:37.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc00a7c0 con 0x7ff00415c480 2023-05-17T11:45:37.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc00ab70 con 0x7ff00415c480 2023-05-17T11:45:37.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff004160a60 con 0x7ff00415c480 2023-05-17T11:45:37.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0041608d0 con 0x7ff00415c480 2023-05-17T11:45:37.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff004168ea0 con 0x7ff00415c480 2023-05-17T11:45:37.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feffc00acd0 con 0x7ff00415c480 2023-05-17T11:45:37.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7feffaffd640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefe40662b0 0x7fefe4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:37.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feffc0832f0 con 0x7ff00415c480 2023-05-17T11:45:37.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.703+0000 7ff00259c640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefe40662b0 0x7fefe4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:37.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.707+0000 7ff00259c640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefe40662b0 0x7fefe4068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feff4009970 tx=0x7feff4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:37.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.707+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feffc0506d0 con 0x7ff00415c480 2023-05-17T11:45:37.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:37.895+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff00404de80 con 0x7ff00415c480 2023-05-17T11:45:38.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.523+0000 7feffaffd640 1 -- 172.21.15.3:0/183858148 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7feffc053cf0 con 0x7ff00415c480 2023-05-17T11:45:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.523+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefe40662b0 msgr2=0x7fefe4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.523+0000 7ff00898f640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefe40662b0 0x7fefe4068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feff4009970 tx=0x7feff4008040 comp rx=0 tx=0).stop 2023-05-17T11:45:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.523+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 msgr2=0x7ff0040cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.523+0000 7ff00898f640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cd4e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feffc001570 tx=0x7feffc00cca0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 shutdown_connections 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefe40662b0 0x7fefe4068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff00415c480 0x7ff0040cd4e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff00415c0b0 0x7ff0040ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 --2- 172.21.15.3:0/183858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0040cb0b0 0x7ff0040b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 >> 172.21.15.3:0/183858148 conn(0x7ff0040d05b0 msgr2=0x7ff004151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 shutdown_connections 2023-05-17T11:45:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.527+0000 7ff00898f640 1 -- 172.21.15.3:0/183858148 wait complete. 2023-05-17T11:45:38.558 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-17T11:45:38.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:45:38.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 Processor -- start 2023-05-17T11:45:38.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 -- start start 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd88071c10 0x7fbd88070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbd8806bc30 0x7fbd8806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd880c92f0 con 0x7fbd88158f10 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8806c5f0 con 0x7fbd8806bc30 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8e539640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd88071480 con 0x7fbd88071c10 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd87fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbd88158f10 0x7fbd880cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46744/0 (socket says 172.21.15.3:46744) 2023-05-17T11:45:38.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd87fff640 1 -- 172.21.15.3:0/2130928823 learned_addr learned my addr 172.21.15.3:0/2130928823 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:38.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8cad6640 1 --2- 172.21.15.3:0/2130928823 >> v2:172.21.15.3:3300/0 conn(0x7fbd8806bc30 0x7fbd8806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:38.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd877fe640 1 --2- 172.21.15.3:0/2130928823 >> v2:172.21.15.60:3300/0 conn(0x7fbd88071c10 0x7fbd88070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:38.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd86ffd640 1 -- 172.21.15.3:0/2130928823 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144641039 0 0) 0x7fbd880c92f0 con 0x7fbd88158f10 2023-05-17T11:45:38.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd86ffd640 1 -- 172.21.15.3:0/2130928823 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd70005740 con 0x7fbd88158f10 2023-05-17T11:45:38.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2130928823 >> v2:172.21.15.60:3300/0 conn(0x7fbd88071c10 msgr2=0x7fbd88070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:38.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8cad6640 1 --2- 172.21.15.3:0/2130928823 >> v2:172.21.15.60:3300/0 conn(0x7fbd88071c10 0x7fbd88070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2130928823 >> v1:172.21.15.3:6789/0 conn(0x7fbd88158f10 legacy=0x7fbd880cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.691+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2130928823 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd880c8a00 con 0x7fbd8806bc30 2023-05-17T11:45:38.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8cad6640 1 --2- 172.21.15.3:0/2130928823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd8806bc30 0x7fbd8806c0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd880ce360 tx=0x7fbd8001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd136b12976a7ba1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:38.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd86ffd640 1 -- 172.21.15.3:0/2130928823 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800a9400 con 0x7fbd8806bc30 2023-05-17T11:45:38.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd86ffd640 1 -- 172.21.15.3:0/2130928823 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd800a9560 con 0x7fbd8806bc30 2023-05-17T11:45:38.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd86ffd640 1 -- 172.21.15.3:0/2130928823 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800a98f0 con 0x7fbd8806bc30 2023-05-17T11:45:38.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 -- 172.21.15.3:0/2130928823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd8806bc30 msgr2=0x7fbd8806c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2130928823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd8806bc30 0x7fbd8806c0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd880ce360 tx=0x7fbd8001c910 comp rx=0 tx=0).stop 2023-05-17T11:45:38.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 -- 172.21.15.3:0/2130928823 shutdown_connections 2023-05-17T11:45:38.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2130928823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd8806bc30 0x7fbd8806c0b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2130928823 >> v2:172.21.15.60:3300/0 conn(0x7fbd88071c10 0x7fbd88070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 -- 172.21.15.3:0/2130928823 >> 172.21.15.3:0/2130928823 conn(0x7fbd880b0b30 msgr2=0x7fbd880cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:38.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 -- 172.21.15.3:0/2130928823 shutdown_connections 2023-05-17T11:45:38.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.695+0000 7fbd8e539640 1 -- 172.21.15.3:0/2130928823 wait complete. 2023-05-17T11:45:38.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 Processor -- start 2023-05-17T11:45:38.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 -- start start 2023-05-17T11:45:38.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd8806bc30 0x7fbd8814dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:38.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbd88071c10 0x7fbd88161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:38.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 0x7fbd881623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:38.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880c1f70 con 0x7fbd88158f10 2023-05-17T11:45:38.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880c24e0 con 0x7fbd8806bc30 2023-05-17T11:45:38.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8814dff0 con 0x7fbd88071c10 2023-05-17T11:45:38.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 0x7fbd881623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:38.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 0x7fbd881623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51430/0 (socket says 172.21.15.3:51430) 2023-05-17T11:45:38.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2051001295 learned_addr learned my addr 172.21.15.3:0/2051001295 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd87fff640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd8806bc30 0x7fbd8814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd877fe640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbd88071c10 0x7fbd88161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbd88071c10 msgr2=0x7fbd88161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbd88071c10 0x7fbd88161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd8806bc30 msgr2=0x7fbd8814dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd8806bc30 0x7fbd8814dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 -- 172.21.15.3:0/2051001295 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009a70 con 0x7fbd88158f10 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd877fe640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbd88071c10 0x7fbd88161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd87fff640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd8806bc30 0x7fbd8814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8cad6640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 0x7fbd881623a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd80019520 tx=0x7fbd8001b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800a9e90 con 0x7fbd88158f10 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80009450 con 0x7fbd88158f10 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800b2880 con 0x7fbd88158f10 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd880cc690 con 0x7fbd88158f10 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.699+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd880c8f80 con 0x7fbd88158f10 2023-05-17T11:45:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.703+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd88069ab0 con 0x7fbd88158f10 2023-05-17T11:45:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.703+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd800b29e0 con 0x7fbd88158f10 2023-05-17T11:45:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.703+0000 7fbd84ff9640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbd74066280 0x7fbd74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.703+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd8011e560 con 0x7fbd88158f10 2023-05-17T11:45:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.703+0000 7fbd87fff640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbd74066280 0x7fbd74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.703+0000 7fbd87fff640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbd74066280 0x7fbd74068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd780011f0 tx=0x7fbd78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.707+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbd800ef460 con 0x7fbd88158f10 2023-05-17T11:45:38.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.895+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd880c26a0 con 0x7fbd88158f10 2023-05-17T11:45:38.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.895+0000 7fbd84ff9640 1 -- 172.21.15.3:0/2051001295 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fbd880c26a0 con 0x7fbd88158f10 2023-05-17T11:45:38.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:38.907 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:45:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbd74066280 msgr2=0x7fbd74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbd74066280 0x7fbd74068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd780011f0 tx=0x7fbd78009040 comp rx=0 tx=0).stop 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 msgr2=0x7fbd881623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 0x7fbd881623a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd80019520 tx=0x7fbd8001b150 comp rx=0 tx=0).stop 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 shutdown_connections 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbd74066280 0x7fbd74068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd88158f10 0x7fbd881623a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbd88071c10 0x7fbd88161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 --2- 172.21.15.3:0/2051001295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd8806bc30 0x7fbd8814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 >> 172.21.15.3:0/2051001295 conn(0x7fbd880b0b30 msgr2=0x7fbd88069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 shutdown_connections 2023-05-17T11:45:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:38.899+0000 7fbd8e539640 1 -- 172.21.15.3:0/2051001295 wait complete. 2023-05-17T11:45:38.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:39.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fe07bc640 1 Processor -- start 2023-05-17T11:45:39.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fe07bc640 1 -- start start 2023-05-17T11:45:39.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fe07bc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7fd815c180 0x7f7fd80d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fe07bc640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd80af450 con 0x7f7fd80d0b20 2023-05-17T11:45:39.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fe07bc640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd80af730 con 0x7f7fd80d33f0 2023-05-17T11:45:39.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fe07bc640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd80afa10 con 0x7f7fd815c180 2023-05-17T11:45:39.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fded59640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7fd80d0b20 0x7f7fd80b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46756/0 (socket says 172.21.15.3:46756) 2023-05-17T11:45:39.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fded59640 1 -- 172.21.15.3:0/1583149328 learned_addr learned my addr 172.21.15.3:0/1583149328 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:39.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fde558640 1 --2- 172.21.15.3:0/1583149328 >> v2:172.21.15.60:3300/0 conn(0x7f7fd815c180 0x7f7fd80d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fdd556640 1 -- 172.21.15.3:0/1583149328 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356697274 0 0) 0x7f7fd80af450 con 0x7f7fd80d0b20 2023-05-17T11:45:39.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fdd556640 1 -- 172.21.15.3:0/1583149328 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc4003530 con 0x7f7fd80d0b20 2023-05-17T11:45:39.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fde558640 1 -- 172.21.15.3:0/1583149328 >> v1:172.21.15.60:6789/0 conn(0x7f7fd80d33f0 legacy=0x7f7fd80d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fde558640 1 -- 172.21.15.3:0/1583149328 >> v1:172.21.15.3:6789/0 conn(0x7f7fd80d0b20 legacy=0x7f7fd80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.055+0000 7f7fde558640 1 -- 172.21.15.3:0/1583149328 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80afcf0 con 0x7f7fd815c180 2023-05-17T11:45:39.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fde558640 1 --2- 172.21.15.3:0/1583149328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd815c180 0x7f7fd80d2400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40097c0 tx=0x7f7fd401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f439d482307a01e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fdd556640 1 -- 172.21.15.3:0/1583149328 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40ad660 con 0x7f7fd815c180 2023-05-17T11:45:39.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fdd556640 1 -- 172.21.15.3:0/1583149328 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40ad7c0 con 0x7f7fd815c180 2023-05-17T11:45:39.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fdd556640 1 -- 172.21.15.3:0/1583149328 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40adb50 con 0x7f7fd815c180 2023-05-17T11:45:39.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 -- 172.21.15.3:0/1583149328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd815c180 msgr2=0x7f7fd80d2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/1583149328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd815c180 0x7f7fd80d2400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40097c0 tx=0x7f7fd401c450 comp rx=0 tx=0).stop 2023-05-17T11:45:39.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 -- 172.21.15.3:0/1583149328 shutdown_connections 2023-05-17T11:45:39.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/1583149328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd815c180 0x7f7fd80d2400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 -- 172.21.15.3:0/1583149328 >> 172.21.15.3:0/1583149328 conn(0x7f7fd8071b00 msgr2=0x7f7fd809bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:39.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 -- 172.21.15.3:0/1583149328 shutdown_connections 2023-05-17T11:45:39.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.059+0000 7f7fe07bc640 1 -- 172.21.15.3:0/1583149328 wait complete. 2023-05-17T11:45:39.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 Processor -- start 2023-05-17T11:45:39.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 -- start start 2023-05-17T11:45:39.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7fd80d0b20 0x7f7fd8153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd80d33f0 0x7f7fd8151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 0x7f7fd8151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd814d3a0 con 0x7f7fd815c180 2023-05-17T11:45:39.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd814cf10 con 0x7f7fd80d33f0 2023-05-17T11:45:39.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd814c300 con 0x7f7fd80d0b20 2023-05-17T11:45:39.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 0x7f7fd8151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 0x7f7fd8151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51440/0 (socket says 172.21.15.3:51440) 2023-05-17T11:45:39.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 -- 172.21.15.3:0/3339508220 learned_addr learned my addr 172.21.15.3:0/3339508220 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:39.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fde558640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7fd80d0b20 0x7f7fd8153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fddd57640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd80d33f0 0x7f7fd8151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 -- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7fd80d0b20 msgr2=0x7f7fd8153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7fd80d0b20 0x7f7fd8153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 -- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd80d33f0 msgr2=0x7f7fd8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd80d33f0 0x7f7fd8151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 -- 172.21.15.3:0/3339508220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4009420 con 0x7f7fd815c180 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fded59640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 0x7f7fd8151550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000cb40 tx=0x7f7fd000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000aca0 con 0x7f7fd815c180 2023-05-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd000ae00 con 0x7f7fd815c180 2023-05-17T11:45:39.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0012620 con 0x7f7fd815c180 2023-05-17T11:45:39.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd815c6e0 con 0x7f7fd815c180 2023-05-17T11:45:39.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.063+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd815c550 con 0x7f7fd815c180 2023-05-17T11:45:39.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.067+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd80b1410 con 0x7f7fd815c180 2023-05-17T11:45:39.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.067+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fd0007070 con 0x7f7fd815c180 2023-05-17T11:45:39.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.067+0000 7f7fceffd640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7fbc066280 0x7f7fbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.067+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fd0083d20 con 0x7f7fd815c180 2023-05-17T11:45:39.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.067+0000 7f7fde558640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7fbc066280 0x7f7fbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.067+0000 7f7fde558640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7fbc066280 0x7f7fbc068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40af000 tx=0x7f7fd4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.071+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7fd00511b0 con 0x7f7fd815c180 2023-05-17T11:45:39.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.227+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fd814d080 con 0x7f7fd815c180 2023-05-17T11:45:39.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fceffd640 1 -- 172.21.15.3:0/3339508220 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f7fd0017090 con 0x7f7fd815c180 2023-05-17T11:45:39.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:39.239 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:39.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7fbc066280 msgr2=0x7f7fbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7fbc066280 0x7f7fbc068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40af000 tx=0x7f7fd4008040 comp rx=0 tx=0).stop 2023-05-17T11:45:39.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 msgr2=0x7f7fd8151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 0x7f7fd8151550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000cb40 tx=0x7f7fd000a060 comp rx=0 tx=0).stop 2023-05-17T11:45:39.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 shutdown_connections 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7fbc066280 0x7f7fbc068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fd815c180 0x7f7fd8151550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd80d33f0 0x7f7fd8151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 --2- 172.21.15.3:0/3339508220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7fd80d0b20 0x7f7fd8153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 >> 172.21.15.3:0/3339508220 conn(0x7f7fd8071b00 msgr2=0x7f7fd80c8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 shutdown_connections 2023-05-17T11:45:39.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.231+0000 7f7fe07bc640 1 -- 172.21.15.3:0/3339508220 wait complete. 2023-05-17T11:45:39.259 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T11:45:39.260 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T11:45:39.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 Processor -- start 2023-05-17T11:45:39.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 -- start start 2023-05-17T11:45:39.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ce8158f10 0x7f3ce8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ce806bc30 0x7f3ce806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80c92f0 con 0x7f3ce8071c10 2023-05-17T11:45:39.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce806c5f0 con 0x7f3ce8158f10 2023-05-17T11:45:39.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ceef7b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce8071480 con 0x7f3ce806bc30 2023-05-17T11:45:39.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3cecd17640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ce8158f10 0x7f3ce8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ce7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3ce8071c10 0x7f3ce80cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46768/0 (socket says 172.21.15.3:46768) 2023-05-17T11:45:39.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ce7fff640 1 -- 172.21.15.3:0/1651742001 learned_addr learned my addr 172.21.15.3:0/1651742001 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:39.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ced518640 1 --2- 172.21.15.3:0/1651742001 >> v2:172.21.15.60:3300/0 conn(0x7f3ce806bc30 0x7f3ce806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3cecd17640 1 -- 172.21.15.3:0/1651742001 >> v2:172.21.15.60:3300/0 conn(0x7f3ce806bc30 msgr2=0x7f3ce806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:39.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3cecd17640 1 --2- 172.21.15.3:0/1651742001 >> v2:172.21.15.60:3300/0 conn(0x7f3ce806bc30 0x7f3ce806c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3cecd17640 1 -- 172.21.15.3:0/1651742001 >> v1:172.21.15.3:6789/0 conn(0x7f3ce8071c10 legacy=0x7f3ce80cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3cecd17640 1 -- 172.21.15.3:0/1651742001 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80c8a00 con 0x7f3ce8158f10 2023-05-17T11:45:39.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.387+0000 7f3ce77fe640 1 -- 172.21.15.3:0/1651742001 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313977903 0 0) 0x7f3ce80c92f0 con 0x7f3ce8071c10 2023-05-17T11:45:39.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3cecd17640 1 --2- 172.21.15.3:0/1651742001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce8070f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3ce806e040 tx=0x7f3cdc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c062dc4db352acbb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ce77fe640 1 -- 172.21.15.3:0/1651742001 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc004230 con 0x7f3ce8158f10 2023-05-17T11:45:39.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ce77fe640 1 -- 172.21.15.3:0/1651742001 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc0a7050 con 0x7f3ce8158f10 2023-05-17T11:45:39.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ce77fe640 1 -- 172.21.15.3:0/1651742001 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc003620 con 0x7f3ce8158f10 2023-05-17T11:45:39.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 -- 172.21.15.3:0/1651742001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 msgr2=0x7f3ce8070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/1651742001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce8070f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3ce806e040 tx=0x7f3cdc01c460 comp rx=0 tx=0).stop 2023-05-17T11:45:39.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 -- 172.21.15.3:0/1651742001 shutdown_connections 2023-05-17T11:45:39.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/1651742001 >> v2:172.21.15.60:3300/0 conn(0x7f3ce806bc30 0x7f3ce806c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/1651742001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce8070f40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 -- 172.21.15.3:0/1651742001 >> 172.21.15.3:0/1651742001 conn(0x7f3ce80b0b30 msgr2=0x7f3ce80cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:39.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 -- 172.21.15.3:0/1651742001 shutdown_connections 2023-05-17T11:45:39.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.391+0000 7f3ceef7b640 1 -- 172.21.15.3:0/1651742001 wait complete. 2023-05-17T11:45:39.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 Processor -- start 2023-05-17T11:45:39.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 -- start start 2023-05-17T11:45:39.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3ce806bc30 0x7f3ce8162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce8071c10 0x7f3ce814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce80c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80c2210 con 0x7f3ce8158f10 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80c1ee0 con 0x7f3ce8071c10 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce81630c0 con 0x7f3ce806bc30 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce80c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce80c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51462/0 (socket says 172.21.15.3:51462) 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 -- 172.21.15.3:0/271833349 learned_addr learned my addr 172.21.15.3:0/271833349 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ce7fff640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce8071c10 0x7f3ce814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3cecd17640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3ce806bc30 0x7f3ce8162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 -- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3ce806bc30 msgr2=0x7f3ce8162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3ce806bc30 0x7f3ce8162870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 -- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce8071c10 msgr2=0x7f3ce814d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce8071c10 0x7f3ce814d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 -- 172.21.15.3:0/271833349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009420 con 0x7f3ce8158f10 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ced518640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce80c5480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0007e40 tx=0x7f3ce000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0014620 con 0x7f3ce8158f10 2023-05-17T11:45:39.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce000ee90 con 0x7f3ce8158f10 2023-05-17T11:45:39.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce80cc690 con 0x7f3ce8158f10 2023-05-17T11:45:39.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00149e0 con 0x7f3ce8158f10 2023-05-17T11:45:39.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.395+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80c8f80 con 0x7f3ce8158f10 2023-05-17T11:45:39.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.399+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce8069ab0 con 0x7f3ce8158f10 2023-05-17T11:45:39.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.399+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ce0014b40 con 0x7f3ce8158f10 2023-05-17T11:45:39.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.399+0000 7f3ce57fa640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3ccc066280 0x7f3ccc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.399+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ce0084620 con 0x7f3ce8158f10 2023-05-17T11:45:39.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.399+0000 7f3cecd17640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3ccc066280 0x7f3ccc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.399+0000 7f3cecd17640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3ccc066280 0x7f3ccc068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0ad000 tx=0x7f3cdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.403+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3ce0051ab0 con 0x7f3ce8158f10 2023-05-17T11:45:39.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.555+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 --> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce804df20 con 0x7f3ccc066280 2023-05-17T11:45:39.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.563+0000 7f3ce57fa640 1 -- 172.21.15.3:0/271833349 <== mgr.4110 v2:172.21.15.3:6832/2126677587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286737 (secure 0 0 0) 0x7f3ce804df20 con 0x7f3ccc066280 2023-05-17T11:45:39.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:39.578 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-05-17T11:45:39.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3ccc066280 msgr2=0x7f3ccc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3ccc066280 0x7f3ccc068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0ad000 tx=0x7f3cdc008040 comp rx=0 tx=0).stop 2023-05-17T11:45:39.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 msgr2=0x7f3ce80c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce80c5480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0007e40 tx=0x7f3ce000e4b0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 shutdown_connections 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3ccc066280 0x7f3ccc068730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ce8158f10 0x7f3ce80c5480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce8071c10 0x7f3ce814d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 --2- 172.21.15.3:0/271833349 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3ce806bc30 0x7f3ce8162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 >> 172.21.15.3:0/271833349 conn(0x7f3ce80b0b30 msgr2=0x7f3ce80cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 shutdown_connections 2023-05-17T11:45:39.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.567+0000 7f3ceef7b640 1 -- 172.21.15.3:0/271833349 wait complete. 2023-05-17T11:45:39.597 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-17T11:45:38.527442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82540,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":754892180,"statfs":{"total":773094113280,"available":773009592320,"internally_reserved":0,"allocated":3125248,"data_stored":1868987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.416593"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.535482+0000","last_change":"2023-05-17T11:45:35.531488+0000","last_active":"2023-05-17T11:45:35.535482+0000","last_peered":"2023-05-17T11:45:35.535482+0000","last_clean":"2023-05-17T11:45:35.535482+0000","last_became_active":"2023-05-17T11:45:35.531185+0000","last_became_peered":"2023-05-17T11:45:35.531185+0000","last_unstale":"2023-05-17T11:45:35.535482+0000","last_undegraded":"2023-05-17T11:45:35.535482+0000","last_fullsized":"2023-05-17T11:45:35.535482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:37:00.455903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521624+0000","last_change":"2023-05-17T11:45:35.539055+0000","last_active":"2023-05-17T11:45:36.521624+0000","last_peered":"2023-05-17T11:45:36.521624+0000","last_clean":"2023-05-17T11:45:36.521624+0000","last_became_active":"2023-05-17T11:45:35.538706+0000","last_became_peered":"2023-05-17T11:45:35.538706+0000","last_unstale":"2023-05-17T11:45:36.521624+0000","last_undegraded":"2023-05-17T11:45:36.521624+0000","last_fullsized":"2023-05-17T11:45:36.521624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555629+0000","last_change":"2023-05-17T11:45:35.543264+0000","last_active":"2023-05-17T11:45:35.555629+0000","last_peered":"2023-05-17T11:45:35.555629+0000","last_clean":"2023-05-17T11:45:35.555629+0000","last_became_active":"2023-05-17T11:45:35.542323+0000","last_became_peered":"2023-05-17T11:45:35.542323+0000","last_unstale":"2023-05-17T11:45:35.555629+0000","last_undegraded":"2023-05-17T11:45:35.555629+0000","last_fullsized":"2023-05-17T11:45:35.555629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178187+0000","last_change":"2023-05-17T11:45:35.547666+0000","last_active":"2023-05-17T11:45:37.178187+0000","last_peered":"2023-05-17T11:45:37.178187+0000","last_clean":"2023-05-17T11:45:37.178187+0000","last_became_active":"2023-05-17T11:45:35.547228+0000","last_became_peered":"2023-05-17T11:45:35.547228+0000","last_unstale":"2023-05-17T11:45:37.178187+0000","last_undegraded":"2023-05-17T11:45:37.178187+0000","last_fullsized":"2023-05-17T11:45:37.178187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538325+0000","last_change":"2023-05-17T11:45:35.530614+0000","last_active":"2023-05-17T11:45:35.538325+0000","last_peered":"2023-05-17T11:45:35.538325+0000","last_clean":"2023-05-17T11:45:35.538325+0000","last_became_active":"2023-05-17T11:45:35.529983+0000","last_became_peered":"2023-05-17T11:45:35.529983+0000","last_unstale":"2023-05-17T11:45:35.538325+0000","last_undegraded":"2023-05-17T11:45:35.538325+0000","last_fullsized":"2023-05-17T11:45:35.538325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:19.352747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.548719+0000","last_change":"2023-05-17T11:45:35.534671+0000","last_active":"2023-05-17T11:45:35.548719+0000","last_peered":"2023-05-17T11:45:35.548719+0000","last_clean":"2023-05-17T11:45:35.548719+0000","last_became_active":"2023-05-17T11:45:35.534089+0000","last_became_peered":"2023-05-17T11:45:35.534089+0000","last_unstale":"2023-05-17T11:45:35.548719+0000","last_undegraded":"2023-05-17T11:45:35.548719+0000","last_fullsized":"2023-05-17T11:45:35.548719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:24:26.208061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559627+0000","last_change":"2023-05-17T11:45:35.556495+0000","last_active":"2023-05-17T11:45:35.559627+0000","last_peered":"2023-05-17T11:45:35.559627+0000","last_clean":"2023-05-17T11:45:35.559627+0000","last_became_active":"2023-05-17T11:45:35.556172+0000","last_became_peered":"2023-05-17T11:45:35.556172+0000","last_unstale":"2023-05-17T11:45:35.559627+0000","last_undegraded":"2023-05-17T11:45:35.559627+0000","last_fullsized":"2023-05-17T11:45:35.559627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:15:20.505190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521284+0000","last_change":"2023-05-17T11:45:35.545750+0000","last_active":"2023-05-17T11:45:36.521284+0000","last_peered":"2023-05-17T11:45:36.521284+0000","last_clean":"2023-05-17T11:45:36.521284+0000","last_became_active":"2023-05-17T11:45:35.543809+0000","last_became_peered":"2023-05-17T11:45:35.543809+0000","last_unstale":"2023-05-17T11:45:36.521284+0000","last_undegraded":"2023-05-17T11:45:36.521284+0000","last_fullsized":"2023-05-17T11:45:36.521284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546272+0000","last_change":"2023-05-17T11:45:35.533284+0000","last_active":"2023-05-17T11:45:35.546272+0000","last_peered":"2023-05-17T11:45:35.546272+0000","last_clean":"2023-05-17T11:45:35.546272+0000","last_became_active":"2023-05-17T11:45:35.533036+0000","last_became_peered":"2023-05-17T11:45:35.533036+0000","last_unstale":"2023-05-17T11:45:35.546272+0000","last_undegraded":"2023-05-17T11:45:35.546272+0000","last_fullsized":"2023-05-17T11:45:35.546272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521791+0000","last_change":"2023-05-17T11:45:35.536658+0000","last_active":"2023-05-17T11:45:36.521791+0000","last_peered":"2023-05-17T11:45:36.521791+0000","last_clean":"2023-05-17T11:45:36.521791+0000","last_became_active":"2023-05-17T11:45:35.536150+0000","last_became_peered":"2023-05-17T11:45:35.536150+0000","last_unstale":"2023-05-17T11:45:36.521791+0000","last_undegraded":"2023-05-17T11:45:36.521791+0000","last_fullsized":"2023-05-17T11:45:36.521791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555650+0000","last_change":"2023-05-17T11:45:35.543512+0000","last_active":"2023-05-17T11:45:35.555650+0000","last_peered":"2023-05-17T11:45:35.555650+0000","last_clean":"2023-05-17T11:45:35.555650+0000","last_became_active":"2023-05-17T11:45:35.540333+0000","last_became_peered":"2023-05-17T11:45:35.540333+0000","last_unstale":"2023-05-17T11:45:35.555650+0000","last_undegraded":"2023-05-17T11:45:35.555650+0000","last_fullsized":"2023-05-17T11:45:35.555650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:55:31.094625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.549426+0000","last_change":"2023-05-17T11:45:35.542466+0000","last_active":"2023-05-17T11:45:35.549426+0000","last_peered":"2023-05-17T11:45:35.549426+0000","last_clean":"2023-05-17T11:45:35.549426+0000","last_became_active":"2023-05-17T11:45:35.542211+0000","last_became_peered":"2023-05-17T11:45:35.542211+0000","last_unstale":"2023-05-17T11:45:35.549426+0000","last_undegraded":"2023-05-17T11:45:35.549426+0000","last_fullsized":"2023-05-17T11:45:35.549426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:25:32.647449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.534498+0000","last_change":"2023-05-17T11:45:35.528858+0000","last_active":"2023-05-17T11:45:35.534498+0000","last_peered":"2023-05-17T11:45:35.534498+0000","last_clean":"2023-05-17T11:45:35.534498+0000","last_became_active":"2023-05-17T11:45:35.527334+0000","last_became_peered":"2023-05-17T11:45:35.527334+0000","last_unstale":"2023-05-17T11:45:35.534498+0000","last_undegraded":"2023-05-17T11:45:35.534498+0000","last_fullsized":"2023-05-17T11:45:35.534498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:19.352747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521378+0000","last_change":"2023-05-17T11:45:35.533168+0000","last_active":"2023-05-17T11:45:36.521378+0000","last_peered":"2023-05-17T11:45:36.521378+0000","last_clean":"2023-05-17T11:45:36.521378+0000","last_became_active":"2023-05-17T11:45:35.532752+0000","last_became_peered":"2023-05-17T11:45:35.532752+0000","last_unstale":"2023-05-17T11:45:36.521378+0000","last_undegraded":"2023-05-17T11:45:36.521378+0000","last_fullsized":"2023-05-17T11:45:36.521378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559646+0000","last_change":"2023-05-17T11:45:35.556519+0000","last_active":"2023-05-17T11:45:35.559646+0000","last_peered":"2023-05-17T11:45:35.559646+0000","last_clean":"2023-05-17T11:45:35.559646+0000","last_became_active":"2023-05-17T11:45:35.556187+0000","last_became_peered":"2023-05-17T11:45:35.556187+0000","last_unstale":"2023-05-17T11:45:35.559646+0000","last_undegraded":"2023-05-17T11:45:35.559646+0000","last_fullsized":"2023-05-17T11:45:35.559646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:19.803154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.548604+0000","last_change":"2023-05-17T11:45:35.535436+0000","last_active":"2023-05-17T11:45:35.548604+0000","last_peered":"2023-05-17T11:45:35.548604+0000","last_clean":"2023-05-17T11:45:35.548604+0000","last_became_active":"2023-05-17T11:45:35.535014+0000","last_became_peered":"2023-05-17T11:45:35.535014+0000","last_unstale":"2023-05-17T11:45:35.548604+0000","last_undegraded":"2023-05-17T11:45:35.548604+0000","last_fullsized":"2023-05-17T11:45:35.548604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:19.352747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538476+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:35.538476+0000","last_peered":"2023-05-17T11:45:35.538476+0000","last_clean":"2023-05-17T11:45:35.538476+0000","last_became_active":"2023-05-17T11:45:35.530050+0000","last_became_peered":"2023-05-17T11:45:35.530050+0000","last_unstale":"2023-05-17T11:45:35.538476+0000","last_undegraded":"2023-05-17T11:45:35.538476+0000","last_fullsized":"2023-05-17T11:45:35.538476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:25:32.647449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555134+0000","last_change":"2023-05-17T11:45:35.540996+0000","last_active":"2023-05-17T11:45:35.555134+0000","last_peered":"2023-05-17T11:45:35.555134+0000","last_clean":"2023-05-17T11:45:35.555134+0000","last_became_active":"2023-05-17T11:45:35.539704+0000","last_became_peered":"2023-05-17T11:45:35.539704+0000","last_unstale":"2023-05-17T11:45:35.555134+0000","last_undegraded":"2023-05-17T11:45:35.555134+0000","last_fullsized":"2023-05-17T11:45:35.555134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.550256+0000","last_change":"2023-05-17T11:45:35.545437+0000","last_active":"2023-05-17T11:45:35.550256+0000","last_peered":"2023-05-17T11:45:35.550256+0000","last_clean":"2023-05-17T11:45:35.550256+0000","last_became_active":"2023-05-17T11:45:35.545111+0000","last_became_peered":"2023-05-17T11:45:35.545111+0000","last_unstale":"2023-05-17T11:45:35.550256+0000","last_undegraded":"2023-05-17T11:45:35.550256+0000","last_fullsized":"2023-05-17T11:45:35.550256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:24:13.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.558015+0000","last_change":"2023-05-17T11:45:35.553620+0000","last_active":"2023-05-17T11:45:35.558015+0000","last_peered":"2023-05-17T11:45:35.558015+0000","last_clean":"2023-05-17T11:45:35.558015+0000","last_became_active":"2023-05-17T11:45:35.550862+0000","last_became_peered":"2023-05-17T11:45:35.550862+0000","last_unstale":"2023-05-17T11:45:35.558015+0000","last_undegraded":"2023-05-17T11:45:35.558015+0000","last_fullsized":"2023-05-17T11:45:35.558015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.560414+0000","last_change":"2023-05-17T11:45:35.559364+0000","last_active":"2023-05-17T11:45:35.560414+0000","last_peered":"2023-05-17T11:45:35.560414+0000","last_clean":"2023-05-17T11:45:35.560414+0000","last_became_active":"2023-05-17T11:45:35.558911+0000","last_became_peered":"2023-05-17T11:45:35.558911+0000","last_unstale":"2023-05-17T11:45:35.560414+0000","last_undegraded":"2023-05-17T11:45:35.560414+0000","last_fullsized":"2023-05-17T11:45:35.560414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.545601+0000","last_change":"2023-05-17T11:45:35.540513+0000","last_active":"2023-05-17T11:45:35.545601+0000","last_peered":"2023-05-17T11:45:35.545601+0000","last_clean":"2023-05-17T11:45:35.545601+0000","last_became_active":"2023-05-17T11:45:35.540257+0000","last_became_peered":"2023-05-17T11:45:35.540257+0000","last_unstale":"2023-05-17T11:45:35.545601+0000","last_undegraded":"2023-05-17T11:45:35.545601+0000","last_fullsized":"2023-05-17T11:45:35.545601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:24:26.208061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521091+0000","last_change":"2023-05-17T11:45:35.531180+0000","last_active":"2023-05-17T11:45:36.521091+0000","last_peered":"2023-05-17T11:45:36.521091+0000","last_clean":"2023-05-17T11:45:36.521091+0000","last_became_active":"2023-05-17T11:45:35.530904+0000","last_became_peered":"2023-05-17T11:45:35.530904+0000","last_unstale":"2023-05-17T11:45:36.521091+0000","last_undegraded":"2023-05-17T11:45:36.521091+0000","last_fullsized":"2023-05-17T11:45:36.521091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:19.803154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.558872+0000","last_change":"2023-05-17T11:45:35.543609+0000","last_active":"2023-05-17T11:45:35.558872+0000","last_peered":"2023-05-17T11:45:35.558872+0000","last_clean":"2023-05-17T11:45:35.558872+0000","last_became_active":"2023-05-17T11:45:35.543225+0000","last_became_peered":"2023-05-17T11:45:35.543225+0000","last_unstale":"2023-05-17T11:45:35.558872+0000","last_undegraded":"2023-05-17T11:45:35.558872+0000","last_fullsized":"2023-05-17T11:45:35.558872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519623+0000","last_change":"2023-05-17T11:45:35.546917+0000","last_active":"2023-05-17T11:45:36.519623+0000","last_peered":"2023-05-17T11:45:36.519623+0000","last_clean":"2023-05-17T11:45:36.519623+0000","last_became_active":"2023-05-17T11:45:35.546616+0000","last_became_peered":"2023-05-17T11:45:35.546616+0000","last_unstale":"2023-05-17T11:45:36.519623+0000","last_undegraded":"2023-05-17T11:45:36.519623+0000","last_fullsized":"2023-05-17T11:45:36.519623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520007+0000","last_change":"2023-05-17T11:45:35.535060+0000","last_active":"2023-05-17T11:45:36.520007+0000","last_peered":"2023-05-17T11:45:36.520007+0000","last_clean":"2023-05-17T11:45:36.520007+0000","last_became_active":"2023-05-17T11:45:35.534805+0000","last_became_peered":"2023-05-17T11:45:35.534805+0000","last_unstale":"2023-05-17T11:45:36.520007+0000","last_undegraded":"2023-05-17T11:45:36.520007+0000","last_fullsized":"2023-05-17T11:45:36.520007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521780+0000","last_change":"2023-05-17T11:45:35.542414+0000","last_active":"2023-05-17T11:45:36.521780+0000","last_peered":"2023-05-17T11:45:36.521780+0000","last_clean":"2023-05-17T11:45:36.521780+0000","last_became_active":"2023-05-17T11:45:35.542083+0000","last_became_peered":"2023-05-17T11:45:35.542083+0000","last_unstale":"2023-05-17T11:45:36.521780+0000","last_undegraded":"2023-05-17T11:45:36.521780+0000","last_fullsized":"2023-05-17T11:45:36.521780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519826+0000","last_change":"2023-05-17T11:45:35.538026+0000","last_active":"2023-05-17T11:45:36.519826+0000","last_peered":"2023-05-17T11:45:36.519826+0000","last_clean":"2023-05-17T11:45:36.519826+0000","last_became_active":"2023-05-17T11:45:35.534906+0000","last_became_peered":"2023-05-17T11:45:35.534906+0000","last_unstale":"2023-05-17T11:45:36.519826+0000","last_undegraded":"2023-05-17T11:45:36.519826+0000","last_fullsized":"2023-05-17T11:45:36.519826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521427+0000","last_change":"2023-05-17T11:45:35.545248+0000","last_active":"2023-05-17T11:45:36.521427+0000","last_peered":"2023-05-17T11:45:36.521427+0000","last_clean":"2023-05-17T11:45:36.521427+0000","last_became_active":"2023-05-17T11:45:35.544970+0000","last_became_peered":"2023-05-17T11:45:35.544970+0000","last_unstale":"2023-05-17T11:45:36.521427+0000","last_undegraded":"2023-05-17T11:45:36.521427+0000","last_fullsized":"2023-05-17T11:45:36.521427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557931+0000","last_change":"2023-05-17T11:45:35.553537+0000","last_active":"2023-05-17T11:45:35.557931+0000","last_peered":"2023-05-17T11:45:35.557931+0000","last_clean":"2023-05-17T11:45:35.557931+0000","last_became_active":"2023-05-17T11:45:35.551558+0000","last_became_peered":"2023-05-17T11:45:35.551558+0000","last_unstale":"2023-05-17T11:45:35.557931+0000","last_undegraded":"2023-05-17T11:45:35.557931+0000","last_fullsized":"2023-05-17T11:45:35.557931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:48:15.769750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521229+0000","last_change":"2023-05-17T11:45:35.534702+0000","last_active":"2023-05-17T11:45:36.521229+0000","last_peered":"2023-05-17T11:45:36.521229+0000","last_clean":"2023-05-17T11:45:36.521229+0000","last_became_active":"2023-05-17T11:45:35.534447+0000","last_became_peered":"2023-05-17T11:45:35.534447+0000","last_unstale":"2023-05-17T11:45:36.521229+0000","last_undegraded":"2023-05-17T11:45:36.521229+0000","last_fullsized":"2023-05-17T11:45:36.521229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.177990+0000","last_change":"2023-05-17T11:45:35.546069+0000","last_active":"2023-05-17T11:45:37.177990+0000","last_peered":"2023-05-17T11:45:37.177990+0000","last_clean":"2023-05-17T11:45:37.177990+0000","last_became_active":"2023-05-17T11:45:35.545768+0000","last_became_peered":"2023-05-17T11:45:35.545768+0000","last_unstale":"2023-05-17T11:45:37.177990+0000","last_undegraded":"2023-05-17T11:45:37.177990+0000","last_fullsized":"2023-05-17T11:45:37.177990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521500+0000","last_change":"2023-05-17T11:45:35.541053+0000","last_active":"2023-05-17T11:45:36.521500+0000","last_peered":"2023-05-17T11:45:36.521500+0000","last_clean":"2023-05-17T11:45:36.521500+0000","last_became_active":"2023-05-17T11:45:35.540780+0000","last_became_peered":"2023-05-17T11:45:35.540780+0000","last_unstale":"2023-05-17T11:45:36.521500+0000","last_undegraded":"2023-05-17T11:45:36.521500+0000","last_fullsized":"2023-05-17T11:45:36.521500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559247+0000","last_change":"2023-05-17T11:45:35.148198+0000","last_active":"2023-05-17T11:45:35.559247+0000","last_peered":"2023-05-17T11:45:35.559247+0000","last_clean":"2023-05-17T11:45:35.559247+0000","last_became_active":"2023-05-17T11:45:35.147893+0000","last_became_peered":"2023-05-17T11:45:35.147893+0000","last_unstale":"2023-05-17T11:45:35.559247+0000","last_undegraded":"2023-05-17T11:45:35.559247+0000","last_fullsized":"2023-05-17T11:45:35.559247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:48.964519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521783+0000","last_change":"2023-05-17T11:45:35.546006+0000","last_active":"2023-05-17T11:45:36.521783+0000","last_peered":"2023-05-17T11:45:36.521783+0000","last_clean":"2023-05-17T11:45:36.521783+0000","last_became_active":"2023-05-17T11:45:35.545532+0000","last_became_peered":"2023-05-17T11:45:35.545532+0000","last_unstale":"2023-05-17T11:45:36.521783+0000","last_undegraded":"2023-05-17T11:45:36.521783+0000","last_fullsized":"2023-05-17T11:45:36.521783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.527473+0000","last_change":"2023-05-17T11:45:35.138861+0000","last_active":"2023-05-17T11:45:35.527473+0000","last_peered":"2023-05-17T11:45:35.527473+0000","last_clean":"2023-05-17T11:45:35.527473+0000","last_became_active":"2023-05-17T11:45:35.138231+0000","last_became_peered":"2023-05-17T11:45:35.138231+0000","last_unstale":"2023-05-17T11:45:35.527473+0000","last_undegraded":"2023-05-17T11:45:35.527473+0000","last_fullsized":"2023-05-17T11:45:35.527473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:17.511368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538730+0000","last_change":"2023-05-17T11:45:35.532498+0000","last_active":"2023-05-17T11:45:35.538730+0000","last_peered":"2023-05-17T11:45:35.538730+0000","last_clean":"2023-05-17T11:45:35.538730+0000","last_became_active":"2023-05-17T11:45:35.532219+0000","last_became_peered":"2023-05-17T11:45:35.532219+0000","last_unstale":"2023-05-17T11:45:35.538730+0000","last_undegraded":"2023-05-17T11:45:35.538730+0000","last_fullsized":"2023-05-17T11:45:35.538730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:37:00.455903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.537233+0000","last_change":"2023-05-17T11:45:35.143472+0000","last_active":"2023-05-17T11:45:35.537233+0000","last_peered":"2023-05-17T11:45:35.537233+0000","last_clean":"2023-05-17T11:45:35.537233+0000","last_became_active":"2023-05-17T11:45:35.142889+0000","last_became_peered":"2023-05-17T11:45:35.142889+0000","last_unstale":"2023-05-17T11:45:35.537233+0000","last_undegraded":"2023-05-17T11:45:35.537233+0000","last_fullsized":"2023-05-17T11:45:35.537233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:49.363470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521564+0000","last_change":"2023-05-17T11:45:35.544687+0000","last_active":"2023-05-17T11:45:36.521564+0000","last_peered":"2023-05-17T11:45:36.521564+0000","last_clean":"2023-05-17T11:45:36.521564+0000","last_became_active":"2023-05-17T11:45:35.544357+0000","last_became_peered":"2023-05-17T11:45:35.544357+0000","last_unstale":"2023-05-17T11:45:36.521564+0000","last_undegraded":"2023-05-17T11:45:36.521564+0000","last_fullsized":"2023-05-17T11:45:36.521564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178143+0000","last_change":"2023-05-17T11:45:35.132466+0000","last_active":"2023-05-17T11:45:37.178143+0000","last_peered":"2023-05-17T11:45:37.178143+0000","last_clean":"2023-05-17T11:45:37.178143+0000","last_became_active":"2023-05-17T11:45:35.132140+0000","last_became_peered":"2023-05-17T11:45:35.132140+0000","last_unstale":"2023-05-17T11:45:37.178143+0000","last_undegraded":"2023-05-17T11:45:37.178143+0000","last_fullsized":"2023-05-17T11:45:37.178143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:04.077222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559102+0000","last_change":"2023-05-17T11:45:35.148167+0000","last_active":"2023-05-17T11:45:35.559102+0000","last_peered":"2023-05-17T11:45:35.559102+0000","last_clean":"2023-05-17T11:45:35.559102+0000","last_became_active":"2023-05-17T11:45:35.147381+0000","last_became_peered":"2023-05-17T11:45:35.147381+0000","last_unstale":"2023-05-17T11:45:35.559102+0000","last_undegraded":"2023-05-17T11:45:35.559102+0000","last_fullsized":"2023-05-17T11:45:35.559102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521316+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:36.521316+0000","last_peered":"2023-05-17T11:45:36.521316+0000","last_clean":"2023-05-17T11:45:36.521316+0000","last_became_active":"2023-05-17T11:45:35.529813+0000","last_became_peered":"2023-05-17T11:45:35.529813+0000","last_unstale":"2023-05-17T11:45:36.521316+0000","last_undegraded":"2023-05-17T11:45:36.521316+0000","last_fullsized":"2023-05-17T11:45:36.521316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559340+0000","last_change":"2023-05-17T11:45:35.148428+0000","last_active":"2023-05-17T11:45:35.559340+0000","last_peered":"2023-05-17T11:45:35.559340+0000","last_clean":"2023-05-17T11:45:35.559340+0000","last_became_active":"2023-05-17T11:45:35.147509+0000","last_became_peered":"2023-05-17T11:45:35.147509+0000","last_unstale":"2023-05-17T11:45:35.559340+0000","last_undegraded":"2023-05-17T11:45:35.559340+0000","last_fullsized":"2023-05-17T11:45:35.559340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:29.545146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555158+0000","last_change":"2023-05-17T11:45:35.541926+0000","last_active":"2023-05-17T11:45:35.555158+0000","last_peered":"2023-05-17T11:45:35.555158+0000","last_clean":"2023-05-17T11:45:35.555158+0000","last_became_active":"2023-05-17T11:45:35.540338+0000","last_became_peered":"2023-05-17T11:45:35.540338+0000","last_unstale":"2023-05-17T11:45:35.555158+0000","last_undegraded":"2023-05-17T11:45:35.555158+0000","last_fullsized":"2023-05-17T11:45:35.555158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:23:24.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559737+0000","last_change":"2023-05-17T11:45:35.140919+0000","last_active":"2023-05-17T11:45:35.559737+0000","last_peered":"2023-05-17T11:45:35.559737+0000","last_clean":"2023-05-17T11:45:35.559737+0000","last_became_active":"2023-05-17T11:45:35.140533+0000","last_became_peered":"2023-05-17T11:45:35.140533+0000","last_unstale":"2023-05-17T11:45:35.559737+0000","last_undegraded":"2023-05-17T11:45:35.559737+0000","last_fullsized":"2023-05-17T11:45:35.559737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:03.684194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178078+0000","last_change":"2023-05-17T11:45:35.544834+0000","last_active":"2023-05-17T11:45:37.178078+0000","last_peered":"2023-05-17T11:45:37.178078+0000","last_clean":"2023-05-17T11:45:37.178078+0000","last_became_active":"2023-05-17T11:45:35.544565+0000","last_became_peered":"2023-05-17T11:45:35.544565+0000","last_unstale":"2023-05-17T11:45:37.178078+0000","last_undegraded":"2023-05-17T11:45:37.178078+0000","last_fullsized":"2023-05-17T11:45:37.178078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521886+0000","last_change":"2023-05-17T11:45:35.141712+0000","last_active":"2023-05-17T11:45:36.521886+0000","last_peered":"2023-05-17T11:45:36.521886+0000","last_clean":"2023-05-17T11:45:36.521886+0000","last_became_active":"2023-05-17T11:45:35.141301+0000","last_became_peered":"2023-05-17T11:45:35.141301+0000","last_unstale":"2023-05-17T11:45:36.521886+0000","last_undegraded":"2023-05-17T11:45:36.521886+0000","last_fullsized":"2023-05-17T11:45:36.521886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.545650+0000","last_change":"2023-05-17T11:45:35.541253+0000","last_active":"2023-05-17T11:45:35.545650+0000","last_peered":"2023-05-17T11:45:35.545650+0000","last_clean":"2023-05-17T11:45:35.545650+0000","last_became_active":"2023-05-17T11:45:35.540949+0000","last_became_peered":"2023-05-17T11:45:35.540949+0000","last_unstale":"2023-05-17T11:45:35.545650+0000","last_undegraded":"2023-05-17T11:45:35.545650+0000","last_fullsized":"2023-05-17T11:45:35.545650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:24:13.270647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521633+0000","last_change":"2023-05-17T11:45:35.144268+0000","last_active":"2023-05-17T11:45:36.521633+0000","last_peered":"2023-05-17T11:45:36.521633+0000","last_clean":"2023-05-17T11:45:36.521633+0000","last_became_active":"2023-05-17T11:45:35.143991+0000","last_became_peered":"2023-05-17T11:45:35.143991+0000","last_unstale":"2023-05-17T11:45:36.521633+0000","last_undegraded":"2023-05-17T11:45:36.521633+0000","last_fullsized":"2023-05-17T11:45:36.521633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555479+0000","last_change":"2023-05-17T11:45:35.542321+0000","last_active":"2023-05-17T11:45:35.555479+0000","last_peered":"2023-05-17T11:45:35.555479+0000","last_clean":"2023-05-17T11:45:35.555479+0000","last_became_active":"2023-05-17T11:45:35.539632+0000","last_became_peered":"2023-05-17T11:45:35.539632+0000","last_unstale":"2023-05-17T11:45:35.555479+0000","last_undegraded":"2023-05-17T11:45:35.555479+0000","last_fullsized":"2023-05-17T11:45:35.555479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:05.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178234+0000","last_change":"2023-05-17T11:45:35.142904+0000","last_active":"2023-05-17T11:45:37.178234+0000","last_peered":"2023-05-17T11:45:37.178234+0000","last_clean":"2023-05-17T11:45:37.178234+0000","last_became_active":"2023-05-17T11:45:35.142584+0000","last_became_peered":"2023-05-17T11:45:35.142584+0000","last_unstale":"2023-05-17T11:45:37.178234+0000","last_undegraded":"2023-05-17T11:45:37.178234+0000","last_fullsized":"2023-05-17T11:45:37.178234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:53.799577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.549356+0000","last_change":"2023-05-17T11:45:35.536915+0000","last_active":"2023-05-17T11:45:35.549356+0000","last_peered":"2023-05-17T11:45:35.549356+0000","last_clean":"2023-05-17T11:45:35.549356+0000","last_became_active":"2023-05-17T11:45:35.536543+0000","last_became_peered":"2023-05-17T11:45:35.536543+0000","last_unstale":"2023-05-17T11:45:35.549356+0000","last_undegraded":"2023-05-17T11:45:35.549356+0000","last_fullsized":"2023-05-17T11:45:35.549356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:25:32.647449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.524558+0000","last_change":"2023-05-17T11:45:35.137585+0000","last_active":"2023-05-17T11:45:35.524558+0000","last_peered":"2023-05-17T11:45:35.524558+0000","last_clean":"2023-05-17T11:45:35.524558+0000","last_became_active":"2023-05-17T11:45:35.137054+0000","last_became_peered":"2023-05-17T11:45:35.137054+0000","last_unstale":"2023-05-17T11:45:35.524558+0000","last_undegraded":"2023-05-17T11:45:35.524558+0000","last_fullsized":"2023-05-17T11:45:35.524558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:24:12.263401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557949+0000","last_change":"2023-05-17T11:45:35.550175+0000","last_active":"2023-05-17T11:45:35.557949+0000","last_peered":"2023-05-17T11:45:35.557949+0000","last_clean":"2023-05-17T11:45:35.557949+0000","last_became_active":"2023-05-17T11:45:35.549881+0000","last_became_peered":"2023-05-17T11:45:35.549881+0000","last_unstale":"2023-05-17T11:45:35.557949+0000","last_undegraded":"2023-05-17T11:45:35.557949+0000","last_fullsized":"2023-05-17T11:45:35.557949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:54.806823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521247+0000","last_change":"2023-05-17T11:45:35.144989+0000","last_active":"2023-05-17T11:45:36.521247+0000","last_peered":"2023-05-17T11:45:36.521247+0000","last_clean":"2023-05-17T11:45:36.521247+0000","last_became_active":"2023-05-17T11:45:35.144819+0000","last_became_peered":"2023-05-17T11:45:35.144819+0000","last_unstale":"2023-05-17T11:45:36.521247+0000","last_undegraded":"2023-05-17T11:45:36.521247+0000","last_fullsized":"2023-05-17T11:45:36.521247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:03.684194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519767+0000","last_change":"2023-05-17T11:45:35.537836+0000","last_active":"2023-05-17T11:45:36.519767+0000","last_peered":"2023-05-17T11:45:36.519767+0000","last_clean":"2023-05-17T11:45:36.519767+0000","last_became_active":"2023-05-17T11:45:35.536405+0000","last_became_peered":"2023-05-17T11:45:35.536405+0000","last_unstale":"2023-05-17T11:45:36.519767+0000","last_undegraded":"2023-05-17T11:45:36.519767+0000","last_fullsized":"2023-05-17T11:45:36.519767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.532815+0000","last_change":"2023-05-17T11:45:23.894807+0000","last_active":"2023-05-17T11:45:35.532815+0000","last_peered":"2023-05-17T11:45:35.532815+0000","last_clean":"2023-05-17T11:45:35.532815+0000","last_became_active":"2023-05-17T11:45:23.894516+0000","last_became_peered":"2023-05-17T11:45:23.894516+0000","last_unstale":"2023-05-17T11:45:35.532815+0000","last_undegraded":"2023-05-17T11:45:35.532815+0000","last_fullsized":"2023-05-17T11:45:35.532815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_clean_scrub_stamp":"2023-05-17T11:45:22.596969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:15.915777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521380+0000","last_change":"2023-05-17T11:45:30.089866+0000","last_active":"2023-05-17T11:45:36.521380+0000","last_peered":"2023-05-17T11:45:36.521380+0000","last_clean":"2023-05-17T11:45:36.521380+0000","last_became_active":"2023-05-17T11:45:30.089207+0000","last_became_peered":"2023-05-17T11:45:30.089207+0000","last_unstale":"2023-05-17T11:45:36.521380+0000","last_undegraded":"2023-05-17T11:45:36.521380+0000","last_fullsized":"2023-05-17T11:45:36.521380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:27.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521342+0000","last_change":"2023-05-17T11:45:35.140973+0000","last_active":"2023-05-17T11:45:36.521342+0000","last_peered":"2023-05-17T11:45:36.521342+0000","last_clean":"2023-05-17T11:45:36.521342+0000","last_became_active":"2023-05-17T11:45:35.140590+0000","last_became_peered":"2023-05-17T11:45:35.140590+0000","last_unstale":"2023-05-17T11:45:36.521342+0000","last_undegraded":"2023-05-17T11:45:36.521342+0000","last_fullsized":"2023-05-17T11:45:36.521342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:32.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178394+0000","last_change":"2023-05-17T11:45:35.552628+0000","last_active":"2023-05-17T11:45:37.178394+0000","last_peered":"2023-05-17T11:45:37.178394+0000","last_clean":"2023-05-17T11:45:37.178394+0000","last_became_active":"2023-05-17T11:45:35.552298+0000","last_became_peered":"2023-05-17T11:45:35.552298+0000","last_unstale":"2023-05-17T11:45:37.178394+0000","last_undegraded":"2023-05-17T11:45:37.178394+0000","last_fullsized":"2023-05-17T11:45:37.178394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.532690+0000","last_change":"2023-05-17T11:45:30.093107+0000","last_active":"2023-05-17T11:45:35.532690+0000","last_peered":"2023-05-17T11:45:35.532690+0000","last_clean":"2023-05-17T11:45:35.532690+0000","last_became_active":"2023-05-17T11:45:30.092684+0000","last_became_peered":"2023-05-17T11:45:30.092684+0000","last_unstale":"2023-05-17T11:45:35.532690+0000","last_undegraded":"2023-05-17T11:45:35.532690+0000","last_fullsized":"2023-05-17T11:45:35.532690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:14.681922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.524409+0000","last_change":"2023-05-17T11:45:35.135037+0000","last_active":"2023-05-17T11:45:35.524409+0000","last_peered":"2023-05-17T11:45:35.524409+0000","last_clean":"2023-05-17T11:45:35.524409+0000","last_became_active":"2023-05-17T11:45:35.134656+0000","last_became_peered":"2023-05-17T11:45:35.134656+0000","last_unstale":"2023-05-17T11:45:35.524409+0000","last_undegraded":"2023-05-17T11:45:35.524409+0000","last_fullsized":"2023-05-17T11:45:35.524409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:23.222428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.545410+0000","last_change":"2023-05-17T11:45:35.541264+0000","last_active":"2023-05-17T11:45:35.545410+0000","last_peered":"2023-05-17T11:45:35.545410+0000","last_clean":"2023-05-17T11:45:35.545410+0000","last_became_active":"2023-05-17T11:45:35.541014+0000","last_became_peered":"2023-05-17T11:45:35.541014+0000","last_unstale":"2023-05-17T11:45:35.545410+0000","last_undegraded":"2023-05-17T11:45:35.545410+0000","last_fullsized":"2023-05-17T11:45:35.545410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:10:29.041251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.514537+0000","last_change":"2023-05-17T11:45:30.096072+0000","last_active":"2023-05-17T11:45:35.514537+0000","last_peered":"2023-05-17T11:45:35.514537+0000","last_clean":"2023-05-17T11:45:35.514537+0000","last_became_active":"2023-05-17T11:45:30.095647+0000","last_became_peered":"2023-05-17T11:45:30.095647+0000","last_unstale":"2023-05-17T11:45:35.514537+0000","last_undegraded":"2023-05-17T11:45:35.514537+0000","last_fullsized":"2023-05-17T11:45:35.514537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:07.189741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519445+0000","last_change":"2023-05-17T11:45:35.129591+0000","last_active":"2023-05-17T11:45:36.519445+0000","last_peered":"2023-05-17T11:45:36.519445+0000","last_clean":"2023-05-17T11:45:36.519445+0000","last_became_active":"2023-05-17T11:45:35.129301+0000","last_became_peered":"2023-05-17T11:45:35.129301+0000","last_unstale":"2023-05-17T11:45:36.519445+0000","last_undegraded":"2023-05-17T11:45:36.519445+0000","last_fullsized":"2023-05-17T11:45:36.519445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:18.795908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520150+0000","last_change":"2023-05-17T11:45:35.534133+0000","last_active":"2023-05-17T11:45:36.520150+0000","last_peered":"2023-05-17T11:45:36.520150+0000","last_clean":"2023-05-17T11:45:36.520150+0000","last_became_active":"2023-05-17T11:45:35.533661+0000","last_became_peered":"2023-05-17T11:45:35.533661+0000","last_unstale":"2023-05-17T11:45:36.520150+0000","last_undegraded":"2023-05-17T11:45:36.520150+0000","last_fullsized":"2023-05-17T11:45:36.520150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521322+0000","last_change":"2023-05-17T11:45:30.084716+0000","last_active":"2023-05-17T11:45:36.521322+0000","last_peered":"2023-05-17T11:45:36.521322+0000","last_clean":"2023-05-17T11:45:36.521322+0000","last_became_active":"2023-05-17T11:45:30.084340+0000","last_became_peered":"2023-05-17T11:45:30.084340+0000","last_unstale":"2023-05-17T11:45:36.521322+0000","last_undegraded":"2023-05-17T11:45:36.521322+0000","last_fullsized":"2023-05-17T11:45:36.521322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:35:58.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.526283+0000","last_change":"2023-05-17T11:45:35.142948+0000","last_active":"2023-05-17T11:45:35.526283+0000","last_peered":"2023-05-17T11:45:35.526283+0000","last_clean":"2023-05-17T11:45:35.526283+0000","last_became_active":"2023-05-17T11:45:35.142653+0000","last_became_peered":"2023-05-17T11:45:35.142653+0000","last_unstale":"2023-05-17T11:45:35.526283+0000","last_undegraded":"2023-05-17T11:45:35.526283+0000","last_fullsized":"2023-05-17T11:45:35.526283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:19.716929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519660+0000","last_change":"2023-05-17T11:45:35.534568+0000","last_active":"2023-05-17T11:45:36.519660+0000","last_peered":"2023-05-17T11:45:36.519660+0000","last_clean":"2023-05-17T11:45:36.519660+0000","last_became_active":"2023-05-17T11:45:35.534170+0000","last_became_peered":"2023-05-17T11:45:35.534170+0000","last_unstale":"2023-05-17T11:45:36.519660+0000","last_undegraded":"2023-05-17T11:45:36.519660+0000","last_fullsized":"2023-05-17T11:45:36.519660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521950+0000","last_change":"2023-05-17T11:45:35.146757+0000","last_active":"2023-05-17T11:45:36.521950+0000","last_peered":"2023-05-17T11:45:36.521950+0000","last_clean":"2023-05-17T11:45:36.521950+0000","last_became_active":"2023-05-17T11:45:35.146469+0000","last_became_peered":"2023-05-17T11:45:35.146469+0000","last_unstale":"2023-05-17T11:45:36.521950+0000","last_undegraded":"2023-05-17T11:45:36.521950+0000","last_fullsized":"2023-05-17T11:45:36.521950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:07.960059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519815+0000","last_change":"2023-05-17T11:45:30.647020+0000","last_active":"2023-05-17T11:45:36.519815+0000","last_peered":"2023-05-17T11:45:36.519815+0000","last_clean":"2023-05-17T11:45:36.519815+0000","last_became_active":"2023-05-17T11:45:30.646621+0000","last_became_peered":"2023-05-17T11:45:30.646621+0000","last_unstale":"2023-05-17T11:45:36.519815+0000","last_undegraded":"2023-05-17T11:45:36.519815+0000","last_fullsized":"2023-05-17T11:45:36.519815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:43.929512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519875+0000","last_change":"2023-05-17T11:45:35.534583+0000","last_active":"2023-05-17T11:45:36.519875+0000","last_peered":"2023-05-17T11:45:36.519875+0000","last_clean":"2023-05-17T11:45:36.519875+0000","last_became_active":"2023-05-17T11:45:35.533116+0000","last_became_peered":"2023-05-17T11:45:35.533116+0000","last_unstale":"2023-05-17T11:45:36.519875+0000","last_undegraded":"2023-05-17T11:45:36.519875+0000","last_fullsized":"2023-05-17T11:45:36.519875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519724+0000","last_change":"2023-05-17T11:45:35.129695+0000","last_active":"2023-05-17T11:45:36.519724+0000","last_peered":"2023-05-17T11:45:36.519724+0000","last_clean":"2023-05-17T11:45:36.519724+0000","last_became_active":"2023-05-17T11:45:35.129376+0000","last_became_peered":"2023-05-17T11:45:35.129376+0000","last_unstale":"2023-05-17T11:45:36.519724+0000","last_undegraded":"2023-05-17T11:45:36.519724+0000","last_fullsized":"2023-05-17T11:45:36.519724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.542100+0000","last_change":"2023-05-17T11:45:30.647758+0000","last_active":"2023-05-17T11:45:35.542100+0000","last_peered":"2023-05-17T11:45:35.542100+0000","last_clean":"2023-05-17T11:45:35.542100+0000","last_became_active":"2023-05-17T11:45:30.647423+0000","last_became_peered":"2023-05-17T11:45:30.647423+0000","last_unstale":"2023-05-17T11:45:35.542100+0000","last_undegraded":"2023-05-17T11:45:35.542100+0000","last_fullsized":"2023-05-17T11:45:35.542100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:27.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.541731+0000","last_change":"2023-05-17T11:45:35.536548+0000","last_active":"2023-05-17T11:45:35.541731+0000","last_peered":"2023-05-17T11:45:35.541731+0000","last_clean":"2023-05-17T11:45:35.541731+0000","last_became_active":"2023-05-17T11:45:35.535873+0000","last_became_peered":"2023-05-17T11:45:35.535873+0000","last_unstale":"2023-05-17T11:45:35.541731+0000","last_undegraded":"2023-05-17T11:45:35.541731+0000","last_fullsized":"2023-05-17T11:45:35.541731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:55:31.094625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521680+0000","last_change":"2023-05-17T11:45:35.144973+0000","last_active":"2023-05-17T11:45:36.521680+0000","last_peered":"2023-05-17T11:45:36.521680+0000","last_clean":"2023-05-17T11:45:36.521680+0000","last_became_active":"2023-05-17T11:45:35.144558+0000","last_became_peered":"2023-05-17T11:45:35.144558+0000","last_unstale":"2023-05-17T11:45:36.521680+0000","last_undegraded":"2023-05-17T11:45:36.521680+0000","last_fullsized":"2023-05-17T11:45:36.521680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520015+0000","last_change":"2023-05-17T11:45:30.087244+0000","last_active":"2023-05-17T11:45:36.520015+0000","last_peered":"2023-05-17T11:45:36.520015+0000","last_clean":"2023-05-17T11:45:36.520015+0000","last_became_active":"2023-05-17T11:45:30.086890+0000","last_became_peered":"2023-05-17T11:45:30.086890+0000","last_unstale":"2023-05-17T11:45:36.520015+0000","last_undegraded":"2023-05-17T11:45:36.520015+0000","last_fullsized":"2023-05-17T11:45:36.520015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:35.074387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521122+0000","last_change":"2023-05-17T11:45:35.534336+0000","last_active":"2023-05-17T11:45:36.521122+0000","last_peered":"2023-05-17T11:45:36.521122+0000","last_clean":"2023-05-17T11:45:36.521122+0000","last_became_active":"2023-05-17T11:45:35.533768+0000","last_became_peered":"2023-05-17T11:45:35.533768+0000","last_unstale":"2023-05-17T11:45:36.521122+0000","last_undegraded":"2023-05-17T11:45:36.521122+0000","last_fullsized":"2023-05-17T11:45:36.521122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.527576+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:35.527576+0000","last_peered":"2023-05-17T11:45:35.527576+0000","last_clean":"2023-05-17T11:45:35.527576+0000","last_became_active":"2023-05-17T11:45:35.138278+0000","last_became_peered":"2023-05-17T11:45:35.138278+0000","last_unstale":"2023-05-17T11:45:35.527576+0000","last_undegraded":"2023-05-17T11:45:35.527576+0000","last_fullsized":"2023-05-17T11:45:35.527576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:53.799577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178430+0000","last_change":"2023-05-17T11:45:30.088456+0000","last_active":"2023-05-17T11:45:37.178430+0000","last_peered":"2023-05-17T11:45:37.178430+0000","last_clean":"2023-05-17T11:45:37.178430+0000","last_became_active":"2023-05-17T11:45:30.088082+0000","last_became_peered":"2023-05-17T11:45:30.088082+0000","last_unstale":"2023-05-17T11:45:37.178430+0000","last_undegraded":"2023-05-17T11:45:37.178430+0000","last_fullsized":"2023-05-17T11:45:37.178430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:22.386463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.548675+0000","last_change":"2023-05-17T11:45:35.538184+0000","last_active":"2023-05-17T11:45:35.548675+0000","last_peered":"2023-05-17T11:45:35.548675+0000","last_clean":"2023-05-17T11:45:35.548675+0000","last_became_active":"2023-05-17T11:45:35.537967+0000","last_became_peered":"2023-05-17T11:45:35.537967+0000","last_unstale":"2023-05-17T11:45:35.548675+0000","last_undegraded":"2023-05-17T11:45:35.548675+0000","last_fullsized":"2023-05-17T11:45:35.548675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:37:00.455903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557948+0000","last_change":"2023-05-17T11:45:35.551187+0000","last_active":"2023-05-17T11:45:35.557948+0000","last_peered":"2023-05-17T11:45:35.557948+0000","last_clean":"2023-05-17T11:45:35.557948+0000","last_became_active":"2023-05-17T11:45:35.550919+0000","last_became_peered":"2023-05-17T11:45:35.550919+0000","last_unstale":"2023-05-17T11:45:35.557948+0000","last_undegraded":"2023-05-17T11:45:35.557948+0000","last_fullsized":"2023-05-17T11:45:35.557948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:36:26.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.561704+0000","last_change":"2023-05-17T11:45:35.143591+0000","last_active":"2023-05-17T11:45:35.561704+0000","last_peered":"2023-05-17T11:45:35.561704+0000","last_clean":"2023-05-17T11:45:35.561704+0000","last_became_active":"2023-05-17T11:45:35.143258+0000","last_became_peered":"2023-05-17T11:45:35.143258+0000","last_unstale":"2023-05-17T11:45:35.561704+0000","last_undegraded":"2023-05-17T11:45:35.561704+0000","last_fullsized":"2023-05-17T11:45:35.561704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:27.421470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519735+0000","last_change":"2023-05-17T11:45:35.546190+0000","last_active":"2023-05-17T11:45:36.519735+0000","last_peered":"2023-05-17T11:45:36.519735+0000","last_clean":"2023-05-17T11:45:36.519735+0000","last_became_active":"2023-05-17T11:45:35.545718+0000","last_became_peered":"2023-05-17T11:45:35.545718+0000","last_unstale":"2023-05-17T11:45:36.519735+0000","last_undegraded":"2023-05-17T11:45:36.519735+0000","last_fullsized":"2023-05-17T11:45:36.519735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559652+0000","last_change":"2023-05-17T11:45:35.146268+0000","last_active":"2023-05-17T11:45:35.559652+0000","last_peered":"2023-05-17T11:45:35.559652+0000","last_clean":"2023-05-17T11:45:35.559652+0000","last_became_active":"2023-05-17T11:45:35.145917+0000","last_became_peered":"2023-05-17T11:45:35.145917+0000","last_unstale":"2023-05-17T11:45:35.559652+0000","last_undegraded":"2023-05-17T11:45:35.559652+0000","last_fullsized":"2023-05-17T11:45:35.559652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521793+0000","last_change":"2023-05-17T11:45:35.138653+0000","last_active":"2023-05-17T11:45:36.521793+0000","last_peered":"2023-05-17T11:45:36.521793+0000","last_clean":"2023-05-17T11:45:36.521793+0000","last_became_active":"2023-05-17T11:45:35.138291+0000","last_became_peered":"2023-05-17T11:45:35.138291+0000","last_unstale":"2023-05-17T11:45:36.521793+0000","last_undegraded":"2023-05-17T11:45:36.521793+0000","last_fullsized":"2023-05-17T11:45:36.521793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521323+0000","last_change":"2023-05-17T11:45:35.535628+0000","last_active":"2023-05-17T11:45:36.521323+0000","last_peered":"2023-05-17T11:45:36.521323+0000","last_clean":"2023-05-17T11:45:36.521323+0000","last_became_active":"2023-05-17T11:45:35.535341+0000","last_became_peered":"2023-05-17T11:45:35.535341+0000","last_unstale":"2023-05-17T11:45:36.521323+0000","last_undegraded":"2023-05-17T11:45:36.521323+0000","last_fullsized":"2023-05-17T11:45:36.521323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.530104+0000","last_change":"2023-05-17T11:45:35.138119+0000","last_active":"2023-05-17T11:45:35.530104+0000","last_peered":"2023-05-17T11:45:35.530104+0000","last_clean":"2023-05-17T11:45:35.530104+0000","last_became_active":"2023-05-17T11:45:35.137723+0000","last_became_peered":"2023-05-17T11:45:35.137723+0000","last_unstale":"2023-05-17T11:45:35.530104+0000","last_undegraded":"2023-05-17T11:45:35.530104+0000","last_fullsized":"2023-05-17T11:45:35.530104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:19.716929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521068+0000","last_change":"2023-05-17T11:45:35.535751+0000","last_active":"2023-05-17T11:45:36.521068+0000","last_peered":"2023-05-17T11:45:36.521068+0000","last_clean":"2023-05-17T11:45:36.521068+0000","last_became_active":"2023-05-17T11:45:35.535474+0000","last_became_peered":"2023-05-17T11:45:35.535474+0000","last_unstale":"2023-05-17T11:45:36.521068+0000","last_undegraded":"2023-05-17T11:45:36.521068+0000","last_fullsized":"2023-05-17T11:45:36.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:15:20.505190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178382+0000","last_change":"2023-05-17T11:45:35.546921+0000","last_active":"2023-05-17T11:45:37.178382+0000","last_peered":"2023-05-17T11:45:37.178382+0000","last_clean":"2023-05-17T11:45:37.178382+0000","last_became_active":"2023-05-17T11:45:35.546572+0000","last_became_peered":"2023-05-17T11:45:35.546572+0000","last_unstale":"2023-05-17T11:45:37.178382+0000","last_undegraded":"2023-05-17T11:45:37.178382+0000","last_fullsized":"2023-05-17T11:45:37.178382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:20.724175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521192+0000","last_change":"2023-05-17T11:45:35.141081+0000","last_active":"2023-05-17T11:45:36.521192+0000","last_peered":"2023-05-17T11:45:36.521192+0000","last_clean":"2023-05-17T11:45:36.521192+0000","last_became_active":"2023-05-17T11:45:35.140623+0000","last_became_peered":"2023-05-17T11:45:35.140623+0000","last_unstale":"2023-05-17T11:45:36.521192+0000","last_undegraded":"2023-05-17T11:45:36.521192+0000","last_fullsized":"2023-05-17T11:45:36.521192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:49.363470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538749+0000","last_change":"2023-05-17T11:45:35.534028+0000","last_active":"2023-05-17T11:45:35.538749+0000","last_peered":"2023-05-17T11:45:35.538749+0000","last_clean":"2023-05-17T11:45:35.538749+0000","last_became_active":"2023-05-17T11:45:35.533692+0000","last_became_peered":"2023-05-17T11:45:35.533692+0000","last_unstale":"2023-05-17T11:45:35.538749+0000","last_undegraded":"2023-05-17T11:45:35.538749+0000","last_fullsized":"2023-05-17T11:45:35.538749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:23:24.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519734+0000","last_change":"2023-05-17T11:45:35.146893+0000","last_active":"2023-05-17T11:45:36.519734+0000","last_peered":"2023-05-17T11:45:36.519734+0000","last_clean":"2023-05-17T11:45:36.519734+0000","last_became_active":"2023-05-17T11:45:35.146547+0000","last_became_peered":"2023-05-17T11:45:35.146547+0000","last_unstale":"2023-05-17T11:45:36.519734+0000","last_undegraded":"2023-05-17T11:45:36.519734+0000","last_fullsized":"2023-05-17T11:45:36.519734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:29.545146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521823+0000","last_change":"2023-05-17T11:45:35.534371+0000","last_active":"2023-05-17T11:45:36.521823+0000","last_peered":"2023-05-17T11:45:36.521823+0000","last_clean":"2023-05-17T11:45:36.521823+0000","last_became_active":"2023-05-17T11:45:35.534091+0000","last_became_peered":"2023-05-17T11:45:35.534091+0000","last_unstale":"2023-05-17T11:45:36.521823+0000","last_undegraded":"2023-05-17T11:45:36.521823+0000","last_fullsized":"2023-05-17T11:45:36.521823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546976+0000","last_change":"2023-05-17T11:45:35.139454+0000","last_active":"2023-05-17T11:45:35.546976+0000","last_peered":"2023-05-17T11:45:35.546976+0000","last_clean":"2023-05-17T11:45:35.546976+0000","last_became_active":"2023-05-17T11:45:35.138750+0000","last_became_peered":"2023-05-17T11:45:35.138750+0000","last_unstale":"2023-05-17T11:45:35.546976+0000","last_undegraded":"2023-05-17T11:45:35.546976+0000","last_fullsized":"2023-05-17T11:45:35.546976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:10:28.034005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.544765+0000","last_change":"2023-05-17T11:45:35.539372+0000","last_active":"2023-05-17T11:45:35.544765+0000","last_peered":"2023-05-17T11:45:35.544765+0000","last_clean":"2023-05-17T11:45:35.544765+0000","last_became_active":"2023-05-17T11:45:35.539059+0000","last_became_peered":"2023-05-17T11:45:35.539059+0000","last_unstale":"2023-05-17T11:45:35.544765+0000","last_undegraded":"2023-05-17T11:45:35.544765+0000","last_fullsized":"2023-05-17T11:45:35.544765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:24:26.208061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546975+0000","last_change":"2023-05-17T11:45:35.135013+0000","last_active":"2023-05-17T11:45:35.546975+0000","last_peered":"2023-05-17T11:45:35.546975+0000","last_clean":"2023-05-17T11:45:35.546975+0000","last_became_active":"2023-05-17T11:45:35.134702+0000","last_became_peered":"2023-05-17T11:45:35.134702+0000","last_unstale":"2023-05-17T11:45:35.546975+0000","last_undegraded":"2023-05-17T11:45:35.546975+0000","last_fullsized":"2023-05-17T11:45:35.546975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:36.287355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555382+0000","last_change":"2023-05-17T11:45:35.544396+0000","last_active":"2023-05-17T11:45:35.555382+0000","last_peered":"2023-05-17T11:45:35.555382+0000","last_clean":"2023-05-17T11:45:35.555382+0000","last_became_active":"2023-05-17T11:45:35.544113+0000","last_became_peered":"2023-05-17T11:45:35.544113+0000","last_unstale":"2023-05-17T11:45:35.555382+0000","last_undegraded":"2023-05-17T11:45:35.555382+0000","last_fullsized":"2023-05-17T11:45:35.555382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521540+0000","last_change":"2023-05-17T11:45:35.145692+0000","last_active":"2023-05-17T11:45:36.521540+0000","last_peered":"2023-05-17T11:45:36.521540+0000","last_clean":"2023-05-17T11:45:36.521540+0000","last_became_active":"2023-05-17T11:45:35.145352+0000","last_became_peered":"2023-05-17T11:45:35.145352+0000","last_unstale":"2023-05-17T11:45:36.521540+0000","last_undegraded":"2023-05-17T11:45:36.521540+0000","last_fullsized":"2023-05-17T11:45:36.521540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546825+0000","last_change":"2023-05-17T11:45:35.527750+0000","last_active":"2023-05-17T11:45:35.546825+0000","last_peered":"2023-05-17T11:45:35.546825+0000","last_clean":"2023-05-17T11:45:35.546825+0000","last_became_active":"2023-05-17T11:45:35.527428+0000","last_became_peered":"2023-05-17T11:45:35.527428+0000","last_unstale":"2023-05-17T11:45:35.546825+0000","last_undegraded":"2023-05-17T11:45:35.546825+0000","last_fullsized":"2023-05-17T11:45:35.546825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:24:13.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521918+0000","last_change":"2023-05-17T11:45:35.143811+0000","last_active":"2023-05-17T11:45:36.521918+0000","last_peered":"2023-05-17T11:45:36.521918+0000","last_clean":"2023-05-17T11:45:36.521918+0000","last_became_active":"2023-05-17T11:45:35.142921+0000","last_became_peered":"2023-05-17T11:45:35.142921+0000","last_unstale":"2023-05-17T11:45:36.521918+0000","last_undegraded":"2023-05-17T11:45:36.521918+0000","last_fullsized":"2023-05-17T11:45:36.521918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:24.352254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521461+0000","last_change":"2023-05-17T11:45:35.532708+0000","last_active":"2023-05-17T11:45:36.521461+0000","last_peered":"2023-05-17T11:45:36.521461+0000","last_clean":"2023-05-17T11:45:36.521461+0000","last_became_active":"2023-05-17T11:45:35.532426+0000","last_became_peered":"2023-05-17T11:45:35.532426+0000","last_unstale":"2023-05-17T11:45:36.521461+0000","last_undegraded":"2023-05-17T11:45:36.521461+0000","last_fullsized":"2023-05-17T11:45:36.521461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521732+0000","last_change":"2023-05-17T11:45:35.140853+0000","last_active":"2023-05-17T11:45:36.521732+0000","last_peered":"2023-05-17T11:45:36.521732+0000","last_clean":"2023-05-17T11:45:36.521732+0000","last_became_active":"2023-05-17T11:45:35.140321+0000","last_became_peered":"2023-05-17T11:45:35.140321+0000","last_unstale":"2023-05-17T11:45:36.521732+0000","last_undegraded":"2023-05-17T11:45:36.521732+0000","last_fullsized":"2023-05-17T11:45:36.521732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557940+0000","last_change":"2023-05-17T11:45:35.551649+0000","last_active":"2023-05-17T11:45:35.557940+0000","last_peered":"2023-05-17T11:45:35.557940+0000","last_clean":"2023-05-17T11:45:35.557940+0000","last_became_active":"2023-05-17T11:45:35.551298+0000","last_became_peered":"2023-05-17T11:45:35.551298+0000","last_unstale":"2023-05-17T11:45:35.557940+0000","last_undegraded":"2023-05-17T11:45:35.557940+0000","last_fullsized":"2023-05-17T11:45:35.557940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:13.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546322+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:35.546322+0000","last_peered":"2023-05-17T11:45:35.546322+0000","last_clean":"2023-05-17T11:45:35.546322+0000","last_became_active":"2023-05-17T11:45:35.138958+0000","last_became_peered":"2023-05-17T11:45:35.138958+0000","last_unstale":"2023-05-17T11:45:35.546322+0000","last_undegraded":"2023-05-17T11:45:35.546322+0000","last_fullsized":"2023-05-17T11:45:35.546322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:04.077222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13192,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358648,"statfs":{"total":96636764160,"available":96623255552,"internally_reserved":0,"allocated":851968,"data_stored":675094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12072,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359768,"statfs":{"total":96636764160,"available":96624402432,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12092,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359748,"statfs":{"total":96636764160,"available":96624381952,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12156,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359684,"statfs":{"total":96636764160,"available":96624316416,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7912,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363928,"statfs":{"total":96636764160,"available":96628662272,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T11:45:39.606 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T11:45:39.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 Processor -- start 2023-05-17T11:45:39.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 -- start start 2023-05-17T11:45:39.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca1015c1c0 0x7fca100b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fca100d0e40 0x7fca100b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100b1e30 0x7fca1015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca100b1c80 con 0x7fca100d0e40 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1006b790 con 0x7fca1015c1c0 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca157cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1006ae60 con 0x7fca100b1e30 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fca100d0e40 0x7fca100b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fca100d0e40 0x7fca100b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51478/0 (socket says 172.21.15.3:51478) 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 -- 172.21.15.3:0/1108958955 learned_addr learned my addr 172.21.15.3:0/1108958955 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:39.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0effd640 1 --2- 172.21.15.3:0/1108958955 >> v2:172.21.15.60:3300/0 conn(0x7fca1015c1c0 0x7fca100b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0f7fe640 1 --2- 172.21.15.3:0/1108958955 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100b1e30 0x7fca1015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 -- 172.21.15.3:0/1108958955 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100b1e30 msgr2=0x7fca1015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:39.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 --2- 172.21.15.3:0/1108958955 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100b1e30 0x7fca1015fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 -- 172.21.15.3:0/1108958955 >> v2:172.21.15.60:3300/0 conn(0x7fca1015c1c0 msgr2=0x7fca100b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:39.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 --2- 172.21.15.3:0/1108958955 >> v2:172.21.15.60:3300/0 conn(0x7fca1015c1c0 0x7fca100b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.771+0000 7fca0e7fc640 1 -- 172.21.15.3:0/1108958955 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1006b140 con 0x7fca100d0e40 2023-05-17T11:45:39.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca0e7fc640 1 --2- 172.21.15.3:0/1108958955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100d0e40 0x7fca100b48b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca1008b880 tx=0x7fca0401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bf6992e65dd84 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca0dffb640 1 -- 172.21.15.3:0/1108958955 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca040ab600 con 0x7fca100d0e40 2023-05-17T11:45:39.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca0dffb640 1 -- 172.21.15.3:0/1108958955 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca040a7050 con 0x7fca100d0e40 2023-05-17T11:45:39.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca0dffb640 1 -- 172.21.15.3:0/1108958955 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca040ab980 con 0x7fca100d0e40 2023-05-17T11:45:39.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 -- 172.21.15.3:0/1108958955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100d0e40 msgr2=0x7fca100b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 --2- 172.21.15.3:0/1108958955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100d0e40 0x7fca100b48b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca1008b880 tx=0x7fca0401c180 comp rx=0 tx=0).stop 2023-05-17T11:45:39.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 -- 172.21.15.3:0/1108958955 shutdown_connections 2023-05-17T11:45:39.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 --2- 172.21.15.3:0/1108958955 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100b1e30 0x7fca1015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 --2- 172.21.15.3:0/1108958955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100d0e40 0x7fca100b48b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 --2- 172.21.15.3:0/1108958955 >> v2:172.21.15.60:3300/0 conn(0x7fca1015c1c0 0x7fca100b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 -- 172.21.15.3:0/1108958955 >> 172.21.15.3:0/1108958955 conn(0x7fca1009bc30 msgr2=0x7fca100d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:39.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 -- 172.21.15.3:0/1108958955 shutdown_connections 2023-05-17T11:45:39.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 -- 172.21.15.3:0/1108958955 wait complete. 2023-05-17T11:45:39.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 Processor -- start 2023-05-17T11:45:39.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.775+0000 7fca157cb640 1 -- start start 2023-05-17T11:45:39.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 0x7fca100b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100d0e40 0x7fca1015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca1015c1c0 0x7fca100c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca100b8710 con 0x7fca100b1e30 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10152510 con 0x7fca1015c1c0 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca100c8eb0 con 0x7fca100d0e40 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 0x7fca100b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 0x7fca100b81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51494/0 (socket says 172.21.15.3:51494) 2023-05-17T11:45:39.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 -- 172.21.15.3:0/4209519831 learned_addr learned my addr 172.21.15.3:0/4209519831 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:39.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0e7fc640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100d0e40 0x7fca1015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0f7fe640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca1015c1c0 0x7fca100c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 -- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100d0e40 msgr2=0x7fca1015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100d0e40 0x7fca1015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 -- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca1015c1c0 msgr2=0x7fca100c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca1015c1c0 0x7fca100c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 -- 172.21.15.3:0/4209519831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040094d0 con 0x7fca100b1e30 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca0effd640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 0x7fca100b81d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca0000e870 tx=0x7fca0000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00009510 con 0x7fca100b1e30 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000eec0 con 0x7fca100b1e30 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1015c720 con 0x7fca100b1e30 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000cb40 con 0x7fca100b1e30 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1015c590 con 0x7fca100b1e30 2023-05-17T11:45:39.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.779+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca100af420 con 0x7fca100b1e30 2023-05-17T11:45:39.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.783+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca0000cca0 con 0x7fca100b1e30 2023-05-17T11:45:39.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.783+0000 7fc9f77fe640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc9fc0662b0 0x7fc9fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:39.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.783+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca00083de0 con 0x7fca100b1e30 2023-05-17T11:45:39.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.783+0000 7fca0e7fc640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc9fc0662b0 0x7fc9fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:39.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.783+0000 7fca0e7fc640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc9fc0662b0 0x7fc9fc068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca040ad000 tx=0x7fca04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:39.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.787+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fca00051270 con 0x7fca100b1e30 2023-05-17T11:45:39.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.935+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 --> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca10067130 con 0x7fc9fc0662b0 2023-05-17T11:45:39.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.943+0000 7fc9f77fe640 1 -- 172.21.15.3:0/4209519831 <== mgr.4110 v2:172.21.15.3:6832/2126677587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286737 (secure 0 0 0) 0x7fca10067130 con 0x7fc9fc0662b0 2023-05-17T11:45:39.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:39.958 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-05-17T11:45:39.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc9fc0662b0 msgr2=0x7fc9fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc9fc0662b0 0x7fc9fc068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca040ad000 tx=0x7fca04008040 comp rx=0 tx=0).stop 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 msgr2=0x7fca100b81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 0x7fca100b81d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca0000e870 tx=0x7fca0000ec70 comp rx=0 tx=0).stop 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 shutdown_connections 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc9fc0662b0 0x7fc9fc068760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca1015c1c0 0x7fca100c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fca100d0e40 0x7fca1015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 --2- 172.21.15.3:0/4209519831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca100b1e30 0x7fca100b81d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:39.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 >> 172.21.15.3:0/4209519831 conn(0x7fca1009bc30 msgr2=0x7fca100b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:39.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 shutdown_connections 2023-05-17T11:45:39.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:39.947+0000 7fca157cb640 1 -- 172.21.15.3:0/4209519831 wait complete. 2023-05-17T11:45:39.974 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-17T11:45:38.527442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82540,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":754892180,"statfs":{"total":773094113280,"available":773009592320,"internally_reserved":0,"allocated":3125248,"data_stored":1868987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.416593"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.535482+0000","last_change":"2023-05-17T11:45:35.531488+0000","last_active":"2023-05-17T11:45:35.535482+0000","last_peered":"2023-05-17T11:45:35.535482+0000","last_clean":"2023-05-17T11:45:35.535482+0000","last_became_active":"2023-05-17T11:45:35.531185+0000","last_became_peered":"2023-05-17T11:45:35.531185+0000","last_unstale":"2023-05-17T11:45:35.535482+0000","last_undegraded":"2023-05-17T11:45:35.535482+0000","last_fullsized":"2023-05-17T11:45:35.535482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:37:00.455903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521624+0000","last_change":"2023-05-17T11:45:35.539055+0000","last_active":"2023-05-17T11:45:36.521624+0000","last_peered":"2023-05-17T11:45:36.521624+0000","last_clean":"2023-05-17T11:45:36.521624+0000","last_became_active":"2023-05-17T11:45:35.538706+0000","last_became_peered":"2023-05-17T11:45:35.538706+0000","last_unstale":"2023-05-17T11:45:36.521624+0000","last_undegraded":"2023-05-17T11:45:36.521624+0000","last_fullsized":"2023-05-17T11:45:36.521624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555629+0000","last_change":"2023-05-17T11:45:35.543264+0000","last_active":"2023-05-17T11:45:35.555629+0000","last_peered":"2023-05-17T11:45:35.555629+0000","last_clean":"2023-05-17T11:45:35.555629+0000","last_became_active":"2023-05-17T11:45:35.542323+0000","last_became_peered":"2023-05-17T11:45:35.542323+0000","last_unstale":"2023-05-17T11:45:35.555629+0000","last_undegraded":"2023-05-17T11:45:35.555629+0000","last_fullsized":"2023-05-17T11:45:35.555629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178187+0000","last_change":"2023-05-17T11:45:35.547666+0000","last_active":"2023-05-17T11:45:37.178187+0000","last_peered":"2023-05-17T11:45:37.178187+0000","last_clean":"2023-05-17T11:45:37.178187+0000","last_became_active":"2023-05-17T11:45:35.547228+0000","last_became_peered":"2023-05-17T11:45:35.547228+0000","last_unstale":"2023-05-17T11:45:37.178187+0000","last_undegraded":"2023-05-17T11:45:37.178187+0000","last_fullsized":"2023-05-17T11:45:37.178187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538325+0000","last_change":"2023-05-17T11:45:35.530614+0000","last_active":"2023-05-17T11:45:35.538325+0000","last_peered":"2023-05-17T11:45:35.538325+0000","last_clean":"2023-05-17T11:45:35.538325+0000","last_became_active":"2023-05-17T11:45:35.529983+0000","last_became_peered":"2023-05-17T11:45:35.529983+0000","last_unstale":"2023-05-17T11:45:35.538325+0000","last_undegraded":"2023-05-17T11:45:35.538325+0000","last_fullsized":"2023-05-17T11:45:35.538325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:19.352747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.548719+0000","last_change":"2023-05-17T11:45:35.534671+0000","last_active":"2023-05-17T11:45:35.548719+0000","last_peered":"2023-05-17T11:45:35.548719+0000","last_clean":"2023-05-17T11:45:35.548719+0000","last_became_active":"2023-05-17T11:45:35.534089+0000","last_became_peered":"2023-05-17T11:45:35.534089+0000","last_unstale":"2023-05-17T11:45:35.548719+0000","last_undegraded":"2023-05-17T11:45:35.548719+0000","last_fullsized":"2023-05-17T11:45:35.548719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:24:26.208061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559627+0000","last_change":"2023-05-17T11:45:35.556495+0000","last_active":"2023-05-17T11:45:35.559627+0000","last_peered":"2023-05-17T11:45:35.559627+0000","last_clean":"2023-05-17T11:45:35.559627+0000","last_became_active":"2023-05-17T11:45:35.556172+0000","last_became_peered":"2023-05-17T11:45:35.556172+0000","last_unstale":"2023-05-17T11:45:35.559627+0000","last_undegraded":"2023-05-17T11:45:35.559627+0000","last_fullsized":"2023-05-17T11:45:35.559627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:15:20.505190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521284+0000","last_change":"2023-05-17T11:45:35.545750+0000","last_active":"2023-05-17T11:45:36.521284+0000","last_peered":"2023-05-17T11:45:36.521284+0000","last_clean":"2023-05-17T11:45:36.521284+0000","last_became_active":"2023-05-17T11:45:35.543809+0000","last_became_peered":"2023-05-17T11:45:35.543809+0000","last_unstale":"2023-05-17T11:45:36.521284+0000","last_undegraded":"2023-05-17T11:45:36.521284+0000","last_fullsized":"2023-05-17T11:45:36.521284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546272+0000","last_change":"2023-05-17T11:45:35.533284+0000","last_active":"2023-05-17T11:45:35.546272+0000","last_peered":"2023-05-17T11:45:35.546272+0000","last_clean":"2023-05-17T11:45:35.546272+0000","last_became_active":"2023-05-17T11:45:35.533036+0000","last_became_peered":"2023-05-17T11:45:35.533036+0000","last_unstale":"2023-05-17T11:45:35.546272+0000","last_undegraded":"2023-05-17T11:45:35.546272+0000","last_fullsized":"2023-05-17T11:45:35.546272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521791+0000","last_change":"2023-05-17T11:45:35.536658+0000","last_active":"2023-05-17T11:45:36.521791+0000","last_peered":"2023-05-17T11:45:36.521791+0000","last_clean":"2023-05-17T11:45:36.521791+0000","last_became_active":"2023-05-17T11:45:35.536150+0000","last_became_peered":"2023-05-17T11:45:35.536150+0000","last_unstale":"2023-05-17T11:45:36.521791+0000","last_undegraded":"2023-05-17T11:45:36.521791+0000","last_fullsized":"2023-05-17T11:45:36.521791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555650+0000","last_change":"2023-05-17T11:45:35.543512+0000","last_active":"2023-05-17T11:45:35.555650+0000","last_peered":"2023-05-17T11:45:35.555650+0000","last_clean":"2023-05-17T11:45:35.555650+0000","last_became_active":"2023-05-17T11:45:35.540333+0000","last_became_peered":"2023-05-17T11:45:35.540333+0000","last_unstale":"2023-05-17T11:45:35.555650+0000","last_undegraded":"2023-05-17T11:45:35.555650+0000","last_fullsized":"2023-05-17T11:45:35.555650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:55:31.094625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.549426+0000","last_change":"2023-05-17T11:45:35.542466+0000","last_active":"2023-05-17T11:45:35.549426+0000","last_peered":"2023-05-17T11:45:35.549426+0000","last_clean":"2023-05-17T11:45:35.549426+0000","last_became_active":"2023-05-17T11:45:35.542211+0000","last_became_peered":"2023-05-17T11:45:35.542211+0000","last_unstale":"2023-05-17T11:45:35.549426+0000","last_undegraded":"2023-05-17T11:45:35.549426+0000","last_fullsized":"2023-05-17T11:45:35.549426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:25:32.647449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.534498+0000","last_change":"2023-05-17T11:45:35.528858+0000","last_active":"2023-05-17T11:45:35.534498+0000","last_peered":"2023-05-17T11:45:35.534498+0000","last_clean":"2023-05-17T11:45:35.534498+0000","last_became_active":"2023-05-17T11:45:35.527334+0000","last_became_peered":"2023-05-17T11:45:35.527334+0000","last_unstale":"2023-05-17T11:45:35.534498+0000","last_undegraded":"2023-05-17T11:45:35.534498+0000","last_fullsized":"2023-05-17T11:45:35.534498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:19.352747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521378+0000","last_change":"2023-05-17T11:45:35.533168+0000","last_active":"2023-05-17T11:45:36.521378+0000","last_peered":"2023-05-17T11:45:36.521378+0000","last_clean":"2023-05-17T11:45:36.521378+0000","last_became_active":"2023-05-17T11:45:35.532752+0000","last_became_peered":"2023-05-17T11:45:35.532752+0000","last_unstale":"2023-05-17T11:45:36.521378+0000","last_undegraded":"2023-05-17T11:45:36.521378+0000","last_fullsized":"2023-05-17T11:45:36.521378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559646+0000","last_change":"2023-05-17T11:45:35.556519+0000","last_active":"2023-05-17T11:45:35.559646+0000","last_peered":"2023-05-17T11:45:35.559646+0000","last_clean":"2023-05-17T11:45:35.559646+0000","last_became_active":"2023-05-17T11:45:35.556187+0000","last_became_peered":"2023-05-17T11:45:35.556187+0000","last_unstale":"2023-05-17T11:45:35.559646+0000","last_undegraded":"2023-05-17T11:45:35.559646+0000","last_fullsized":"2023-05-17T11:45:35.559646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:19.803154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.548604+0000","last_change":"2023-05-17T11:45:35.535436+0000","last_active":"2023-05-17T11:45:35.548604+0000","last_peered":"2023-05-17T11:45:35.548604+0000","last_clean":"2023-05-17T11:45:35.548604+0000","last_became_active":"2023-05-17T11:45:35.535014+0000","last_became_peered":"2023-05-17T11:45:35.535014+0000","last_unstale":"2023-05-17T11:45:35.548604+0000","last_undegraded":"2023-05-17T11:45:35.548604+0000","last_fullsized":"2023-05-17T11:45:35.548604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:19.352747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538476+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:35.538476+0000","last_peered":"2023-05-17T11:45:35.538476+0000","last_clean":"2023-05-17T11:45:35.538476+0000","last_became_active":"2023-05-17T11:45:35.530050+0000","last_became_peered":"2023-05-17T11:45:35.530050+0000","last_unstale":"2023-05-17T11:45:35.538476+0000","last_undegraded":"2023-05-17T11:45:35.538476+0000","last_fullsized":"2023-05-17T11:45:35.538476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:25:32.647449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555134+0000","last_change":"2023-05-17T11:45:35.540996+0000","last_active":"2023-05-17T11:45:35.555134+0000","last_peered":"2023-05-17T11:45:35.555134+0000","last_clean":"2023-05-17T11:45:35.555134+0000","last_became_active":"2023-05-17T11:45:35.539704+0000","last_became_peered":"2023-05-17T11:45:35.539704+0000","last_unstale":"2023-05-17T11:45:35.555134+0000","last_undegraded":"2023-05-17T11:45:35.555134+0000","last_fullsized":"2023-05-17T11:45:35.555134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.550256+0000","last_change":"2023-05-17T11:45:35.545437+0000","last_active":"2023-05-17T11:45:35.550256+0000","last_peered":"2023-05-17T11:45:35.550256+0000","last_clean":"2023-05-17T11:45:35.550256+0000","last_became_active":"2023-05-17T11:45:35.545111+0000","last_became_peered":"2023-05-17T11:45:35.545111+0000","last_unstale":"2023-05-17T11:45:35.550256+0000","last_undegraded":"2023-05-17T11:45:35.550256+0000","last_fullsized":"2023-05-17T11:45:35.550256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:24:13.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.558015+0000","last_change":"2023-05-17T11:45:35.553620+0000","last_active":"2023-05-17T11:45:35.558015+0000","last_peered":"2023-05-17T11:45:35.558015+0000","last_clean":"2023-05-17T11:45:35.558015+0000","last_became_active":"2023-05-17T11:45:35.550862+0000","last_became_peered":"2023-05-17T11:45:35.550862+0000","last_unstale":"2023-05-17T11:45:35.558015+0000","last_undegraded":"2023-05-17T11:45:35.558015+0000","last_fullsized":"2023-05-17T11:45:35.558015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.560414+0000","last_change":"2023-05-17T11:45:35.559364+0000","last_active":"2023-05-17T11:45:35.560414+0000","last_peered":"2023-05-17T11:45:35.560414+0000","last_clean":"2023-05-17T11:45:35.560414+0000","last_became_active":"2023-05-17T11:45:35.558911+0000","last_became_peered":"2023-05-17T11:45:35.558911+0000","last_unstale":"2023-05-17T11:45:35.560414+0000","last_undegraded":"2023-05-17T11:45:35.560414+0000","last_fullsized":"2023-05-17T11:45:35.560414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.545601+0000","last_change":"2023-05-17T11:45:35.540513+0000","last_active":"2023-05-17T11:45:35.545601+0000","last_peered":"2023-05-17T11:45:35.545601+0000","last_clean":"2023-05-17T11:45:35.545601+0000","last_became_active":"2023-05-17T11:45:35.540257+0000","last_became_peered":"2023-05-17T11:45:35.540257+0000","last_unstale":"2023-05-17T11:45:35.545601+0000","last_undegraded":"2023-05-17T11:45:35.545601+0000","last_fullsized":"2023-05-17T11:45:35.545601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:24:26.208061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521091+0000","last_change":"2023-05-17T11:45:35.531180+0000","last_active":"2023-05-17T11:45:36.521091+0000","last_peered":"2023-05-17T11:45:36.521091+0000","last_clean":"2023-05-17T11:45:36.521091+0000","last_became_active":"2023-05-17T11:45:35.530904+0000","last_became_peered":"2023-05-17T11:45:35.530904+0000","last_unstale":"2023-05-17T11:45:36.521091+0000","last_undegraded":"2023-05-17T11:45:36.521091+0000","last_fullsized":"2023-05-17T11:45:36.521091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:19.803154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.558872+0000","last_change":"2023-05-17T11:45:35.543609+0000","last_active":"2023-05-17T11:45:35.558872+0000","last_peered":"2023-05-17T11:45:35.558872+0000","last_clean":"2023-05-17T11:45:35.558872+0000","last_became_active":"2023-05-17T11:45:35.543225+0000","last_became_peered":"2023-05-17T11:45:35.543225+0000","last_unstale":"2023-05-17T11:45:35.558872+0000","last_undegraded":"2023-05-17T11:45:35.558872+0000","last_fullsized":"2023-05-17T11:45:35.558872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519623+0000","last_change":"2023-05-17T11:45:35.546917+0000","last_active":"2023-05-17T11:45:36.519623+0000","last_peered":"2023-05-17T11:45:36.519623+0000","last_clean":"2023-05-17T11:45:36.519623+0000","last_became_active":"2023-05-17T11:45:35.546616+0000","last_became_peered":"2023-05-17T11:45:35.546616+0000","last_unstale":"2023-05-17T11:45:36.519623+0000","last_undegraded":"2023-05-17T11:45:36.519623+0000","last_fullsized":"2023-05-17T11:45:36.519623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520007+0000","last_change":"2023-05-17T11:45:35.535060+0000","last_active":"2023-05-17T11:45:36.520007+0000","last_peered":"2023-05-17T11:45:36.520007+0000","last_clean":"2023-05-17T11:45:36.520007+0000","last_became_active":"2023-05-17T11:45:35.534805+0000","last_became_peered":"2023-05-17T11:45:35.534805+0000","last_unstale":"2023-05-17T11:45:36.520007+0000","last_undegraded":"2023-05-17T11:45:36.520007+0000","last_fullsized":"2023-05-17T11:45:36.520007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521780+0000","last_change":"2023-05-17T11:45:35.542414+0000","last_active":"2023-05-17T11:45:36.521780+0000","last_peered":"2023-05-17T11:45:36.521780+0000","last_clean":"2023-05-17T11:45:36.521780+0000","last_became_active":"2023-05-17T11:45:35.542083+0000","last_became_peered":"2023-05-17T11:45:35.542083+0000","last_unstale":"2023-05-17T11:45:36.521780+0000","last_undegraded":"2023-05-17T11:45:36.521780+0000","last_fullsized":"2023-05-17T11:45:36.521780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519826+0000","last_change":"2023-05-17T11:45:35.538026+0000","last_active":"2023-05-17T11:45:36.519826+0000","last_peered":"2023-05-17T11:45:36.519826+0000","last_clean":"2023-05-17T11:45:36.519826+0000","last_became_active":"2023-05-17T11:45:35.534906+0000","last_became_peered":"2023-05-17T11:45:35.534906+0000","last_unstale":"2023-05-17T11:45:36.519826+0000","last_undegraded":"2023-05-17T11:45:36.519826+0000","last_fullsized":"2023-05-17T11:45:36.519826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521427+0000","last_change":"2023-05-17T11:45:35.545248+0000","last_active":"2023-05-17T11:45:36.521427+0000","last_peered":"2023-05-17T11:45:36.521427+0000","last_clean":"2023-05-17T11:45:36.521427+0000","last_became_active":"2023-05-17T11:45:35.544970+0000","last_became_peered":"2023-05-17T11:45:35.544970+0000","last_unstale":"2023-05-17T11:45:36.521427+0000","last_undegraded":"2023-05-17T11:45:36.521427+0000","last_fullsized":"2023-05-17T11:45:36.521427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557931+0000","last_change":"2023-05-17T11:45:35.553537+0000","last_active":"2023-05-17T11:45:35.557931+0000","last_peered":"2023-05-17T11:45:35.557931+0000","last_clean":"2023-05-17T11:45:35.557931+0000","last_became_active":"2023-05-17T11:45:35.551558+0000","last_became_peered":"2023-05-17T11:45:35.551558+0000","last_unstale":"2023-05-17T11:45:35.557931+0000","last_undegraded":"2023-05-17T11:45:35.557931+0000","last_fullsized":"2023-05-17T11:45:35.557931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:48:15.769750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521229+0000","last_change":"2023-05-17T11:45:35.534702+0000","last_active":"2023-05-17T11:45:36.521229+0000","last_peered":"2023-05-17T11:45:36.521229+0000","last_clean":"2023-05-17T11:45:36.521229+0000","last_became_active":"2023-05-17T11:45:35.534447+0000","last_became_peered":"2023-05-17T11:45:35.534447+0000","last_unstale":"2023-05-17T11:45:36.521229+0000","last_undegraded":"2023-05-17T11:45:36.521229+0000","last_fullsized":"2023-05-17T11:45:36.521229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.177990+0000","last_change":"2023-05-17T11:45:35.546069+0000","last_active":"2023-05-17T11:45:37.177990+0000","last_peered":"2023-05-17T11:45:37.177990+0000","last_clean":"2023-05-17T11:45:37.177990+0000","last_became_active":"2023-05-17T11:45:35.545768+0000","last_became_peered":"2023-05-17T11:45:35.545768+0000","last_unstale":"2023-05-17T11:45:37.177990+0000","last_undegraded":"2023-05-17T11:45:37.177990+0000","last_fullsized":"2023-05-17T11:45:37.177990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521500+0000","last_change":"2023-05-17T11:45:35.541053+0000","last_active":"2023-05-17T11:45:36.521500+0000","last_peered":"2023-05-17T11:45:36.521500+0000","last_clean":"2023-05-17T11:45:36.521500+0000","last_became_active":"2023-05-17T11:45:35.540780+0000","last_became_peered":"2023-05-17T11:45:35.540780+0000","last_unstale":"2023-05-17T11:45:36.521500+0000","last_undegraded":"2023-05-17T11:45:36.521500+0000","last_fullsized":"2023-05-17T11:45:36.521500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559247+0000","last_change":"2023-05-17T11:45:35.148198+0000","last_active":"2023-05-17T11:45:35.559247+0000","last_peered":"2023-05-17T11:45:35.559247+0000","last_clean":"2023-05-17T11:45:35.559247+0000","last_became_active":"2023-05-17T11:45:35.147893+0000","last_became_peered":"2023-05-17T11:45:35.147893+0000","last_unstale":"2023-05-17T11:45:35.559247+0000","last_undegraded":"2023-05-17T11:45:35.559247+0000","last_fullsized":"2023-05-17T11:45:35.559247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:48.964519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521783+0000","last_change":"2023-05-17T11:45:35.546006+0000","last_active":"2023-05-17T11:45:36.521783+0000","last_peered":"2023-05-17T11:45:36.521783+0000","last_clean":"2023-05-17T11:45:36.521783+0000","last_became_active":"2023-05-17T11:45:35.545532+0000","last_became_peered":"2023-05-17T11:45:35.545532+0000","last_unstale":"2023-05-17T11:45:36.521783+0000","last_undegraded":"2023-05-17T11:45:36.521783+0000","last_fullsized":"2023-05-17T11:45:36.521783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.527473+0000","last_change":"2023-05-17T11:45:35.138861+0000","last_active":"2023-05-17T11:45:35.527473+0000","last_peered":"2023-05-17T11:45:35.527473+0000","last_clean":"2023-05-17T11:45:35.527473+0000","last_became_active":"2023-05-17T11:45:35.138231+0000","last_became_peered":"2023-05-17T11:45:35.138231+0000","last_unstale":"2023-05-17T11:45:35.527473+0000","last_undegraded":"2023-05-17T11:45:35.527473+0000","last_fullsized":"2023-05-17T11:45:35.527473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:17.511368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538730+0000","last_change":"2023-05-17T11:45:35.532498+0000","last_active":"2023-05-17T11:45:35.538730+0000","last_peered":"2023-05-17T11:45:35.538730+0000","last_clean":"2023-05-17T11:45:35.538730+0000","last_became_active":"2023-05-17T11:45:35.532219+0000","last_became_peered":"2023-05-17T11:45:35.532219+0000","last_unstale":"2023-05-17T11:45:35.538730+0000","last_undegraded":"2023-05-17T11:45:35.538730+0000","last_fullsized":"2023-05-17T11:45:35.538730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:37:00.455903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.537233+0000","last_change":"2023-05-17T11:45:35.143472+0000","last_active":"2023-05-17T11:45:35.537233+0000","last_peered":"2023-05-17T11:45:35.537233+0000","last_clean":"2023-05-17T11:45:35.537233+0000","last_became_active":"2023-05-17T11:45:35.142889+0000","last_became_peered":"2023-05-17T11:45:35.142889+0000","last_unstale":"2023-05-17T11:45:35.537233+0000","last_undegraded":"2023-05-17T11:45:35.537233+0000","last_fullsized":"2023-05-17T11:45:35.537233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:49.363470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521564+0000","last_change":"2023-05-17T11:45:35.544687+0000","last_active":"2023-05-17T11:45:36.521564+0000","last_peered":"2023-05-17T11:45:36.521564+0000","last_clean":"2023-05-17T11:45:36.521564+0000","last_became_active":"2023-05-17T11:45:35.544357+0000","last_became_peered":"2023-05-17T11:45:35.544357+0000","last_unstale":"2023-05-17T11:45:36.521564+0000","last_undegraded":"2023-05-17T11:45:36.521564+0000","last_fullsized":"2023-05-17T11:45:36.521564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178143+0000","last_change":"2023-05-17T11:45:35.132466+0000","last_active":"2023-05-17T11:45:37.178143+0000","last_peered":"2023-05-17T11:45:37.178143+0000","last_clean":"2023-05-17T11:45:37.178143+0000","last_became_active":"2023-05-17T11:45:35.132140+0000","last_became_peered":"2023-05-17T11:45:35.132140+0000","last_unstale":"2023-05-17T11:45:37.178143+0000","last_undegraded":"2023-05-17T11:45:37.178143+0000","last_fullsized":"2023-05-17T11:45:37.178143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:04.077222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559102+0000","last_change":"2023-05-17T11:45:35.148167+0000","last_active":"2023-05-17T11:45:35.559102+0000","last_peered":"2023-05-17T11:45:35.559102+0000","last_clean":"2023-05-17T11:45:35.559102+0000","last_became_active":"2023-05-17T11:45:35.147381+0000","last_became_peered":"2023-05-17T11:45:35.147381+0000","last_unstale":"2023-05-17T11:45:35.559102+0000","last_undegraded":"2023-05-17T11:45:35.559102+0000","last_fullsized":"2023-05-17T11:45:35.559102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521316+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:36.521316+0000","last_peered":"2023-05-17T11:45:36.521316+0000","last_clean":"2023-05-17T11:45:36.521316+0000","last_became_active":"2023-05-17T11:45:35.529813+0000","last_became_peered":"2023-05-17T11:45:35.529813+0000","last_unstale":"2023-05-17T11:45:36.521316+0000","last_undegraded":"2023-05-17T11:45:36.521316+0000","last_fullsized":"2023-05-17T11:45:36.521316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559340+0000","last_change":"2023-05-17T11:45:35.148428+0000","last_active":"2023-05-17T11:45:35.559340+0000","last_peered":"2023-05-17T11:45:35.559340+0000","last_clean":"2023-05-17T11:45:35.559340+0000","last_became_active":"2023-05-17T11:45:35.147509+0000","last_became_peered":"2023-05-17T11:45:35.147509+0000","last_unstale":"2023-05-17T11:45:35.559340+0000","last_undegraded":"2023-05-17T11:45:35.559340+0000","last_fullsized":"2023-05-17T11:45:35.559340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:29.545146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555158+0000","last_change":"2023-05-17T11:45:35.541926+0000","last_active":"2023-05-17T11:45:35.555158+0000","last_peered":"2023-05-17T11:45:35.555158+0000","last_clean":"2023-05-17T11:45:35.555158+0000","last_became_active":"2023-05-17T11:45:35.540338+0000","last_became_peered":"2023-05-17T11:45:35.540338+0000","last_unstale":"2023-05-17T11:45:35.555158+0000","last_undegraded":"2023-05-17T11:45:35.555158+0000","last_fullsized":"2023-05-17T11:45:35.555158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:23:24.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559737+0000","last_change":"2023-05-17T11:45:35.140919+0000","last_active":"2023-05-17T11:45:35.559737+0000","last_peered":"2023-05-17T11:45:35.559737+0000","last_clean":"2023-05-17T11:45:35.559737+0000","last_became_active":"2023-05-17T11:45:35.140533+0000","last_became_peered":"2023-05-17T11:45:35.140533+0000","last_unstale":"2023-05-17T11:45:35.559737+0000","last_undegraded":"2023-05-17T11:45:35.559737+0000","last_fullsized":"2023-05-17T11:45:35.559737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:03.684194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178078+0000","last_change":"2023-05-17T11:45:35.544834+0000","last_active":"2023-05-17T11:45:37.178078+0000","last_peered":"2023-05-17T11:45:37.178078+0000","last_clean":"2023-05-17T11:45:37.178078+0000","last_became_active":"2023-05-17T11:45:35.544565+0000","last_became_peered":"2023-05-17T11:45:35.544565+0000","last_unstale":"2023-05-17T11:45:37.178078+0000","last_undegraded":"2023-05-17T11:45:37.178078+0000","last_fullsized":"2023-05-17T11:45:37.178078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521886+0000","last_change":"2023-05-17T11:45:35.141712+0000","last_active":"2023-05-17T11:45:36.521886+0000","last_peered":"2023-05-17T11:45:36.521886+0000","last_clean":"2023-05-17T11:45:36.521886+0000","last_became_active":"2023-05-17T11:45:35.141301+0000","last_became_peered":"2023-05-17T11:45:35.141301+0000","last_unstale":"2023-05-17T11:45:36.521886+0000","last_undegraded":"2023-05-17T11:45:36.521886+0000","last_fullsized":"2023-05-17T11:45:36.521886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.545650+0000","last_change":"2023-05-17T11:45:35.541253+0000","last_active":"2023-05-17T11:45:35.545650+0000","last_peered":"2023-05-17T11:45:35.545650+0000","last_clean":"2023-05-17T11:45:35.545650+0000","last_became_active":"2023-05-17T11:45:35.540949+0000","last_became_peered":"2023-05-17T11:45:35.540949+0000","last_unstale":"2023-05-17T11:45:35.545650+0000","last_undegraded":"2023-05-17T11:45:35.545650+0000","last_fullsized":"2023-05-17T11:45:35.545650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:24:13.270647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521633+0000","last_change":"2023-05-17T11:45:35.144268+0000","last_active":"2023-05-17T11:45:36.521633+0000","last_peered":"2023-05-17T11:45:36.521633+0000","last_clean":"2023-05-17T11:45:36.521633+0000","last_became_active":"2023-05-17T11:45:35.143991+0000","last_became_peered":"2023-05-17T11:45:35.143991+0000","last_unstale":"2023-05-17T11:45:36.521633+0000","last_undegraded":"2023-05-17T11:45:36.521633+0000","last_fullsized":"2023-05-17T11:45:36.521633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555479+0000","last_change":"2023-05-17T11:45:35.542321+0000","last_active":"2023-05-17T11:45:35.555479+0000","last_peered":"2023-05-17T11:45:35.555479+0000","last_clean":"2023-05-17T11:45:35.555479+0000","last_became_active":"2023-05-17T11:45:35.539632+0000","last_became_peered":"2023-05-17T11:45:35.539632+0000","last_unstale":"2023-05-17T11:45:35.555479+0000","last_undegraded":"2023-05-17T11:45:35.555479+0000","last_fullsized":"2023-05-17T11:45:35.555479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:05.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178234+0000","last_change":"2023-05-17T11:45:35.142904+0000","last_active":"2023-05-17T11:45:37.178234+0000","last_peered":"2023-05-17T11:45:37.178234+0000","last_clean":"2023-05-17T11:45:37.178234+0000","last_became_active":"2023-05-17T11:45:35.142584+0000","last_became_peered":"2023-05-17T11:45:35.142584+0000","last_unstale":"2023-05-17T11:45:37.178234+0000","last_undegraded":"2023-05-17T11:45:37.178234+0000","last_fullsized":"2023-05-17T11:45:37.178234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:53.799577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.549356+0000","last_change":"2023-05-17T11:45:35.536915+0000","last_active":"2023-05-17T11:45:35.549356+0000","last_peered":"2023-05-17T11:45:35.549356+0000","last_clean":"2023-05-17T11:45:35.549356+0000","last_became_active":"2023-05-17T11:45:35.536543+0000","last_became_peered":"2023-05-17T11:45:35.536543+0000","last_unstale":"2023-05-17T11:45:35.549356+0000","last_undegraded":"2023-05-17T11:45:35.549356+0000","last_fullsized":"2023-05-17T11:45:35.549356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:25:32.647449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.524558+0000","last_change":"2023-05-17T11:45:35.137585+0000","last_active":"2023-05-17T11:45:35.524558+0000","last_peered":"2023-05-17T11:45:35.524558+0000","last_clean":"2023-05-17T11:45:35.524558+0000","last_became_active":"2023-05-17T11:45:35.137054+0000","last_became_peered":"2023-05-17T11:45:35.137054+0000","last_unstale":"2023-05-17T11:45:35.524558+0000","last_undegraded":"2023-05-17T11:45:35.524558+0000","last_fullsized":"2023-05-17T11:45:35.524558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:24:12.263401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557949+0000","last_change":"2023-05-17T11:45:35.550175+0000","last_active":"2023-05-17T11:45:35.557949+0000","last_peered":"2023-05-17T11:45:35.557949+0000","last_clean":"2023-05-17T11:45:35.557949+0000","last_became_active":"2023-05-17T11:45:35.549881+0000","last_became_peered":"2023-05-17T11:45:35.549881+0000","last_unstale":"2023-05-17T11:45:35.557949+0000","last_undegraded":"2023-05-17T11:45:35.557949+0000","last_fullsized":"2023-05-17T11:45:35.557949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:54.806823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521247+0000","last_change":"2023-05-17T11:45:35.144989+0000","last_active":"2023-05-17T11:45:36.521247+0000","last_peered":"2023-05-17T11:45:36.521247+0000","last_clean":"2023-05-17T11:45:36.521247+0000","last_became_active":"2023-05-17T11:45:35.144819+0000","last_became_peered":"2023-05-17T11:45:35.144819+0000","last_unstale":"2023-05-17T11:45:36.521247+0000","last_undegraded":"2023-05-17T11:45:36.521247+0000","last_fullsized":"2023-05-17T11:45:36.521247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:03.684194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519767+0000","last_change":"2023-05-17T11:45:35.537836+0000","last_active":"2023-05-17T11:45:36.519767+0000","last_peered":"2023-05-17T11:45:36.519767+0000","last_clean":"2023-05-17T11:45:36.519767+0000","last_became_active":"2023-05-17T11:45:35.536405+0000","last_became_peered":"2023-05-17T11:45:35.536405+0000","last_unstale":"2023-05-17T11:45:36.519767+0000","last_undegraded":"2023-05-17T11:45:36.519767+0000","last_fullsized":"2023-05-17T11:45:36.519767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.532815+0000","last_change":"2023-05-17T11:45:23.894807+0000","last_active":"2023-05-17T11:45:35.532815+0000","last_peered":"2023-05-17T11:45:35.532815+0000","last_clean":"2023-05-17T11:45:35.532815+0000","last_became_active":"2023-05-17T11:45:23.894516+0000","last_became_peered":"2023-05-17T11:45:23.894516+0000","last_unstale":"2023-05-17T11:45:35.532815+0000","last_undegraded":"2023-05-17T11:45:35.532815+0000","last_fullsized":"2023-05-17T11:45:35.532815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_clean_scrub_stamp":"2023-05-17T11:45:22.596969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:15.915777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521380+0000","last_change":"2023-05-17T11:45:30.089866+0000","last_active":"2023-05-17T11:45:36.521380+0000","last_peered":"2023-05-17T11:45:36.521380+0000","last_clean":"2023-05-17T11:45:36.521380+0000","last_became_active":"2023-05-17T11:45:30.089207+0000","last_became_peered":"2023-05-17T11:45:30.089207+0000","last_unstale":"2023-05-17T11:45:36.521380+0000","last_undegraded":"2023-05-17T11:45:36.521380+0000","last_fullsized":"2023-05-17T11:45:36.521380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:27.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521342+0000","last_change":"2023-05-17T11:45:35.140973+0000","last_active":"2023-05-17T11:45:36.521342+0000","last_peered":"2023-05-17T11:45:36.521342+0000","last_clean":"2023-05-17T11:45:36.521342+0000","last_became_active":"2023-05-17T11:45:35.140590+0000","last_became_peered":"2023-05-17T11:45:35.140590+0000","last_unstale":"2023-05-17T11:45:36.521342+0000","last_undegraded":"2023-05-17T11:45:36.521342+0000","last_fullsized":"2023-05-17T11:45:36.521342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:32.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178394+0000","last_change":"2023-05-17T11:45:35.552628+0000","last_active":"2023-05-17T11:45:37.178394+0000","last_peered":"2023-05-17T11:45:37.178394+0000","last_clean":"2023-05-17T11:45:37.178394+0000","last_became_active":"2023-05-17T11:45:35.552298+0000","last_became_peered":"2023-05-17T11:45:35.552298+0000","last_unstale":"2023-05-17T11:45:37.178394+0000","last_undegraded":"2023-05-17T11:45:37.178394+0000","last_fullsized":"2023-05-17T11:45:37.178394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.532690+0000","last_change":"2023-05-17T11:45:30.093107+0000","last_active":"2023-05-17T11:45:35.532690+0000","last_peered":"2023-05-17T11:45:35.532690+0000","last_clean":"2023-05-17T11:45:35.532690+0000","last_became_active":"2023-05-17T11:45:30.092684+0000","last_became_peered":"2023-05-17T11:45:30.092684+0000","last_unstale":"2023-05-17T11:45:35.532690+0000","last_undegraded":"2023-05-17T11:45:35.532690+0000","last_fullsized":"2023-05-17T11:45:35.532690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:14.681922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.524409+0000","last_change":"2023-05-17T11:45:35.135037+0000","last_active":"2023-05-17T11:45:35.524409+0000","last_peered":"2023-05-17T11:45:35.524409+0000","last_clean":"2023-05-17T11:45:35.524409+0000","last_became_active":"2023-05-17T11:45:35.134656+0000","last_became_peered":"2023-05-17T11:45:35.134656+0000","last_unstale":"2023-05-17T11:45:35.524409+0000","last_undegraded":"2023-05-17T11:45:35.524409+0000","last_fullsized":"2023-05-17T11:45:35.524409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:23.222428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.545410+0000","last_change":"2023-05-17T11:45:35.541264+0000","last_active":"2023-05-17T11:45:35.545410+0000","last_peered":"2023-05-17T11:45:35.545410+0000","last_clean":"2023-05-17T11:45:35.545410+0000","last_became_active":"2023-05-17T11:45:35.541014+0000","last_became_peered":"2023-05-17T11:45:35.541014+0000","last_unstale":"2023-05-17T11:45:35.545410+0000","last_undegraded":"2023-05-17T11:45:35.545410+0000","last_fullsized":"2023-05-17T11:45:35.545410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:10:29.041251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.514537+0000","last_change":"2023-05-17T11:45:30.096072+0000","last_active":"2023-05-17T11:45:35.514537+0000","last_peered":"2023-05-17T11:45:35.514537+0000","last_clean":"2023-05-17T11:45:35.514537+0000","last_became_active":"2023-05-17T11:45:30.095647+0000","last_became_peered":"2023-05-17T11:45:30.095647+0000","last_unstale":"2023-05-17T11:45:35.514537+0000","last_undegraded":"2023-05-17T11:45:35.514537+0000","last_fullsized":"2023-05-17T11:45:35.514537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:07.189741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519445+0000","last_change":"2023-05-17T11:45:35.129591+0000","last_active":"2023-05-17T11:45:36.519445+0000","last_peered":"2023-05-17T11:45:36.519445+0000","last_clean":"2023-05-17T11:45:36.519445+0000","last_became_active":"2023-05-17T11:45:35.129301+0000","last_became_peered":"2023-05-17T11:45:35.129301+0000","last_unstale":"2023-05-17T11:45:36.519445+0000","last_undegraded":"2023-05-17T11:45:36.519445+0000","last_fullsized":"2023-05-17T11:45:36.519445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:18.795908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520150+0000","last_change":"2023-05-17T11:45:35.534133+0000","last_active":"2023-05-17T11:45:36.520150+0000","last_peered":"2023-05-17T11:45:36.520150+0000","last_clean":"2023-05-17T11:45:36.520150+0000","last_became_active":"2023-05-17T11:45:35.533661+0000","last_became_peered":"2023-05-17T11:45:35.533661+0000","last_unstale":"2023-05-17T11:45:36.520150+0000","last_undegraded":"2023-05-17T11:45:36.520150+0000","last_fullsized":"2023-05-17T11:45:36.520150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521322+0000","last_change":"2023-05-17T11:45:30.084716+0000","last_active":"2023-05-17T11:45:36.521322+0000","last_peered":"2023-05-17T11:45:36.521322+0000","last_clean":"2023-05-17T11:45:36.521322+0000","last_became_active":"2023-05-17T11:45:30.084340+0000","last_became_peered":"2023-05-17T11:45:30.084340+0000","last_unstale":"2023-05-17T11:45:36.521322+0000","last_undegraded":"2023-05-17T11:45:36.521322+0000","last_fullsized":"2023-05-17T11:45:36.521322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:35:58.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.526283+0000","last_change":"2023-05-17T11:45:35.142948+0000","last_active":"2023-05-17T11:45:35.526283+0000","last_peered":"2023-05-17T11:45:35.526283+0000","last_clean":"2023-05-17T11:45:35.526283+0000","last_became_active":"2023-05-17T11:45:35.142653+0000","last_became_peered":"2023-05-17T11:45:35.142653+0000","last_unstale":"2023-05-17T11:45:35.526283+0000","last_undegraded":"2023-05-17T11:45:35.526283+0000","last_fullsized":"2023-05-17T11:45:35.526283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:19.716929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519660+0000","last_change":"2023-05-17T11:45:35.534568+0000","last_active":"2023-05-17T11:45:36.519660+0000","last_peered":"2023-05-17T11:45:36.519660+0000","last_clean":"2023-05-17T11:45:36.519660+0000","last_became_active":"2023-05-17T11:45:35.534170+0000","last_became_peered":"2023-05-17T11:45:35.534170+0000","last_unstale":"2023-05-17T11:45:36.519660+0000","last_undegraded":"2023-05-17T11:45:36.519660+0000","last_fullsized":"2023-05-17T11:45:36.519660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521950+0000","last_change":"2023-05-17T11:45:35.146757+0000","last_active":"2023-05-17T11:45:36.521950+0000","last_peered":"2023-05-17T11:45:36.521950+0000","last_clean":"2023-05-17T11:45:36.521950+0000","last_became_active":"2023-05-17T11:45:35.146469+0000","last_became_peered":"2023-05-17T11:45:35.146469+0000","last_unstale":"2023-05-17T11:45:36.521950+0000","last_undegraded":"2023-05-17T11:45:36.521950+0000","last_fullsized":"2023-05-17T11:45:36.521950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:07.960059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519815+0000","last_change":"2023-05-17T11:45:30.647020+0000","last_active":"2023-05-17T11:45:36.519815+0000","last_peered":"2023-05-17T11:45:36.519815+0000","last_clean":"2023-05-17T11:45:36.519815+0000","last_became_active":"2023-05-17T11:45:30.646621+0000","last_became_peered":"2023-05-17T11:45:30.646621+0000","last_unstale":"2023-05-17T11:45:36.519815+0000","last_undegraded":"2023-05-17T11:45:36.519815+0000","last_fullsized":"2023-05-17T11:45:36.519815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:43.929512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519875+0000","last_change":"2023-05-17T11:45:35.534583+0000","last_active":"2023-05-17T11:45:36.519875+0000","last_peered":"2023-05-17T11:45:36.519875+0000","last_clean":"2023-05-17T11:45:36.519875+0000","last_became_active":"2023-05-17T11:45:35.533116+0000","last_became_peered":"2023-05-17T11:45:35.533116+0000","last_unstale":"2023-05-17T11:45:36.519875+0000","last_undegraded":"2023-05-17T11:45:36.519875+0000","last_fullsized":"2023-05-17T11:45:36.519875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519724+0000","last_change":"2023-05-17T11:45:35.129695+0000","last_active":"2023-05-17T11:45:36.519724+0000","last_peered":"2023-05-17T11:45:36.519724+0000","last_clean":"2023-05-17T11:45:36.519724+0000","last_became_active":"2023-05-17T11:45:35.129376+0000","last_became_peered":"2023-05-17T11:45:35.129376+0000","last_unstale":"2023-05-17T11:45:36.519724+0000","last_undegraded":"2023-05-17T11:45:36.519724+0000","last_fullsized":"2023-05-17T11:45:36.519724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.542100+0000","last_change":"2023-05-17T11:45:30.647758+0000","last_active":"2023-05-17T11:45:35.542100+0000","last_peered":"2023-05-17T11:45:35.542100+0000","last_clean":"2023-05-17T11:45:35.542100+0000","last_became_active":"2023-05-17T11:45:30.647423+0000","last_became_peered":"2023-05-17T11:45:30.647423+0000","last_unstale":"2023-05-17T11:45:35.542100+0000","last_undegraded":"2023-05-17T11:45:35.542100+0000","last_fullsized":"2023-05-17T11:45:35.542100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:27.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.541731+0000","last_change":"2023-05-17T11:45:35.536548+0000","last_active":"2023-05-17T11:45:35.541731+0000","last_peered":"2023-05-17T11:45:35.541731+0000","last_clean":"2023-05-17T11:45:35.541731+0000","last_became_active":"2023-05-17T11:45:35.535873+0000","last_became_peered":"2023-05-17T11:45:35.535873+0000","last_unstale":"2023-05-17T11:45:35.541731+0000","last_undegraded":"2023-05-17T11:45:35.541731+0000","last_fullsized":"2023-05-17T11:45:35.541731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:55:31.094625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521680+0000","last_change":"2023-05-17T11:45:35.144973+0000","last_active":"2023-05-17T11:45:36.521680+0000","last_peered":"2023-05-17T11:45:36.521680+0000","last_clean":"2023-05-17T11:45:36.521680+0000","last_became_active":"2023-05-17T11:45:35.144558+0000","last_became_peered":"2023-05-17T11:45:35.144558+0000","last_unstale":"2023-05-17T11:45:36.521680+0000","last_undegraded":"2023-05-17T11:45:36.521680+0000","last_fullsized":"2023-05-17T11:45:36.521680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520015+0000","last_change":"2023-05-17T11:45:30.087244+0000","last_active":"2023-05-17T11:45:36.520015+0000","last_peered":"2023-05-17T11:45:36.520015+0000","last_clean":"2023-05-17T11:45:36.520015+0000","last_became_active":"2023-05-17T11:45:30.086890+0000","last_became_peered":"2023-05-17T11:45:30.086890+0000","last_unstale":"2023-05-17T11:45:36.520015+0000","last_undegraded":"2023-05-17T11:45:36.520015+0000","last_fullsized":"2023-05-17T11:45:36.520015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:35.074387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521122+0000","last_change":"2023-05-17T11:45:35.534336+0000","last_active":"2023-05-17T11:45:36.521122+0000","last_peered":"2023-05-17T11:45:36.521122+0000","last_clean":"2023-05-17T11:45:36.521122+0000","last_became_active":"2023-05-17T11:45:35.533768+0000","last_became_peered":"2023-05-17T11:45:35.533768+0000","last_unstale":"2023-05-17T11:45:36.521122+0000","last_undegraded":"2023-05-17T11:45:36.521122+0000","last_fullsized":"2023-05-17T11:45:36.521122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.527576+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:35.527576+0000","last_peered":"2023-05-17T11:45:35.527576+0000","last_clean":"2023-05-17T11:45:35.527576+0000","last_became_active":"2023-05-17T11:45:35.138278+0000","last_became_peered":"2023-05-17T11:45:35.138278+0000","last_unstale":"2023-05-17T11:45:35.527576+0000","last_undegraded":"2023-05-17T11:45:35.527576+0000","last_fullsized":"2023-05-17T11:45:35.527576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:53.799577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178430+0000","last_change":"2023-05-17T11:45:30.088456+0000","last_active":"2023-05-17T11:45:37.178430+0000","last_peered":"2023-05-17T11:45:37.178430+0000","last_clean":"2023-05-17T11:45:37.178430+0000","last_became_active":"2023-05-17T11:45:30.088082+0000","last_became_peered":"2023-05-17T11:45:30.088082+0000","last_unstale":"2023-05-17T11:45:37.178430+0000","last_undegraded":"2023-05-17T11:45:37.178430+0000","last_fullsized":"2023-05-17T11:45:37.178430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:22.386463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.548675+0000","last_change":"2023-05-17T11:45:35.538184+0000","last_active":"2023-05-17T11:45:35.548675+0000","last_peered":"2023-05-17T11:45:35.548675+0000","last_clean":"2023-05-17T11:45:35.548675+0000","last_became_active":"2023-05-17T11:45:35.537967+0000","last_became_peered":"2023-05-17T11:45:35.537967+0000","last_unstale":"2023-05-17T11:45:35.548675+0000","last_undegraded":"2023-05-17T11:45:35.548675+0000","last_fullsized":"2023-05-17T11:45:35.548675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:37:00.455903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557948+0000","last_change":"2023-05-17T11:45:35.551187+0000","last_active":"2023-05-17T11:45:35.557948+0000","last_peered":"2023-05-17T11:45:35.557948+0000","last_clean":"2023-05-17T11:45:35.557948+0000","last_became_active":"2023-05-17T11:45:35.550919+0000","last_became_peered":"2023-05-17T11:45:35.550919+0000","last_unstale":"2023-05-17T11:45:35.557948+0000","last_undegraded":"2023-05-17T11:45:35.557948+0000","last_fullsized":"2023-05-17T11:45:35.557948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:36:26.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.561704+0000","last_change":"2023-05-17T11:45:35.143591+0000","last_active":"2023-05-17T11:45:35.561704+0000","last_peered":"2023-05-17T11:45:35.561704+0000","last_clean":"2023-05-17T11:45:35.561704+0000","last_became_active":"2023-05-17T11:45:35.143258+0000","last_became_peered":"2023-05-17T11:45:35.143258+0000","last_unstale":"2023-05-17T11:45:35.561704+0000","last_undegraded":"2023-05-17T11:45:35.561704+0000","last_fullsized":"2023-05-17T11:45:35.561704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:27.421470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519735+0000","last_change":"2023-05-17T11:45:35.546190+0000","last_active":"2023-05-17T11:45:36.519735+0000","last_peered":"2023-05-17T11:45:36.519735+0000","last_clean":"2023-05-17T11:45:36.519735+0000","last_became_active":"2023-05-17T11:45:35.545718+0000","last_became_peered":"2023-05-17T11:45:35.545718+0000","last_unstale":"2023-05-17T11:45:36.519735+0000","last_undegraded":"2023-05-17T11:45:36.519735+0000","last_fullsized":"2023-05-17T11:45:36.519735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.559652+0000","last_change":"2023-05-17T11:45:35.146268+0000","last_active":"2023-05-17T11:45:35.559652+0000","last_peered":"2023-05-17T11:45:35.559652+0000","last_clean":"2023-05-17T11:45:35.559652+0000","last_became_active":"2023-05-17T11:45:35.145917+0000","last_became_peered":"2023-05-17T11:45:35.145917+0000","last_unstale":"2023-05-17T11:45:35.559652+0000","last_undegraded":"2023-05-17T11:45:35.559652+0000","last_fullsized":"2023-05-17T11:45:35.559652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521793+0000","last_change":"2023-05-17T11:45:35.138653+0000","last_active":"2023-05-17T11:45:36.521793+0000","last_peered":"2023-05-17T11:45:36.521793+0000","last_clean":"2023-05-17T11:45:36.521793+0000","last_became_active":"2023-05-17T11:45:35.138291+0000","last_became_peered":"2023-05-17T11:45:35.138291+0000","last_unstale":"2023-05-17T11:45:36.521793+0000","last_undegraded":"2023-05-17T11:45:36.521793+0000","last_fullsized":"2023-05-17T11:45:36.521793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521323+0000","last_change":"2023-05-17T11:45:35.535628+0000","last_active":"2023-05-17T11:45:36.521323+0000","last_peered":"2023-05-17T11:45:36.521323+0000","last_clean":"2023-05-17T11:45:36.521323+0000","last_became_active":"2023-05-17T11:45:35.535341+0000","last_became_peered":"2023-05-17T11:45:35.535341+0000","last_unstale":"2023-05-17T11:45:36.521323+0000","last_undegraded":"2023-05-17T11:45:36.521323+0000","last_fullsized":"2023-05-17T11:45:36.521323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.530104+0000","last_change":"2023-05-17T11:45:35.138119+0000","last_active":"2023-05-17T11:45:35.530104+0000","last_peered":"2023-05-17T11:45:35.530104+0000","last_clean":"2023-05-17T11:45:35.530104+0000","last_became_active":"2023-05-17T11:45:35.137723+0000","last_became_peered":"2023-05-17T11:45:35.137723+0000","last_unstale":"2023-05-17T11:45:35.530104+0000","last_undegraded":"2023-05-17T11:45:35.530104+0000","last_fullsized":"2023-05-17T11:45:35.530104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:19.716929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521068+0000","last_change":"2023-05-17T11:45:35.535751+0000","last_active":"2023-05-17T11:45:36.521068+0000","last_peered":"2023-05-17T11:45:36.521068+0000","last_clean":"2023-05-17T11:45:36.521068+0000","last_became_active":"2023-05-17T11:45:35.535474+0000","last_became_peered":"2023-05-17T11:45:35.535474+0000","last_unstale":"2023-05-17T11:45:36.521068+0000","last_undegraded":"2023-05-17T11:45:36.521068+0000","last_fullsized":"2023-05-17T11:45:36.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:15:20.505190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178382+0000","last_change":"2023-05-17T11:45:35.546921+0000","last_active":"2023-05-17T11:45:37.178382+0000","last_peered":"2023-05-17T11:45:37.178382+0000","last_clean":"2023-05-17T11:45:37.178382+0000","last_became_active":"2023-05-17T11:45:35.546572+0000","last_became_peered":"2023-05-17T11:45:35.546572+0000","last_unstale":"2023-05-17T11:45:37.178382+0000","last_undegraded":"2023-05-17T11:45:37.178382+0000","last_fullsized":"2023-05-17T11:45:37.178382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:20.724175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521192+0000","last_change":"2023-05-17T11:45:35.141081+0000","last_active":"2023-05-17T11:45:36.521192+0000","last_peered":"2023-05-17T11:45:36.521192+0000","last_clean":"2023-05-17T11:45:36.521192+0000","last_became_active":"2023-05-17T11:45:35.140623+0000","last_became_peered":"2023-05-17T11:45:35.140623+0000","last_unstale":"2023-05-17T11:45:36.521192+0000","last_undegraded":"2023-05-17T11:45:36.521192+0000","last_fullsized":"2023-05-17T11:45:36.521192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:49.363470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.538749+0000","last_change":"2023-05-17T11:45:35.534028+0000","last_active":"2023-05-17T11:45:35.538749+0000","last_peered":"2023-05-17T11:45:35.538749+0000","last_clean":"2023-05-17T11:45:35.538749+0000","last_became_active":"2023-05-17T11:45:35.533692+0000","last_became_peered":"2023-05-17T11:45:35.533692+0000","last_unstale":"2023-05-17T11:45:35.538749+0000","last_undegraded":"2023-05-17T11:45:35.538749+0000","last_fullsized":"2023-05-17T11:45:35.538749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:23:24.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519734+0000","last_change":"2023-05-17T11:45:35.146893+0000","last_active":"2023-05-17T11:45:36.519734+0000","last_peered":"2023-05-17T11:45:36.519734+0000","last_clean":"2023-05-17T11:45:36.519734+0000","last_became_active":"2023-05-17T11:45:35.146547+0000","last_became_peered":"2023-05-17T11:45:35.146547+0000","last_unstale":"2023-05-17T11:45:36.519734+0000","last_undegraded":"2023-05-17T11:45:36.519734+0000","last_fullsized":"2023-05-17T11:45:36.519734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:29.545146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521823+0000","last_change":"2023-05-17T11:45:35.534371+0000","last_active":"2023-05-17T11:45:36.521823+0000","last_peered":"2023-05-17T11:45:36.521823+0000","last_clean":"2023-05-17T11:45:36.521823+0000","last_became_active":"2023-05-17T11:45:35.534091+0000","last_became_peered":"2023-05-17T11:45:35.534091+0000","last_unstale":"2023-05-17T11:45:36.521823+0000","last_undegraded":"2023-05-17T11:45:36.521823+0000","last_fullsized":"2023-05-17T11:45:36.521823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546976+0000","last_change":"2023-05-17T11:45:35.139454+0000","last_active":"2023-05-17T11:45:35.546976+0000","last_peered":"2023-05-17T11:45:35.546976+0000","last_clean":"2023-05-17T11:45:35.546976+0000","last_became_active":"2023-05-17T11:45:35.138750+0000","last_became_peered":"2023-05-17T11:45:35.138750+0000","last_unstale":"2023-05-17T11:45:35.546976+0000","last_undegraded":"2023-05-17T11:45:35.546976+0000","last_fullsized":"2023-05-17T11:45:35.546976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:10:28.034005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.544765+0000","last_change":"2023-05-17T11:45:35.539372+0000","last_active":"2023-05-17T11:45:35.544765+0000","last_peered":"2023-05-17T11:45:35.544765+0000","last_clean":"2023-05-17T11:45:35.544765+0000","last_became_active":"2023-05-17T11:45:35.539059+0000","last_became_peered":"2023-05-17T11:45:35.539059+0000","last_unstale":"2023-05-17T11:45:35.544765+0000","last_undegraded":"2023-05-17T11:45:35.544765+0000","last_fullsized":"2023-05-17T11:45:35.544765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:24:26.208061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546975+0000","last_change":"2023-05-17T11:45:35.135013+0000","last_active":"2023-05-17T11:45:35.546975+0000","last_peered":"2023-05-17T11:45:35.546975+0000","last_clean":"2023-05-17T11:45:35.546975+0000","last_became_active":"2023-05-17T11:45:35.134702+0000","last_became_peered":"2023-05-17T11:45:35.134702+0000","last_unstale":"2023-05-17T11:45:35.546975+0000","last_undegraded":"2023-05-17T11:45:35.546975+0000","last_fullsized":"2023-05-17T11:45:35.546975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:36.287355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.555382+0000","last_change":"2023-05-17T11:45:35.544396+0000","last_active":"2023-05-17T11:45:35.555382+0000","last_peered":"2023-05-17T11:45:35.555382+0000","last_clean":"2023-05-17T11:45:35.555382+0000","last_became_active":"2023-05-17T11:45:35.544113+0000","last_became_peered":"2023-05-17T11:45:35.544113+0000","last_unstale":"2023-05-17T11:45:35.555382+0000","last_undegraded":"2023-05-17T11:45:35.555382+0000","last_fullsized":"2023-05-17T11:45:35.555382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521540+0000","last_change":"2023-05-17T11:45:35.145692+0000","last_active":"2023-05-17T11:45:36.521540+0000","last_peered":"2023-05-17T11:45:36.521540+0000","last_clean":"2023-05-17T11:45:36.521540+0000","last_became_active":"2023-05-17T11:45:35.145352+0000","last_became_peered":"2023-05-17T11:45:35.145352+0000","last_unstale":"2023-05-17T11:45:36.521540+0000","last_undegraded":"2023-05-17T11:45:36.521540+0000","last_fullsized":"2023-05-17T11:45:36.521540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546825+0000","last_change":"2023-05-17T11:45:35.527750+0000","last_active":"2023-05-17T11:45:35.546825+0000","last_peered":"2023-05-17T11:45:35.546825+0000","last_clean":"2023-05-17T11:45:35.546825+0000","last_became_active":"2023-05-17T11:45:35.527428+0000","last_became_peered":"2023-05-17T11:45:35.527428+0000","last_unstale":"2023-05-17T11:45:35.546825+0000","last_undegraded":"2023-05-17T11:45:35.546825+0000","last_fullsized":"2023-05-17T11:45:35.546825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:24:13.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521918+0000","last_change":"2023-05-17T11:45:35.143811+0000","last_active":"2023-05-17T11:45:36.521918+0000","last_peered":"2023-05-17T11:45:36.521918+0000","last_clean":"2023-05-17T11:45:36.521918+0000","last_became_active":"2023-05-17T11:45:35.142921+0000","last_became_peered":"2023-05-17T11:45:35.142921+0000","last_unstale":"2023-05-17T11:45:36.521918+0000","last_undegraded":"2023-05-17T11:45:36.521918+0000","last_fullsized":"2023-05-17T11:45:36.521918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:24.352254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521461+0000","last_change":"2023-05-17T11:45:35.532708+0000","last_active":"2023-05-17T11:45:36.521461+0000","last_peered":"2023-05-17T11:45:36.521461+0000","last_clean":"2023-05-17T11:45:36.521461+0000","last_became_active":"2023-05-17T11:45:35.532426+0000","last_became_peered":"2023-05-17T11:45:35.532426+0000","last_unstale":"2023-05-17T11:45:36.521461+0000","last_undegraded":"2023-05-17T11:45:36.521461+0000","last_fullsized":"2023-05-17T11:45:36.521461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521732+0000","last_change":"2023-05-17T11:45:35.140853+0000","last_active":"2023-05-17T11:45:36.521732+0000","last_peered":"2023-05-17T11:45:36.521732+0000","last_clean":"2023-05-17T11:45:36.521732+0000","last_became_active":"2023-05-17T11:45:35.140321+0000","last_became_peered":"2023-05-17T11:45:35.140321+0000","last_unstale":"2023-05-17T11:45:36.521732+0000","last_undegraded":"2023-05-17T11:45:36.521732+0000","last_fullsized":"2023-05-17T11:45:36.521732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.557940+0000","last_change":"2023-05-17T11:45:35.551649+0000","last_active":"2023-05-17T11:45:35.557940+0000","last_peered":"2023-05-17T11:45:35.557940+0000","last_clean":"2023-05-17T11:45:35.557940+0000","last_became_active":"2023-05-17T11:45:35.551298+0000","last_became_peered":"2023-05-17T11:45:35.551298+0000","last_unstale":"2023-05-17T11:45:35.557940+0000","last_undegraded":"2023-05-17T11:45:35.557940+0000","last_fullsized":"2023-05-17T11:45:35.557940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:13.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T11:45:35.546322+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:35.546322+0000","last_peered":"2023-05-17T11:45:35.546322+0000","last_clean":"2023-05-17T11:45:35.546322+0000","last_became_active":"2023-05-17T11:45:35.138958+0000","last_became_peered":"2023-05-17T11:45:35.138958+0000","last_unstale":"2023-05-17T11:45:35.546322+0000","last_undegraded":"2023-05-17T11:45:35.546322+0000","last_fullsized":"2023-05-17T11:45:35.546322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:04.077222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13192,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358648,"statfs":{"total":96636764160,"available":96623255552,"internally_reserved":0,"allocated":851968,"data_stored":675094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12072,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359768,"statfs":{"total":96636764160,"available":96624402432,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12092,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359748,"statfs":{"total":96636764160,"available":96624381952,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12156,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359684,"statfs":{"total":96636764160,"available":96624316416,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7912,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363928,"statfs":{"total":96636764160,"available":96628662272,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T11:45:39.981 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T11:45:39.981 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-17T11:45:39.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-17T11:45:39.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-17T11:45:39.982 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-17T11:45:40.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 Processor -- start 2023-05-17T11:45:40.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 -- start start 2023-05-17T11:45:40.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fef54158f10 0x7fef54070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef5406bc30 0x7fef5406c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540c92f0 con 0x7fef54071c10 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5406c5f0 con 0x7fef54158f10 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef5acc4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef54071480 con 0x7fef5406bc30 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fef54158f10 0x7fef54070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fef54158f10 0x7fef54070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51510/0 (socket says 172.21.15.3:51510) 2023-05-17T11:45:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 -- 172.21.15.3:0/1672294910 learned_addr learned my addr 172.21.15.3:0/1672294910 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef59261640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef5406bc30 0x7fef5406c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 -- 172.21.15.3:0/1672294910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef5406bc30 msgr2=0x7fef5406c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef5406bc30 0x7fef5406c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 -- 172.21.15.3:0/1672294910 >> v1:172.21.15.60:6789/0 conn(0x7fef54071c10 legacy=0x7fef540cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef58a60640 1 -- 172.21.15.3:0/1672294910 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540c8a00 con 0x7fef54158f10 2023-05-17T11:45:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.147+0000 7fef59261640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef5406bc30 0x7fef5406c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef58a60640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54158f10 0x7fef54070f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2782f2256dc3db2b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef537fe640 1 -- 172.21.15.3:0/1672294910 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480ac410 con 0x7fef54158f10 2023-05-17T11:45:40.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef537fe640 1 -- 172.21.15.3:0/1672294910 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480ac570 con 0x7fef54158f10 2023-05-17T11:45:40.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef537fe640 1 -- 172.21.15.3:0/1672294910 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480ac900 con 0x7fef54158f10 2023-05-17T11:45:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 -- 172.21.15.3:0/1672294910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54158f10 msgr2=0x7fef54070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54158f10 0x7fef54070f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4801c500 comp rx=0 tx=0).stop 2023-05-17T11:45:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 -- 172.21.15.3:0/1672294910 shutdown_connections 2023-05-17T11:45:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef5406bc30 0x7fef5406c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1672294910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54158f10 0x7fef54070f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 -- 172.21.15.3:0/1672294910 >> 172.21.15.3:0/1672294910 conn(0x7fef540b0b30 msgr2=0x7fef540cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 -- 172.21.15.3:0/1672294910 shutdown_connections 2023-05-17T11:45:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 -- 172.21.15.3:0/1672294910 wait complete. 2023-05-17T11:45:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 Processor -- start 2023-05-17T11:45:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.151+0000 7fef5acc4640 1 -- start start 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 0x7fef541431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef54071c10 0x7fef540c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef54158f10 0x7fef540b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c5c60 con 0x7fef5406bc30 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c59c0 con 0x7fef54071c10 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef541551e0 con 0x7fef54158f10 2023-05-17T11:45:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 0x7fef541431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 0x7fef541431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51512/0 (socket says 172.21.15.3:51512) 2023-05-17T11:45:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 -- 172.21.15.3:0/1545352593 learned_addr learned my addr 172.21.15.3:0/1545352593 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef53fff640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef54071c10 0x7fef540c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef59261640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef54158f10 0x7fef540b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 -- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef54158f10 msgr2=0x7fef540b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef54158f10 0x7fef540b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 -- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef54071c10 msgr2=0x7fef540c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef54071c10 0x7fef540c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 -- 172.21.15.3:0/1545352593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480094d0 con 0x7fef5406bc30 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef53fff640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef54071c10 0x7fef540c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef58a60640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 0x7fef541431c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef480af040 tx=0x7fef480192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480acd10 con 0x7fef5406bc30 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480ace70 con 0x7fef5406bc30 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480b7670 con 0x7fef5406bc30 2023-05-17T11:45:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540cc690 con 0x7fef5406bc30 2023-05-17T11:45:40.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540c8f80 con 0x7fef5406bc30 2023-05-17T11:45:40.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.155+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef54163cb0 con 0x7fef5406bc30 2023-05-17T11:45:40.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.159+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef480b3070 con 0x7fef5406bc30 2023-05-17T11:45:40.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.159+0000 7fef517fa640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fef380662b0 0x7fef38068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.159+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef4811e120 con 0x7fef5406bc30 2023-05-17T11:45:40.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.159+0000 7fef53fff640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fef380662b0 0x7fef38068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.159+0000 7fef53fff640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fef380662b0 0x7fef38068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef540cc960 tx=0x7fef40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.163+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fef480eb500 con 0x7fef5406bc30 2023-05-17T11:45:40.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.359+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fef540adbb0 con 0x7fef5406bc30 2023-05-17T11:45:40.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.359+0000 7fef517fa640 1 -- 172.21.15.3:0/1545352593 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164233 (secure 0 0 0) 0x7fef480eeb20 con 0x7fef5406bc30 2023-05-17T11:45:40.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fef380662b0 msgr2=0x7fef38068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fef380662b0 0x7fef38068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef540cc960 tx=0x7fef40009040 comp rx=0 tx=0).stop 2023-05-17T11:45:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 msgr2=0x7fef541431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 0x7fef541431c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef480af040 tx=0x7fef480192a0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 shutdown_connections 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fef380662b0 0x7fef38068760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fef54158f10 0x7fef540b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef54071c10 0x7fef540c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 --2- 172.21.15.3:0/1545352593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef5406bc30 0x7fef541431c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 >> 172.21.15.3:0/1545352593 conn(0x7fef540b0b30 msgr2=0x7fef54161ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 shutdown_connections 2023-05-17T11:45:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.363+0000 7fef5acc4640 1 -- 172.21.15.3:0/1545352593 wait complete. 2023-05-17T11:45:40.391 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":2126677587},{"type":"v1","addr":"172.21.15.3:6833","nonce":2126677587}]},"active_addr":"172.21.15.3:6833/2126677587","active_change":"2023-05-17T11:45:14.514207+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":2566386022}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3689272670}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3610507525}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":63588242}]}]} 2023-05-17T11:45:40.396 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-17T11:45:40.396 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-17T11:45:40.396 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:40.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f988728c640 1 Processor -- start 2023-05-17T11:45:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f988728c640 1 -- start start 2023-05-17T11:45:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f988728c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 0x7f98800b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f988728c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98800ca490 con 0x7f988015a2e0 2023-05-17T11:45:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f988728c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98800ca730 con 0x7f98800716d0 2023-05-17T11:45:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f988728c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800cacf0 con 0x7f98800c9fd0 2023-05-17T11:45:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f9884827640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f988015a2e0 0x7f9880071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46772/0 (socket says 172.21.15.3:46772) 2023-05-17T11:45:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f9884827640 1 -- 172.21.15.3:0/2039684776 learned_addr learned my addr 172.21.15.3:0/2039684776 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f9885829640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 0x7f98800b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928387678 0 0) 0x7f98800ca490 con 0x7f988015a2e0 2023-05-17T11:45:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.523+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f986c003530 con 0x7f988015a2e0 2023-05-17T11:45:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2906121978 0 0) 0x7f986c003530 con 0x7f988015a2e0 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 msgr2=0x7f98800b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 0x7f98800b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 >> v1:172.21.15.60:6789/0 conn(0x7f98800716d0 legacy=0x7f988006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800caa10 con 0x7f988015a2e0 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f9870001680 con 0x7f988015a2e0 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 >> v1:172.21.15.3:6789/0 conn(0x7f988015a2e0 legacy=0x7f9880071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 0x7f986c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c003f60 0x7f986c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f986c004d10 0x7f986c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800cacf0 con 0x7f986c004d10 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c00ba40 con 0x7f986c003f60 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c00bc00 con 0x7f98800c9fd0 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885829640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f986c004d10 0x7f986c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9884827640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c003f60 0x7f986c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885028640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 0x7f986c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885829640 1 -- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 msgr2=0x7f986c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885829640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800c9fd0 0x7f986c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885829640 1 -- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c003f60 msgr2=0x7f986c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885829640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c003f60 0x7f986c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.527+0000 7f9885829640 1 -- 172.21.15.3:0/2039684776 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c003530 con 0x7f986c004d10 2023-05-17T11:45:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f9885829640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f986c004d10 0x7f986c005180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9878009f90 tx=0x7f987801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca434d446801c343 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780a5b20 con 0x7f986c004d10 2023-05-17T11:45:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987800f040 con 0x7f986c004d10 2023-05-17T11:45:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f9877fff640 1 -- 172.21.15.3:0/2039684776 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780ad440 con 0x7f986c004d10 2023-05-17T11:45:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 -- 172.21.15.3:0/2039684776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f986c004d10 msgr2=0x7f986c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 --2- 172.21.15.3:0/2039684776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f986c004d10 0x7f986c005180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9878009f90 tx=0x7f987801cc20 comp rx=0 tx=0).stop 2023-05-17T11:45:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f9885829640 1 -- 172.21.15.3:0/2039684776 reap_dead start 2023-05-17T11:45:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 -- 172.21.15.3:0/2039684776 shutdown_connections 2023-05-17T11:45:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 -- 172.21.15.3:0/2039684776 >> 172.21.15.3:0/2039684776 conn(0x7f98800b0b30 msgr2=0x7f98800cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 -- 172.21.15.3:0/2039684776 shutdown_connections 2023-05-17T11:45:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 -- 172.21.15.3:0/2039684776 wait complete. 2023-05-17T11:45:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 Processor -- start 2023-05-17T11:45:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.531+0000 7f988728c640 1 -- start start 2023-05-17T11:45:40.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9880149a00 0x7f98800b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 0x7f98800ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800cd510 0x7f98801e2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800cd9b0 con 0x7f9880149dd0 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800b1880 con 0x7f9880149a00 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800b3920 con 0x7f98800cd510 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 0x7f98800ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 0x7f98800ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51534/0 (socket says 172.21.15.3:51534) 2023-05-17T11:45:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 -- 172.21.15.3:0/1809121562 learned_addr learned my addr 172.21.15.3:0/1809121562 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9885028640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9880149a00 0x7f98800b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9885829640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800cd510 0x7f98801e2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 -- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800cd510 msgr2=0x7f98801e2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800cd510 0x7f98801e2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 -- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9880149a00 msgr2=0x7f98800b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9880149a00 0x7f98800b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 -- 172.21.15.3:0/1809121562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800c8e80 con 0x7f9880149dd0 2023-05-17T11:45:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9884827640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 0x7f98800ccfd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9870001060 tx=0x7f9870012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870014810 con 0x7f9880149dd0 2023-05-17T11:45:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870014970 con 0x7f9880149dd0 2023-05-17T11:45:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870014d00 con 0x7f9880149dd0 2023-05-17T11:45:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98800c8ba0 con 0x7f9880149dd0 2023-05-17T11:45:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98800b1200 con 0x7f9880149dd0 2023-05-17T11:45:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.535+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988004de80 con 0x7f9880149dd0 2023-05-17T11:45:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.539+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98700153e0 con 0x7f9880149dd0 2023-05-17T11:45:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.539+0000 7f9875ffb640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f98640662d0 0x7f9864068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.539+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9870086b60 con 0x7f9880149dd0 2023-05-17T11:45:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.539+0000 7f9885028640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f98640662d0 0x7f9864068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.539+0000 7f9885028640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f98640662d0 0x7f9864068780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f987c007fd0 tx=0x7f987c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.543+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9870053fe0 con 0x7f9880149dd0 2023-05-17T11:45:40.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98800b19c0 con 0x7f9880149dd0 2023-05-17T11:45:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f9875ffb640 1 -- 172.21.15.3:0/1809121562 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f987001c030 con 0x7f9880149dd0 2023-05-17T11:45:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:40.709 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f98640662d0 msgr2=0x7f9864068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f98640662d0 0x7f9864068780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f987c007fd0 tx=0x7f987c009040 comp rx=0 tx=0).stop 2023-05-17T11:45:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 msgr2=0x7f98800ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 0x7f98800ccfd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9870001060 tx=0x7f9870012920 comp rx=0 tx=0).stop 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 shutdown_connections 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f98640662d0 0x7f9864068780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f98800cd510 0x7f98801e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9880149dd0 0x7f98800ccfd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 --2- 172.21.15.3:0/1809121562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9880149a00 0x7f98800b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 >> 172.21.15.3:0/1809121562 conn(0x7f98800b0b30 msgr2=0x7f98800c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:40.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 shutdown_connections 2023-05-17T11:45:40.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.699+0000 7f988728c640 1 -- 172.21.15.3:0/1809121562 wait complete. 2023-05-17T11:45:40.729 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-17T11:45:40.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.855+0000 7f1815c74640 1 Processor -- start 2023-05-17T11:45:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.855+0000 7f1815c74640 1 -- start start 2023-05-17T11:45:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1815c74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18100716d0 0x7f181006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1815c74640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f181015a2e0 0x7f1810071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1815c74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f18100c9fd0 0x7f18100b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1815c74640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100cacf0 con 0x7f181015a2e0 2023-05-17T11:45:40.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1815c74640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100ca490 con 0x7f18100716d0 2023-05-17T11:45:40.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1815c74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1810070140 con 0x7f18100c9fd0 2023-05-17T11:45:40.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f181015a2e0 0x7f1810071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f181015a2e0 0x7f1810071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51544/0 (socket says 172.21.15.3:51544) 2023-05-17T11:45:40.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 -- 172.21.15.3:0/3982841968 learned_addr learned my addr 172.21.15.3:0/3982841968 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:40.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f180ffff640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f18100c9fd0 0x7f18100b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f180f7fe640 1 --2- 172.21.15.3:0/3982841968 >> v2:172.21.15.60:3300/0 conn(0x7f18100716d0 0x7f181006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 -- 172.21.15.3:0/3982841968 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f18100c9fd0 msgr2=0x7f18100b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f18100c9fd0 0x7f18100b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 -- 172.21.15.3:0/3982841968 >> v2:172.21.15.60:3300/0 conn(0x7f18100716d0 msgr2=0x7f181006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 --2- 172.21.15.3:0/3982841968 >> v2:172.21.15.60:3300/0 conn(0x7f18100716d0 0x7f181006fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f1807fff640 1 -- 172.21.15.3:0/3982841968 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810071fe0 con 0x7f181015a2e0 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f180ffff640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f18100c9fd0 0x7f18100b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.859+0000 7f180f7fe640 1 --2- 172.21.15.3:0/3982841968 >> v2:172.21.15.60:3300/0 conn(0x7f18100716d0 0x7f181006fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:40.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1807fff640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f181015a2e0 0x7f1810071aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f181006f6b0 tx=0x7f17f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8144e91ca13747e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f180effd640 1 -- 172.21.15.3:0/3982841968 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80aa5f0 con 0x7f181015a2e0 2023-05-17T11:45:40.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f180effd640 1 -- 172.21.15.3:0/3982841968 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80aa750 con 0x7f181015a2e0 2023-05-17T11:45:40.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f180effd640 1 -- 172.21.15.3:0/3982841968 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80aaae0 con 0x7f181015a2e0 2023-05-17T11:45:40.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- 172.21.15.3:0/3982841968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f181015a2e0 msgr2=0x7f1810071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f181015a2e0 0x7f1810071aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f181006f6b0 tx=0x7f17f801c4d0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- 172.21.15.3:0/3982841968 shutdown_connections 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f18100c9fd0 0x7f18100b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- 172.21.15.3:0/3982841968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f181015a2e0 0x7f1810071aa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- 172.21.15.3:0/3982841968 >> v2:172.21.15.60:3300/0 conn(0x7f18100716d0 0x7f181006fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- 172.21.15.3:0/3982841968 >> 172.21.15.3:0/3982841968 conn(0x7f18100b0b30 msgr2=0x7f18100cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- 172.21.15.3:0/3982841968 shutdown_connections 2023-05-17T11:45:40.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- 172.21.15.3:0/3982841968 wait complete. 2023-05-17T11:45:40.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 Processor -- start 2023-05-17T11:45:40.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- start start 2023-05-17T11:45:40.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100716d0 0x7f18101f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 0x7f18100b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f181015a2e0 0x7f1810153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100b3ac0 con 0x7f18100c9fd0 2023-05-17T11:45:40.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1810153aa0 con 0x7f18100716d0 2023-05-17T11:45:40.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.863+0000 7f1815c74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18101f29f0 con 0x7f181015a2e0 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 0x7f18100b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 0x7f18100b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51558/0 (socket says 172.21.15.3:51558) 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 -- 172.21.15.3:0/2597463799 learned_addr learned my addr 172.21.15.3:0/2597463799 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180f7fe640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100716d0 0x7f18101f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180ffff640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f181015a2e0 0x7f1810153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 -- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f181015a2e0 msgr2=0x7f1810153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f181015a2e0 0x7f1810153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 -- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100716d0 msgr2=0x7f18101f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100716d0 0x7f18101f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 -- 172.21.15.3:0/2597463799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f80094d0 con 0x7f18100c9fd0 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180ffff640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f181015a2e0 0x7f1810153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1807fff640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 0x7f18100b3580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17f801ab80 tx=0x7f17f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80b3800 con 0x7f18100c9fd0 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80b3980 con 0x7f18100c9fd0 2023-05-17T11:45:40.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18100c8e80 con 0x7f18100c9fd0 2023-05-17T11:45:40.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80b3d30 con 0x7f18100c9fd0 2023-05-17T11:45:40.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18100c8ba0 con 0x7f18100c9fd0 2023-05-17T11:45:40.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181006bc30 con 0x7f18100c9fd0 2023-05-17T11:45:40.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17f80b2380 con 0x7f18100c9fd0 2023-05-17T11:45:40.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.867+0000 7f180cff9640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f17f00662b0 0x7f17f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:40.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.871+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17f80a7070 con 0x7f18100c9fd0 2023-05-17T11:45:40.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.871+0000 7f180f7fe640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f17f00662b0 0x7f17f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:40.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.871+0000 7f180f7fe640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f17f00662b0 0x7f17f0068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1800006b20 tx=0x7f1800008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:40.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:40.871+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f17f80eb9b0 con 0x7f18100c9fd0 2023-05-17T11:45:41.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.027+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f181004ded0 con 0x7f18100c9fd0 2023-05-17T11:45:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.027+0000 7f180cff9640 1 -- 172.21.15.3:0/2597463799 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f17f80eefd0 con 0x7f18100c9fd0 2023-05-17T11:45:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:41.039 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:41.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f17f00662b0 msgr2=0x7f17f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f17f00662b0 0x7f17f0068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1800006b20 tx=0x7f1800008040 comp rx=0 tx=0).stop 2023-05-17T11:45:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 msgr2=0x7f18100b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 0x7f18100b3580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17f801ab80 tx=0x7f17f801ad10 comp rx=0 tx=0).stop 2023-05-17T11:45:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 shutdown_connections 2023-05-17T11:45:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f17f00662b0 0x7f17f0068760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f181015a2e0 0x7f1810153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18100c9fd0 0x7f18100b3580 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 --2- 172.21.15.3:0/2597463799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100716d0 0x7f18101f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 >> 172.21.15.3:0/2597463799 conn(0x7f18100b0b30 msgr2=0x7f18100ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 shutdown_connections 2023-05-17T11:45:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.031+0000 7f1815c74640 1 -- 172.21.15.3:0/2597463799 wait complete. 2023-05-17T11:45:41.060 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-17T11:45:41.060 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-17T11:45:41.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-17T11:45:41.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-17T11:45:41.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-17T11:45:41.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-17T11:45:41.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-17T11:45:41.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-17T11:45:41.241 INFO:tasks.ceph.mds.d.smithi060.stderr:2023-05-17T11:45:41.232+0000 7f3468906640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T11:45:41.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 Processor -- start 2023-05-17T11:45:41.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 -- start start 2023-05-17T11:45:41.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6bc8160010 0x7f6bc806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6bc80b2820 0x7f6bc80afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc8071b30 con 0x7f6bc806a600 2023-05-17T11:45:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc8070060 con 0x7f6bc80b2820 2023-05-17T11:45:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.291+0000 7f6bcfb52640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc8164850 con 0x7f6bc8160010 2023-05-17T11:45:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd0ed640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6bc80b2820 0x7f6bc80afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bce0ef640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6bc806a600 0x7f6bc81603e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46784/0 (socket says 172.21.15.3:46784) 2023-05-17T11:45:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bce0ef640 1 -- 172.21.15.3:0/2049601436 learned_addr learned my addr 172.21.15.3:0/2049601436 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd8ee640 1 --2- 172.21.15.3:0/2049601436 >> v2:172.21.15.60:3300/0 conn(0x7f6bc8160010 0x7f6bc806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2049601436 >> v2:172.21.15.3:3300/0 conn(0x7f6bc80b2820 msgr2=0x7f6bc80afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcc8ec640 1 -- 172.21.15.3:0/2049601436 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485828987 0 0) 0x7f6bc8071b30 con 0x7f6bc806a600 2023-05-17T11:45:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd8ee640 1 --2- 172.21.15.3:0/2049601436 >> v2:172.21.15.3:3300/0 conn(0x7f6bc80b2820 0x7f6bc80afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2049601436 >> v1:172.21.15.3:6789/0 conn(0x7f6bc806a600 legacy=0x7f6bc81603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2049601436 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80717c0 con 0x7f6bc8160010 2023-05-17T11:45:41.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.295+0000 7f6bcd0ed640 1 --2- 172.21.15.3:0/2049601436 >> v2:172.21.15.3:3300/0 conn(0x7f6bc80b2820 0x7f6bc80afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 Processor -- start 2023-05-17T11:45:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 -- start start 2023-05-17T11:45:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcd8ee640 1 --2- 172.21.15.3:0/2049601436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc8160010 0x7f6bc806fb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80cf2d0 tx=0x7f6bc001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac4baf6e88bd41a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcc8ec640 1 -- 172.21.15.3:0/2049601436 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ab600 con 0x7f6bc8160010 2023-05-17T11:45:41.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcc8ec640 1 -- 172.21.15.3:0/2049601436 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00a7050 con 0x7f6bc8160010 2023-05-17T11:45:41.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcc8ec640 1 -- 172.21.15.3:0/2049601436 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ab980 con 0x7f6bc8160010 2023-05-17T11:45:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f0aef125640 1 Processor -- start 2023-05-17T11:45:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f0aef125640 1 -- start start 2023-05-17T11:45:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fb061160640 1 Processor -- start 2023-05-17T11:45:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fb061160640 1 -- start start 2023-05-17T11:45:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e3a00 0x7fbe48054900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbe480e2140 0x7fbe480e25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe48055200 con 0x7fbe48037f50 2023-05-17T11:45:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe480e71e0 con 0x7fbe480e2140 2023-05-17T11:45:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe5548c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480e6420 con 0x7fbe480e3a00 2023-05-17T11:45:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2049601436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc8160010 msgr2=0x7f6bc806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcfb52640 1 --2- 172.21.15.3:0/2049601436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc8160010 0x7f6bc806fb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80cf2d0 tx=0x7f6bc001c3d0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe4effd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe48037f50 0x7fbe48038320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:60988/0 (socket says 172.21.15.3:60988) 2023-05-17T11:45:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe4effd640 1 -- 172.21.15.3:0/3431690721 learned_addr learned my addr 172.21.15.3:0/3431690721 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe4ffff640 1 --2- 172.21.15.3:0/3431690721 >> v2:172.21.15.3:3300/0 conn(0x7fbe480e2140 0x7fbe480e25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7fbe4e7fc640 1 --2- 172.21.15.3:0/3431690721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e3a00 0x7fbe48054900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2049601436 shutdown_connections 2023-05-17T11:45:41.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcfb52640 1 --2- 172.21.15.3:0/2049601436 >> v2:172.21.15.3:3300/0 conn(0x7f6bc80b2820 0x7f6bc80afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcfb52640 1 --2- 172.21.15.3:0/2049601436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc8160010 0x7f6bc806fb20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.299+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2049601436 >> 172.21.15.3:0/2049601436 conn(0x7f6bc8069ab0 msgr2=0x7f6bc8069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2049601436 shutdown_connections 2023-05-17T11:45:41.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 Processor -- start 2023-05-17T11:45:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb061160640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb054050fa0 0x7fb054036530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb061160640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054006fc0 con 0x7fb0540e6c10 2023-05-17T11:45:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb061160640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054036eb0 con 0x7fb054036a70 2023-05-17T11:45:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb061160640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540513f0 con 0x7fb054050fa0 2023-05-17T11:45:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 -- start start 2023-05-17T11:45:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fbe4dffb640 1 -- 172.21.15.3:0/3431690721 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751377923 0 0) 0x7fbe48055200 con 0x7fbe48037f50 2023-05-17T11:45:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3431690721 >> v2:172.21.15.3:3300/0 conn(0x7fbe480e2140 msgr2=0x7fbe480e25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb05a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb054050fa0 0x7fb054036530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2049601436 wait complete. 2023-05-17T11:45:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb05a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb054050fa0 0x7fb054036530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56328/0 (socket says 172.21.15.3:56328) 2023-05-17T11:45:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb05a59c640 1 -- 172.21.15.3:0/3285303127 learned_addr learned my addr 172.21.15.3:0/3285303127 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fbe4e7fc640 1 --2- 172.21.15.3:0/3431690721 >> v2:172.21.15.3:3300/0 conn(0x7fbe480e2140 0x7fbe480e25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3431690721 >> v1:172.21.15.60:6789/0 conn(0x7fbe48037f50 legacy=0x7fbe48038320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3431690721 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480e6700 con 0x7fbe480e3a00 2023-05-17T11:45:41.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fbe4ffff640 1 --2- 172.21.15.3:0/3431690721 >> v2:172.21.15.3:3300/0 conn(0x7fbe480e2140 0x7fbe480e25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:41.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb05a59c640 1 -- 172.21.15.3:0/3285303127 >> v1:172.21.15.60:6789/0 conn(0x7fb054036a70 legacy=0x7fb054052c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb05a59c640 1 -- 172.21.15.3:0/3285303127 >> v1:172.21.15.3:6789/0 conn(0x7fb0540e6c10 legacy=0x7fb05404f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7fb05a59c640 1 -- 172.21.15.3:0/3285303127 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540077d0 con 0x7fb054050fa0 2023-05-17T11:45:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f6bcfb52640 1 Processor -- start 2023-05-17T11:45:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a68052210 0x7f2a68036700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f6bcfb52640 1 -- start start 2023-05-17T11:45:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a68052850 0x7f2a680de620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcfb52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc806a600 0x7f6bc814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcfb52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc80b2820 0x7f6bc81515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcfb52640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bc8160010 0x7f6bc813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcfb52640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8148840 con 0x7f6bc806a600 2023-05-17T11:45:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcfb52640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc814e550 con 0x7f6bc80b2820 2023-05-17T11:45:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcfb52640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8147bc0 con 0x7f6bc8160010 2023-05-17T11:45:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a68005f90 con 0x7f2a680338e0 2023-05-17T11:45:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc806a600 0x7f6bc814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc806a600 0x7f6bc814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51600/0 (socket says 172.21.15.3:51600) 2023-05-17T11:45:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2428687011 learned_addr learned my addr 172.21.15.3:0/2428687011 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bce0ef640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bc8160010 0x7f6bc813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fd12c88b640 1 Processor -- start 2023-05-17T11:45:41.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aef125640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ae80b1fb0 0x7f0ae80b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aef125640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ae806fca0 0x7f0ae80700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aef125640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae8070600 con 0x7f0ae806c670 2023-05-17T11:45:41.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aef125640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae806d680 con 0x7f0ae80b1fb0 2023-05-17T11:45:41.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aef125640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae806d950 con 0x7f0ae806fca0 2023-05-17T11:45:41.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fd12c88b640 1 -- start start 2023-05-17T11:45:41.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd0ed640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc80b2820 0x7f6bc81515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fbe4e7fc640 1 --2- 172.21.15.3:0/3431690721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e3a00 0x7fbe48054900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097c0 tx=0x7fbe4401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e39ad38e051f6c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aecec1640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0ae806c670 0x7f0ae806cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:32776/0 (socket says 172.21.15.3:32776) 2023-05-17T11:45:41.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aecec1640 1 -- 172.21.15.3:0/4108916241 learned_addr learned my addr 172.21.15.3:0/4108916241 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0aed6c2640 1 --2- 172.21.15.3:0/4108916241 >> v2:172.21.15.60:3300/0 conn(0x7f0ae806fca0 0x7f0ae80700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0ae77fe640 1 -- 172.21.15.3:0/4108916241 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361319415 0 0) 0x7f0ae8070600 con 0x7f0ae806c670 2023-05-17T11:45:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f0ae77fe640 1 -- 172.21.15.3:0/4108916241 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad0003530 con 0x7f0ae806c670 2023-05-17T11:45:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f0aed6c2640 1 -- 172.21.15.3:0/4108916241 >> v2:172.21.15.3:3300/0 conn(0x7f0ae80b1fb0 msgr2=0x7f0ae80b2400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T11:45:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f0aed6c2640 1 --2- 172.21.15.3:0/4108916241 >> v2:172.21.15.3:3300/0 conn(0x7f0ae80b1fb0 0x7f0ae80b2400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f0aed6c2640 1 -- 172.21.15.3:0/4108916241 >> v1:172.21.15.60:6789/0 conn(0x7f0ae806c670 legacy=0x7f0ae806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fb05a59c640 1 --2- 172.21.15.3:0/3285303127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb054036530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009870 tx=0x7fb04c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebec70612fdde32c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f0aed6c2640 1 -- 172.21.15.3:0/4108916241 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae806dc30 con 0x7f0ae806fca0 2023-05-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680061e0 con 0x7f2a68052850 2023-05-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fbe4dffb640 1 -- 172.21.15.3:0/3431690721 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44004230 con 0x7fbe480e3a00 2023-05-17T11:45:41.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fbe4dffb640 1 -- 172.21.15.3:0/3431690721 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440a7050 con 0x7fbe480e3a00 2023-05-17T11:45:41.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fbe4dffb640 1 -- 172.21.15.3:0/3431690721 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44003620 con 0x7fbe480e3a00 2023-05-17T11:45:41.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a74bbe640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680064c0 con 0x7f2a68052210 2023-05-17T11:45:41.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a6f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a68052210 0x7f2a68036700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a6f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a68052210 0x7f2a68036700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56352/0 (socket says 172.21.15.3:56352) 2023-05-17T11:45:41.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/2709474432 learned_addr learned my addr 172.21.15.3:0/2709474432 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2428687011 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bc8160010 msgr2=0x7f6bc813f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.303+0000 7f2a6effd640 1 --2- 172.21.15.3:0/2709474432 >> v2:172.21.15.3:3300/0 conn(0x7f2a68052850 0x7f2a680de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/2709474432 >> v2:172.21.15.3:3300/0 conn(0x7f2a68052850 msgr2=0x7f2a680de620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f2a6f7fe640 1 --2- 172.21.15.3:0/2709474432 >> v2:172.21.15.3:3300/0 conn(0x7f2a68052850 0x7f2a680de620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/2709474432 >> v1:172.21.15.3:6789/0 conn(0x7f2a680338e0 legacy=0x7f2a680e2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/2709474432 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680067a0 con 0x7f2a68052210 2023-05-17T11:45:41.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bc8160010 0x7f6bc813f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2428687011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc80b2820 msgr2=0x7f6bc81515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc80b2820 0x7f6bc81515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 -- 172.21.15.3:0/2428687011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009420 con 0x7f6bc806a600 2023-05-17T11:45:41.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7f6bcd8ee640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc806a600 0x7f6bc814fa80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ae040 tx=0x7f6bc001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fbe5548c640 1 -- 172.21.15.3:0/3431690721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e3a00 msgr2=0x7fbe48054900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fbe5548c640 1 --2- 172.21.15.3:0/3431690721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e3a00 0x7fbe48054900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097c0 tx=0x7fbe4401c350 comp rx=0 tx=0).stop 2023-05-17T11:45:41.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fb059d9b640 1 -- 172.21.15.3:0/3285303127 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0ab600 con 0x7fb054050fa0 2023-05-17T11:45:41.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fb059d9b640 1 -- 172.21.15.3:0/3285303127 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0a7050 con 0x7fb054050fa0 2023-05-17T11:45:41.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.307+0000 7fb059d9b640 1 -- 172.21.15.3:0/3285303127 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0ab980 con 0x7fb054050fa0 2023-05-17T11:45:41.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00abe90 con 0x7f6bc806a600 2023-05-17T11:45:41.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00b7450 con 0x7f6bc806a600 2023-05-17T11:45:41.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00b77e0 con 0x7f6bc806a600 2023-05-17T11:45:41.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2428687011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc0009420 con 0x7f6bc806a600 2023-05-17T11:45:41.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f6bcfb52640 1 -- 172.21.15.3:0/2428687011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc816afb0 con 0x7f6bc806a600 2023-05-17T11:45:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 -- 172.21.15.3:0/3285303127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 msgr2=0x7fb054036530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 --2- 172.21.15.3:0/3285303127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb054036530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009870 tx=0x7fb04c01c430 comp rx=0 tx=0).stop 2023-05-17T11:45:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12c88b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c0d0 0x7fd1280afc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12c88b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd12815c4a0 0x7fd1280d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12c88b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1280b1680 0x7fd1280d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12c88b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280b14d0 con 0x7fd12815c4a0 2023-05-17T11:45:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12c88b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280d1090 con 0x7fd1280b1680 2023-05-17T11:45:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12c88b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b1040 con 0x7fd12815c0d0 2023-05-17T11:45:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a6f7fe640 1 --2- 172.21.15.3:0/2709474432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 0x7f2a68036700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800dab0 tx=0x7f2a5c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8948bdd3ec1826 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a6e7fc640 1 -- 172.21.15.3:0/2709474432 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0aa620 con 0x7f2a68052210 2023-05-17T11:45:41.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a6e7fc640 1 -- 172.21.15.3:0/2709474432 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0aa780 con 0x7f2a68052210 2023-05-17T11:45:41.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a6e7fc640 1 -- 172.21.15.3:0/2709474432 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0aa620 con 0x7f2a68052210 2023-05-17T11:45:41.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd11e59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd12815c4a0 0x7fd1280d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd11e59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd12815c4a0 0x7fd1280d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51604/0 (socket says 172.21.15.3:51604) 2023-05-17T11:45:41.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd11e59c640 1 -- 172.21.15.3:0/3624350891 learned_addr learned my addr 172.21.15.3:0/3624350891 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3624350891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c0d0 0x7fd1280afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd12759e640 1 --2- 172.21.15.3:0/3624350891 >> v2:172.21.15.60:3300/0 conn(0x7fd1280b1680 0x7fd1280d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd126d9d640 1 -- 172.21.15.3:0/3624350891 >> v2:172.21.15.60:3300/0 conn(0x7fd1280b1680 msgr2=0x7fd1280d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3624350891 >> v2:172.21.15.60:3300/0 conn(0x7fd1280b1680 0x7fd1280d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd126d9d640 1 -- 172.21.15.3:0/3624350891 >> v2:172.21.15.3:3300/0 conn(0x7fd12815c4a0 msgr2=0x7fd1280d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3624350891 >> v2:172.21.15.3:3300/0 conn(0x7fd12815c4a0 0x7fd1280d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fd126d9d640 1 -- 172.21.15.3:0/3624350891 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280b0190 con 0x7fd12815c0d0 2023-05-17T11:45:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fbe5548c640 1 -- 172.21.15.3:0/3431690721 shutdown_connections 2023-05-17T11:45:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fbe5548c640 1 --2- 172.21.15.3:0/3431690721 >> v2:172.21.15.3:3300/0 conn(0x7fbe480e2140 0x7fbe480e25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fbe5548c640 1 --2- 172.21.15.3:0/3431690721 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e3a00 0x7fbe48054900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fbe5548c640 1 -- 172.21.15.3:0/3431690721 >> 172.21.15.3:0/3431690721 conn(0x7fbe48052f50 msgr2=0x7fbe48053350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ba4000fd0 con 0x7f6bc806a600 2023-05-17T11:45:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 -- 172.21.15.3:0/3285303127 shutdown_connections 2023-05-17T11:45:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 --2- 172.21.15.3:0/3285303127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb054036530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 -- 172.21.15.3:0/3285303127 >> 172.21.15.3:0/3285303127 conn(0x7fb054051530 msgr2=0x7fb054051930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fbe5548c640 1 -- 172.21.15.3:0/3431690721 shutdown_connections 2023-05-17T11:45:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f0aed6c2640 1 --2- 172.21.15.3:0/4108916241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 0x7f0ae80700c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8066ee0 tx=0x7f0adc02d240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303fae30888be04f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fbe5548c640 1 -- 172.21.15.3:0/3431690721 wait complete. 2023-05-17T11:45:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a74bbe640 1 -- 172.21.15.3:0/2709474432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 msgr2=0x7f2a68036700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a74bbe640 1 --2- 172.21.15.3:0/2709474432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 0x7f2a68036700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800dab0 tx=0x7f2a5c01c4a0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 -- 172.21.15.3:0/3285303127 shutdown_connections 2023-05-17T11:45:41.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7fb061160640 1 -- 172.21.15.3:0/3285303127 wait complete. 2023-05-17T11:45:41.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f0ae77fe640 1 -- 172.21.15.3:0/4108916241 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8001680 con 0x7f0ae806fca0 2023-05-17T11:45:41.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f0ae77fe640 1 -- 172.21.15.3:0/4108916241 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc0b8050 con 0x7f0ae806fca0 2023-05-17T11:45:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f0ae77fe640 1 -- 172.21.15.3:0/4108916241 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0bc600 con 0x7f0ae806fca0 2023-05-17T11:45:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a74bbe640 1 -- 172.21.15.3:0/2709474432 shutdown_connections 2023-05-17T11:45:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a74bbe640 1 --2- 172.21.15.3:0/2709474432 >> v2:172.21.15.3:3300/0 conn(0x7f2a68052850 0x7f2a680de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a74bbe640 1 --2- 172.21.15.3:0/2709474432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 0x7f2a68036700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f2a74bbe640 1 -- 172.21.15.3:0/2709474432 >> 172.21.15.3:0/2709474432 conn(0x7f2a68051700 msgr2=0x7f2a68051b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.311+0000 7f0e3f02a640 1 Processor -- start 2023-05-17T11:45:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0e3f02a640 1 -- start start 2023-05-17T11:45:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 -- 172.21.15.3:0/4108916241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 msgr2=0x7f0ae80700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 --2- 172.21.15.3:0/4108916241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 0x7f0ae80700c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8066ee0 tx=0x7f0adc02d240 comp rx=0 tx=0).stop 2023-05-17T11:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 -- 172.21.15.3:0/4108916241 shutdown_connections 2023-05-17T11:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 --2- 172.21.15.3:0/4108916241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 0x7f0ae80700c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 --2- 172.21.15.3:0/4108916241 >> v2:172.21.15.3:3300/0 conn(0x7f0ae80b1fb0 0x7f0ae80b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 -- 172.21.15.3:0/4108916241 >> 172.21.15.3:0/4108916241 conn(0x7f0ae806bb60 msgr2=0x7f0ae806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 -- 172.21.15.3:0/4108916241 shutdown_connections 2023-05-17T11:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fcb358d7640 1 Processor -- start 2023-05-17T11:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fb061160640 1 Processor -- start 2023-05-17T11:45:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fb061160640 1 -- start start 2023-05-17T11:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0aef125640 1 -- 172.21.15.3:0/4108916241 wait complete. 2023-05-17T11:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bc00b7940 con 0x7f6bc806a600 2023-05-17T11:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f6bbe7fc640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bac066350 0x7f6bac068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bc011ed00 con 0x7f6bc806a600 2023-05-17T11:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f6bcd0ed640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bac066350 0x7f6bac068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fbe5548c640 1 Processor -- start 2023-05-17T11:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fbe5548c640 1 -- start start 2023-05-17T11:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fbe5548c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe48037f50 0x7fbe480e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe5548c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e2140 0x7fbe480d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe5548c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe480e3a00 0x7fbe480da860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e2140 0x7fbe480d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e2140 0x7fbe480d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53758/0 (socket says 172.21.15.3:53758) 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3967791747 learned_addr learned my addr 172.21.15.3:0/3967791747 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4ffff640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe480e3a00 0x7fbe480da860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480db3f0 con 0x7fbe48037f50 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480d6970 con 0x7fbe480e3a00 2023-05-17T11:45:41.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480dcf90 con 0x7fbe480e2140 2023-05-17T11:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb061160640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb054036a70 0x7fb0540e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb061160640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb0540dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb061160640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb0540e6c10 0x7fb054049890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb061160640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05404c090 con 0x7fb054036a70 2023-05-17T11:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb061160640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540ea0f0 con 0x7fb054050fa0 2023-05-17T11:45:41.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb061160640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540e8b30 con 0x7fb0540e6c10 2023-05-17T11:45:41.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05b59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb0540e6c10 0x7fb054049890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05b59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb0540e6c10 0x7fb054049890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53766/0 (socket says 172.21.15.3:53766) 2023-05-17T11:45:41.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05b59e640 1 -- 172.21.15.3:0/1065040029 learned_addr learned my addr 172.21.15.3:0/1065040029 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb0540dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3624350891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c0d0 0x7fd1280afc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1280d3300 tx=0x7fd11801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df9f8e6d4a04aa06 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fd12659c640 1 -- 172.21.15.3:0/3624350891 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ab600 con 0x7fd12815c0d0 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fd12659c640 1 -- 172.21.15.3:0/3624350891 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180a7050 con 0x7fd12815c0d0 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fd12659c640 1 -- 172.21.15.3:0/3624350891 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ab980 con 0x7fd12815c0d0 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 -- 172.21.15.3:0/3624350891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c0d0 msgr2=0x7fd1280afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3624350891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c0d0 0x7fd1280afc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1280d3300 tx=0x7fd11801c380 comp rx=0 tx=0).stop 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 -- 172.21.15.3:0/3624350891 shutdown_connections 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3624350891 >> v2:172.21.15.60:3300/0 conn(0x7fd1280b1680 0x7fd1280d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3624350891 >> v2:172.21.15.3:3300/0 conn(0x7fd12815c4a0 0x7fd1280d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3624350891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c0d0 0x7fd1280afc50 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1280d3300 tx=0x7fd11801c380 comp rx=0 tx=0).stop 2023-05-17T11:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 -- 172.21.15.3:0/3624350891 >> 172.21.15.3:0/3624350891 conn(0x7fd12809b950 msgr2=0x7fd1280d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aef125640 1 Processor -- start 2023-05-17T11:45:41.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aef125640 1 -- start start 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f2a74bbe640 1 -- 172.21.15.3:0/2709474432 shutdown_connections 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f2a74bbe640 1 -- 172.21.15.3:0/2709474432 wait complete. 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f2a74bbe640 1 Processor -- start 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f2a74bbe640 1 -- start start 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a74bbe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2a680338e0 0x7f2a680edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a74bbe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 0x7f2a680ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2a680338e0 0x7f2a680edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2a680338e0 0x7f2a680edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53778/0 (socket says 172.21.15.3:53778) 2023-05-17T11:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/1796337469 learned_addr learned my addr 172.21.15.3:0/1796337469 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6effd640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 0x7f2a680ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a74bbe640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a68052850 0x7f2a68048f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0e3f02a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e30036d50 0x7f0e3004f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0e3e028640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0e300dc250 0x7f0e30036640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:32778/0 (socket says 172.21.15.3:32778) 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0e3e028640 1 -- 172.21.15.3:0/673001339 learned_addr learned my addr 172.21.15.3:0/673001339 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7f0e3d827640 1 --2- 172.21.15.3:0/673001339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e30036d50 0x7f0e3004f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300ded10 con 0x7f0e3004f750 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300defd0 con 0x7f0e300dc250 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300df2b0 con 0x7f0e30036d50 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3d026640 1 -- 172.21.15.3:0/673001339 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159369837 0 0) 0x7f0e300defd0 con 0x7f0e300dc250 2023-05-17T11:45:41.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3d026640 1 -- 172.21.15.3:0/673001339 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e24003530 con 0x7f0e300dc250 2023-05-17T11:45:41.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fcb358d7640 1 -- start start 2023-05-17T11:45:41.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fcb358d7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb280e07c0 0x7fcb28053180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.315+0000 7fcb358d7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcb28056890 0x7fcb28006810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb358d7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28005dc0 con 0x7fcb28038740 2023-05-17T11:45:41.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb358d7640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb28006d50 con 0x7fcb28056890 2023-05-17T11:45:41.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb358d7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb28038cb0 con 0x7fcb280e07c0 2023-05-17T11:45:41.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb350d6640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcb28038740 0x7fcb28051310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:32782/0 (socket says 172.21.15.3:32782) 2023-05-17T11:45:41.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb350d6640 1 -- 172.21.15.3:0/3550608217 learned_addr learned my addr 172.21.15.3:0/3550608217 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613582656 0 0) 0x7fcb28005dc0 con 0x7fcb28038740 2023-05-17T11:45:41.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb20003530 con 0x7fcb28038740 2023-05-17T11:45:41.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3967791747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe480e3a00 msgr2=0x7fbe480da860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe480e3a00 0x7fbe480da860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe48037f50 msgr2=0x7fbe480e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe48037f50 0x7fbe480e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009420 con 0x7fbe480e2140 2023-05-17T11:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 -- 172.21.15.3:0/3624350891 shutdown_connections 2023-05-17T11:45:41.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68048790 con 0x7f2a68052850 2023-05-17T11:45:41.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f6bbe7fc640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] conn(0x7f6bac06ea90 0x7f6bac070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 --> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bac071550 con 0x7f6bac06ea90 2023-05-17T11:45:41.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bc011f0b0 con 0x7f6bc806a600 2023-05-17T11:45:41.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f6bce0ef640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] conn(0x7f6bac06ea90 0x7f6bac070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe4e7fc640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e2140 0x7fbe480d38c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe44018f60 tx=0x7fbe440190f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 -- 172.21.15.3:0/1065040029 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb0540e6c10 msgr2=0x7fb054049890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb0540e6c10 0x7fb054049890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 -- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb054036a70 msgr2=0x7fb0540e9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb054036a70 0x7fb0540e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 -- 172.21.15.3:0/1065040029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0094d0 con 0x7fb054050fa0 2023-05-17T11:45:41.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fb05a59c640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb0540dd8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb05400c220 tx=0x7fb04c0191d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aef125640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ae806c670 0x7f0ae814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aef125640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 0x7f0ae814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aecec1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ae806c670 0x7f0ae814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aecec1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ae806c670 0x7f0ae814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53782/0 (socket says 172.21.15.3:53782) 2023-05-17T11:45:41.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aecec1640 1 -- 172.21.15.3:0/3954701207 learned_addr learned my addr 172.21.15.3:0/3954701207 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0aef125640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae80b1fb0 0x7f0ae814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0ae7fff640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 0x7f0ae814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68035cb0 con 0x7f2a68052210 2023-05-17T11:45:41.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6804b1b0 con 0x7f2a680338e0 2023-05-17T11:45:41.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 msgr2=0x7f2a680ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a68052210 0x7f2a680ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a68052850 msgr2=0x7f2a68048f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a68052850 0x7f2a68048f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f2a6f7fe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0094d0 con 0x7f2a680338e0 2023-05-17T11:45:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3d827640 1 -- 172.21.15.3:0/673001339 >> v1:172.21.15.60:6789/0 conn(0x7f0e300dc250 legacy=0x7f0e30036640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3d827640 1 -- 172.21.15.3:0/673001339 >> v1:172.21.15.3:6789/0 conn(0x7f0e3004f750 legacy=0x7f0e30005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f0e3d827640 1 -- 172.21.15.3:0/673001339 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300df590 con 0x7f0e30036d50 2023-05-17T11:45:41.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb348d5640 1 --2- 172.21.15.3:0/3550608217 >> v2:172.21.15.60:3300/0 conn(0x7fcb280e07c0 0x7fcb28053180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 <== mon.1 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551631511 0 0) 0x7fcb20003530 con 0x7fcb28038740 2023-05-17T11:45:41.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 >> v2:172.21.15.60:3300/0 conn(0x7fcb280e07c0 msgr2=0x7fcb28053180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 --2- 172.21.15.3:0/3550608217 >> v2:172.21.15.60:3300/0 conn(0x7fcb280e07c0 0x7fcb28053180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 >> v2:172.21.15.3:3300/0 conn(0x7fcb28056890 msgr2=0x7fcb28006810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 --2- 172.21.15.3:0/3550608217 >> v2:172.21.15.3:3300/0 conn(0x7fcb28056890 0x7fcb28006810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28038f90 con 0x7fcb28038740 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 <== mon.1 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fcb30067d90 con 0x7fcb28038740 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 >> v1:172.21.15.60:6789/0 conn(0x7fcb28038740 legacy=0x7fcb28051310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb20003980 0x7fcb20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb20005180 0x7fcb2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28006d50 con 0x7fcb20003980 2023-05-17T11:45:41.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28038cb0 con 0x7fcb200047d0 2023-05-17T11:45:41.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2000c030 con 0x7fcb20005180 2023-05-17T11:45:41.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0b5850 con 0x7fb054050fa0 2023-05-17T11:45:41.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80cd990 con 0x7f0ae80b1fb0 2023-05-17T11:45:41.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0b59b0 con 0x7fb054050fa0 2023-05-17T11:45:41.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0b5d40 con 0x7fb054050fa0 2023-05-17T11:45:41.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fb061160640 1 -- 172.21.15.3:0/1065040029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb054053b20 con 0x7fb054050fa0 2023-05-17T11:45:41.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fb061160640 1 -- 172.21.15.3:0/1065040029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0540074f0 con 0x7fb054050fa0 2023-05-17T11:45:41.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae815d3b0 con 0x7f0ae806fca0 2023-05-17T11:45:41.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7f6bce0ef640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] conn(0x7f6bac06ea90 0x7f6bac070ea0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae815d080 con 0x7f0ae806c670 2023-05-17T11:45:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fd12c88b640 1 -- 172.21.15.3:0/3624350891 wait complete. 2023-05-17T11:45:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 Processor -- start 2023-05-17T11:45:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f2a6f7fe640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2a680338e0 0x7f2a680edaf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c019110 tx=0x7f2a5c0192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aed6c2640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae80b1fb0 0x7f0ae814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aecec1640 1 -- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 msgr2=0x7f0ae814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aecec1640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae806fca0 0x7f0ae814e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aecec1640 1 -- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae80b1fb0 msgr2=0x7f0ae814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aecec1640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae80b1fb0 0x7f0ae814ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aecec1640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc009420 con 0x7f0ae806c670 2023-05-17T11:45:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aecec1640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ae806c670 0x7f0ae814ce30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c840 tx=0x7f0ad800cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 -- start start 2023-05-17T11:45:41.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== osd.0 v2:172.21.15.3:6800/1433398339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6bac071550 con 0x7f6bac06ea90 2023-05-17T11:45:41.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f6bcd0ed640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bac066350 0x7f6bac068800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc815f4e0 tx=0x7f6bb8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fb061160640 1 -- 172.21.15.3:0/1065040029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb054053cb0 con 0x7fb054050fa0 2023-05-17T11:45:41.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80074e0 con 0x7f0ae806c670 2023-05-17T11:45:41.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb20005180 0x7fcb2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb2ffff640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.319+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44003b70 con 0x7fbe480e2140 2023-05-17T11:45:41.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44003cd0 con 0x7fbe480e2140 2023-05-17T11:45:41.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440ab640 con 0x7fbe480e2140 2023-05-17T11:45:41.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae8158670 con 0x7f0ae806c670 2023-05-17T11:45:41.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb350d6640 1 -- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb200047d0 msgr2=0x7fcb20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb350d6640 1 -- 172.21.15.3:0/3550608217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb20003980 msgr2=0x7fcb20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb20003980 0x7fcb20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fcb350d6640 1 -- 172.21.15.3:0/3550608217 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28038f90 con 0x7fcb20005180 2023-05-17T11:45:41.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae80b1a90 con 0x7f0ae806c670 2023-05-17T11:45:41.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1280b1680 0x7fd1280b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe48054e40 con 0x7fbe480e2140 2023-05-17T11:45:41.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480e2b00 con 0x7fbe480e2140 2023-05-17T11:45:41.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8007640 con 0x7f0ae806c670 2023-05-17T11:45:41.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8004a10 con 0x7f0ae806c670 2023-05-17T11:45:41.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c4a0 0x7fd12806be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1280b3d60 0x7fd12806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281f3d00 con 0x7fd1280b1680 2023-05-17T11:45:41.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281f3fc0 con 0x7fd1280b3d60 2023-05-17T11:45:41.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7fd12c88b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281f42a0 con 0x7fd12815c4a0 2023-05-17T11:45:41.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe48054fd0 con 0x7fbe480e2140 2023-05-17T11:45:41.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3d827640 1 --2- 172.21.15.3:0/673001339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e30036d50 0x7f0e3004f210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e280097f0 tx=0x7f0e2801ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf2ae24f7460550 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0aaaf0 con 0x7f2a680338e0 2023-05-17T11:45:41.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0aac50 con 0x7f2a680338e0 2023-05-17T11:45:41.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.323+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c004510 con 0x7f2a680338e0 2023-05-17T11:45:41.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1280b1680 0x7fd1280b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1280b1680 0x7fd1280b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51686/0 (socket says 172.21.15.3:51686) 2023-05-17T11:45:41.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 -- 172.21.15.3:0/3692575516 learned_addr learned my addr 172.21.15.3:0/3692575516 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a680decf0 con 0x7f2a680338e0 2023-05-17T11:45:41.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a680deb60 con 0x7f2a680338e0 2023-05-17T11:45:41.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 -- 172.21.15.3:0/3692575516 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c4a0 msgr2=0x7fd12806be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd12815c4a0 0x7fd12806be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 -- 172.21.15.3:0/3692575516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1280b3d60 msgr2=0x7fd12806c340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T11:45:41.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1280b3d60 0x7fd12806c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 -- 172.21.15.3:0/3692575516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180093b0 con 0x7fd1280b1680 2023-05-17T11:45:41.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3d026640 1 -- 172.21.15.3:0/673001339 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280ab600 con 0x7f0e30036d50 2023-05-17T11:45:41.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3d026640 1 -- 172.21.15.3:0/673001339 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280a7050 con 0x7f0e30036d50 2023-05-17T11:45:41.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3d026640 1 -- 172.21.15.3:0/673001339 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280ab980 con 0x7f0e30036d50 2023-05-17T11:45:41.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a68006cc0 con 0x7f2a680338e0 2023-05-17T11:45:41.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ac8000fd0 con 0x7f0ae806c670 2023-05-17T11:45:41.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd126d9d640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1280b1680 0x7fd1280b2530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd118019fb0 tx=0x7fd11801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180b7450 con 0x7fd1280b1680 2023-05-17T11:45:41.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180b75b0 con 0x7fd1280b1680 2023-05-17T11:45:41.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180b7960 con 0x7fd1280b1680 2023-05-17T11:45:41.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280b0cd0 con 0x7fd1280b1680 2023-05-17T11:45:41.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ad8004b70 con 0x7f0ae806c670 2023-05-17T11:45:41.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e30036d50 msgr2=0x7f0e3004f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3f02a640 1 --2- 172.21.15.3:0/673001339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e30036d50 0x7f0e3004f210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e280097f0 tx=0x7f0e2801ce10 comp rx=0 tx=0).stop 2023-05-17T11:45:41.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 shutdown_connections 2023-05-17T11:45:41.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3f02a640 1 --2- 172.21.15.3:0/673001339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e30036d50 0x7f0e3004f210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 >> 172.21.15.3:0/673001339 conn(0x7f0e30051640 msgr2=0x7f0e30051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb04c0be410 con 0x7fb054050fa0 2023-05-17T11:45:41.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fb0437fe640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb048066350 0x7fb048068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb04c11ec70 con 0x7fb054050fa0 2023-05-17T11:45:41.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a5c0059a0 con 0x7f2a680338e0 2023-05-17T11:45:41.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fb0437fe640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] conn(0x7fb04806ec00 0x7fb048071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 --> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0480716c0 con 0x7fb04806ec00 2023-05-17T11:45:41.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb04c11f020 con 0x7fb054050fa0 2023-05-17T11:45:41.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb05ad9d640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb048066350 0x7fb048068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb05b59e640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] conn(0x7fb04806ec00 0x7fb048071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f0ae57fa640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0ad4066350 0x7f0ad4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f0ae7fff640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0ad4066350 0x7f0ad4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fcb350d6640 1 -- 172.21.15.3:0/3550608217 reap_dead start 2023-05-17T11:45:41.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.327+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb20005180 0x7fcb2000b990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcb30068150 tx=0x7fcb3009f160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96adc8267ba9f4bb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30127d90 con 0x7fcb20005180 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30069ab0 con 0x7fcb20005180 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb2f7fe640 1 -- 172.21.15.3:0/3550608217 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30069e60 con 0x7fcb20005180 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 -- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb20005180 msgr2=0x7fcb2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb20005180 0x7fcb2000b990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcb30068150 tx=0x7fcb3009f160 comp rx=0 tx=0).stop 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 -- 172.21.15.3:0/3550608217 shutdown_connections 2023-05-17T11:45:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 --2- 172.21.15.3:0/3550608217 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb20005180 0x7fcb2000b990 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 -- 172.21.15.3:0/3550608217 >> 172.21.15.3:0/3550608217 conn(0x7fcb28053740 msgr2=0x7fcb28053b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb05ad9d640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb048066350 0x7fb048068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb05c04f6f0 tx=0x7fb05c078de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb05b59e640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] conn(0x7fb04806ec00 0x7fb048071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe440b2050 con 0x7fbe480e2140 2023-05-17T11:45:41.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe377fe640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbe3c066350 0x7fbe3c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe4411e980 con 0x7fbe480e2140 2023-05-17T11:45:41.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe377fe640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] conn(0x7fbe3c06ec00 0x7fbe3c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe4effd640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbe3c066350 0x7fbe3c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe3c0716c0 con 0x7fbe3c06ec00 2023-05-17T11:45:41.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe4411ed30 con 0x7fbe480e2140 2023-05-17T11:45:41.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 -- 172.21.15.3:0/3550608217 shutdown_connections 2023-05-17T11:45:41.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a5bfff640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2a54066350 0x7f2a54068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a5c11f130 con 0x7f2a680338e0 2023-05-17T11:45:41.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a5bfff640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] conn(0x7f2a5406ec00 0x7f2a54071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a540716c0 con 0x7f2a5406ec00 2023-05-17T11:45:41.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a5c11f460 con 0x7f2a680338e0 2023-05-17T11:45:41.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1180b7ac0 con 0x7fd1280b1680 2023-05-17T11:45:41.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 shutdown_connections 2023-05-17T11:45:41.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe4ffff640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] conn(0x7fbe3c06ec00 0x7fbe3c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fbe4ffff640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] conn(0x7fbe3c06ec00 0x7fbe3c071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== osd.2 v2:172.21.15.3:6809/1833145018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb0480716c0 con 0x7fb04806ec00 2023-05-17T11:45:41.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a6effd640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2a54066350 0x7f2a54068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f2a75e20640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] conn(0x7f2a5406ec00 0x7f2a54071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f0e3f02a640 1 -- 172.21.15.3:0/673001339 wait complete. 2023-05-17T11:45:41.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f0ae7fff640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0ad4066350 0x7f0ad4068800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80b0db0 tx=0x7f0ae0009540 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ad8083760 con 0x7f0ae806c670 2023-05-17T11:45:41.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0ae57fa640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] conn(0x7f0ad406ec00 0x7f0ad4071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f2a6effd640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2a54066350 0x7f2a54068800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a6803a630 tx=0x7f2a64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f2a75e20640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] conn(0x7f2a5406ec00 0x7f2a54071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280b09f0 con 0x7fd1280b1680 2023-05-17T11:45:41.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fbe4effd640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbe3c066350 0x7fbe3c068800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe50000b70 tx=0x7fbe50072540 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11ffff640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd1080662d0 0x7fd108068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== osd.1 v2:172.21.15.3:6811/2665961272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe3c0716c0 con 0x7fbe3c06ec00 2023-05-17T11:45:41.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ad40716c0 con 0x7f0ad406ec00 2023-05-17T11:45:41.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ad8085d80 con 0x7f0ae806c670 2023-05-17T11:45:41.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0aed6c2640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] conn(0x7f0ad406ec00 0x7f0ad4071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.331+0000 7fcb358d7640 1 -- 172.21.15.3:0/3550608217 wait complete. 2023-05-17T11:45:41.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 Processor -- start 2023-05-17T11:45:41.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fcb358d7640 1 Processor -- start 2023-05-17T11:45:41.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 -- start start 2023-05-17T11:45:41.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== osd.5 v2:172.21.15.60:6800/205590027 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2a540716c0 con 0x7f2a5406ec00 2023-05-17T11:45:41.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11e59c640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd1080662d0 0x7fd108068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1281f4130 con 0x7fd1280b1680 2023-05-17T11:45:41.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11e59c640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd1080662d0 0x7fd108068780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd110006f50 tx=0x7fd110006ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd11811d8c0 con 0x7fd1280b1680 2023-05-17T11:45:41.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11ffff640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] conn(0x7fd10806ea80 0x7fd108070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 --> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd108071540 con 0x7fd10806ea80 2023-05-17T11:45:41.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd11811f020 con 0x7fd1280b1680 2023-05-17T11:45:41.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0aed6c2640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] conn(0x7f0ad406ec00 0x7f0ad4071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e30036d50 0x7f0e300dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e3004f750 0x7f0e3017ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e300dc250 0x7f0e300ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300e0c90 con 0x7f0e30036d50 2023-05-17T11:45:41.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300dd4f0 con 0x7f0e300dc250 2023-05-17T11:45:41.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3f02a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300dfde0 con 0x7f0e3004f750 2023-05-17T11:45:41.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fcb358d7640 1 -- start start 2023-05-17T11:45:41.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7fd12759e640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] conn(0x7fd10806ea80 0x7fd108070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e3004f750 0x7f0e3017ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e3004f750 0x7f0e3017ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53816/0 (socket says 172.21.15.3:53816) 2023-05-17T11:45:41.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 -- 172.21.15.3:0/770550728 learned_addr learned my addr 172.21.15.3:0/770550728 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3e028640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e30036d50 0x7f0e300dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 -- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e300dc250 msgr2=0x7f0e300ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e300dc250 0x7f0e300ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 -- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e30036d50 msgr2=0x7f0e300dcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.335+0000 7f0e3d827640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e30036d50 0x7f0e300dcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e3d827640 1 -- 172.21.15.3:0/770550728 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28009420 con 0x7f0e3004f750 2023-05-17T11:45:41.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e3d827640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e3004f750 0x7f0e3017ec80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e280097f0 tx=0x7f0e28019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fd12759e640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] conn(0x7fd10806ea80 0x7fd108070e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== osd.4 v2:172.21.15.60:6809/325718632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0ad40716c0 con 0x7f0ad406ec00 2023-05-17T11:45:41.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b4400 con 0x7f0e3004f750 2023-05-17T11:45:41.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e30052790 con 0x7f0e3004f750 2023-05-17T11:45:41.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3004fb70 con 0x7f0e3004f750 2023-05-17T11:45:41.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280b4560 con 0x7f0e3004f750 2023-05-17T11:45:41.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb358d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb20005180 0x7fcb280d56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b48d0 con 0x7f0e3004f750 2023-05-17T11:45:41.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb358d7640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb2803c5c0 0x7fcb280d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb20005180 0x7fcb280d56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb20005180 0x7fcb280d56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56426/0 (socket says 172.21.15.3:56426) 2023-05-17T11:45:41.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 -- 172.21.15.3:0/3709463587 learned_addr learned my addr 172.21.15.3:0/3709463587 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb358d7640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb280d75b0 0x7fcb280d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d2150 con 0x7fcb280d75b0 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d2430 con 0x7fcb20005180 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d5c10 con 0x7fcb2803c5c0 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb280d75b0 0x7fcb280d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 -- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb2803c5c0 msgr2=0x7fcb280d28c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T11:45:41.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcb2803c5c0 0x7fcb280d28c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 -- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb280d75b0 msgr2=0x7fcb280d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb280d75b0 0x7fcb280d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28006810 con 0x7fcb20005180 2023-05-17T11:45:41.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== osd.3 v2:172.21.15.3:6808/2348065528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd108071540 con 0x7fd10806ea80 2023-05-17T11:45:41.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb280d75b0 0x7fcb280d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:41.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.339+0000 7fcb348d5640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb20005180 0x7fcb280d56d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400d7d0 tx=0x7fcb2400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240096a0 con 0x7fcb20005180 2023-05-17T11:45:41.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24009820 con 0x7fcb20005180 2023-05-17T11:45:41.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e280b2040 con 0x7f0e3004f750 2023-05-17T11:45:41.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb280e0b90 con 0x7fcb20005180 2023-05-17T11:45:41.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24009bd0 con 0x7fcb20005180 2023-05-17T11:45:41.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb280069a0 con 0x7fcb20005180 2023-05-17T11:45:41.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7f0e2effd640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0e1c066350 0x7f0e1c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e2811db40 con 0x7f0e3004f750 2023-05-17T11:45:41.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7f0e3e028640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0e1c066350 0x7f0e1c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.343+0000 7f0e3e028640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0e1c066350 0x7f0e1c068800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e34000fc0 tx=0x7f0e34007dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7f0e3f02a640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] conn(0x7f0e200015f0 0x7f0e20003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb24009d30 con 0x7fcb20005180 2023-05-17T11:45:41.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 --> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e20006b40 con 0x7f0e200015f0 2023-05-17T11:45:41.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb28005280 con 0x7fcb20005180 2023-05-17T11:45:41.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7f0e3e829640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] conn(0x7f0e200015f0 0x7f0e20003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2d7fa640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcb14066350 0x7fcb14068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7f0e3e829640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] conn(0x7f0e200015f0 0x7f0e20003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb24083f80 con 0x7fcb20005180 2023-05-17T11:45:41.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2d7fa640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] conn(0x7fcb1406ea90 0x7fcb14070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb14071550 con 0x7fcb1406ea90 2023-05-17T11:45:41.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2ffff640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcb14066350 0x7fcb14068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb24089530 con 0x7fcb20005180 2023-05-17T11:45:41.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] conn(0x7fcb1406ea90 0x7fcb14070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== osd.6 v2:172.21.15.60:6808/3529818869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0e20006b40 con 0x7f0e200015f0 2023-05-17T11:45:41.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7fcb350d6640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] conn(0x7fcb1406ea90 0x7fcb14070ea0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.347+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 --> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ba4002cc0 con 0x7f6bac06ea90 2023-05-17T11:45:41.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== osd.7 v2:172.21.15.60:6824/1617182656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcb14071550 con 0x7fcb1406ea90 2023-05-17T11:45:41.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6bbe7fc640 1 -- 172.21.15.3:0/2428687011 <== osd.0 v2:172.21.15.3:6800/1433398339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ba4002cc0 con 0x7f6bac06ea90 2023-05-17T11:45:41.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] conn(0x7f6bac06ea90 msgr2=0x7f6bac070ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6800/1433398339,v1:172.21.15.3:6801/1433398339] conn(0x7f6bac06ea90 0x7f6bac070ea0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bac066350 msgr2=0x7f6bac068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bac066350 0x7f6bac068800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc815f4e0 tx=0x7f6bb8009190 comp rx=0 tx=0).stop 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc806a600 msgr2=0x7f6bc814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 --2- 172.21.15.3:0/2428687011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc806a600 0x7f6bc814fa80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ae040 tx=0x7f6bc001ac10 comp rx=0 tx=0).stop 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6bce0ef640 1 -- 172.21.15.3:0/2428687011 reap_dead start 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 shutdown_connections 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 >> 172.21.15.3:0/2428687011 conn(0x7f6bc8069ab0 msgr2=0x7f6bc8155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 shutdown_connections 2023-05-17T11:45:41.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.351+0000 7f6babfff640 1 -- 172.21.15.3:0/2428687011 wait complete. 2023-05-17T11:45:41.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.355+0000 7fcb2ffff640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcb14066350 0x7fcb14068800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c004710 tx=0x7fcb1c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb061160640 1 -- 172.21.15.3:0/1065040029 --> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0540548b0 con 0x7fb04806ec00 2023-05-17T11:45:41.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb0437fe640 1 -- 172.21.15.3:0/1065040029 <== osd.2 v2:172.21.15.3:6809/1833145018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0540548b0 con 0x7fb04806ec00 2023-05-17T11:45:41.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] conn(0x7fb04806ec00 msgr2=0x7fb048071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb0417fa640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6809/1833145018,v1:172.21.15.3:6812/1833145018] conn(0x7fb04806ec00 0x7fb048071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb048066350 msgr2=0x7fb048068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb0417fa640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb048066350 0x7fb048068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb05c04f6f0 tx=0x7fb05c078de0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.363+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 msgr2=0x7fb0540dd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fb0417fa640 1 --2- 172.21.15.3:0/1065040029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb054050fa0 0x7fb0540dd8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb05400c220 tx=0x7fb04c0191d0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fb05b59e640 1 -- 172.21.15.3:0/1065040029 reap_dead start 2023-05-17T11:45:41.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 shutdown_connections 2023-05-17T11:45:41.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 >> 172.21.15.3:0/1065040029 conn(0x7fb054051530 msgr2=0x7fb054035ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 shutdown_connections 2023-05-17T11:45:41.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fb0417fa640 1 -- 172.21.15.3:0/1065040029 wait complete. 2023-05-17T11:45:41.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 --> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe48054fd0 con 0x7fbe3c06ec00 2023-05-17T11:45:41.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fbe377fe640 1 -- 172.21.15.3:0/3967791747 <== osd.1 v2:172.21.15.3:6811/2665961272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe48054fd0 con 0x7fbe3c06ec00 2023-05-17T11:45:41.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 --> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ac8002cc0 con 0x7f0ad406ec00 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] conn(0x7fbe3c06ec00 msgr2=0x7fbe3c071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fbe5548c640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6811/2665961272,v1:172.21.15.3:6815/2665961272] conn(0x7fbe3c06ec00 0x7fbe3c071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbe3c066350 msgr2=0x7fbe3c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.367+0000 7fbe5548c640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbe3c066350 0x7fbe3c068800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe50000b70 tx=0x7fbe50072540 comp rx=0 tx=0).stop 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e2140 msgr2=0x7fbe480d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe5548c640 1 --2- 172.21.15.3:0/3967791747 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbe480e2140 0x7fbe480d38c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe44018f60 tx=0x7fbe440190f0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe4ffff640 1 -- 172.21.15.3:0/3967791747 reap_dead start 2023-05-17T11:45:41.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0ae57fa640 1 -- 172.21.15.3:0/3954701207 <== osd.4 v2:172.21.15.60:6809/325718632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ac8002cc0 con 0x7f0ad406ec00 2023-05-17T11:45:41.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 shutdown_connections 2023-05-17T11:45:41.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 >> 172.21.15.3:0/3967791747 conn(0x7fbe48052f50 msgr2=0x7fbe480514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 shutdown_connections 2023-05-17T11:45:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7fbe5548c640 1 -- 172.21.15.3:0/3967791747 wait complete. 2023-05-17T11:45:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] conn(0x7f0ad406ec00 msgr2=0x7f0ad4071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:6809/325718632,v1:172.21.15.60:6811/325718632] conn(0x7f0ad406ec00 0x7f0ad4071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0ad4066350 msgr2=0x7f0ad4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0ad4066350 0x7f0ad4068800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80b0db0 tx=0x7f0ae0009540 comp rx=0 tx=0).stop 2023-05-17T11:45:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ae806c670 msgr2=0x7f0ae814ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f2a74bbe640 1 -- 172.21.15.3:0/1796337469 --> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a68005450 con 0x7f2a5406ec00 2023-05-17T11:45:41.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 --2- 172.21.15.3:0/3954701207 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ae806c670 0x7f0ae814ce30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c840 tx=0x7f0ad800cd00 comp rx=0 tx=0).stop 2023-05-17T11:45:41.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aed6c2640 1 -- 172.21.15.3:0/3954701207 reap_dead start 2023-05-17T11:45:41.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 shutdown_connections 2023-05-17T11:45:41.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f2a5bfff640 1 -- 172.21.15.3:0/1796337469 <== osd.5 v2:172.21.15.60:6800/205590027 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a68005450 con 0x7f2a5406ec00 2023-05-17T11:45:41.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.371+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 >> 172.21.15.3:0/3954701207 conn(0x7f0ae806bb60 msgr2=0x7f0ae806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 shutdown_connections 2023-05-17T11:45:41.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f0aef125640 1 -- 172.21.15.3:0/3954701207 wait complete. 2023-05-17T11:45:41.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 --> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1281605b0 con 0x7fd10806ea80 2023-05-17T11:45:41.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] conn(0x7f2a5406ec00 msgr2=0x7f2a54071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:6800/205590027,v1:172.21.15.60:6801/205590027] conn(0x7f2a5406ec00 0x7f2a54071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2a54066350 msgr2=0x7f2a54068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2a54066350 0x7f2a54068800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a6803a630 tx=0x7f2a64008040 comp rx=0 tx=0).stop 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2a680338e0 msgr2=0x7f2a680edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 --2- 172.21.15.3:0/1796337469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2a680338e0 0x7f2a680edaf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c019110 tx=0x7f2a5c0192a0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a75e20640 1 -- 172.21.15.3:0/1796337469 reap_dead start 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 shutdown_connections 2023-05-17T11:45:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 >> 172.21.15.3:0/1796337469 conn(0x7f2a68051700 msgr2=0x7f2a680346e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd11ffff640 1 -- 172.21.15.3:0/3692575516 <== osd.3 v2:172.21.15.3:6808/2348065528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1281605b0 con 0x7fd10806ea80 2023-05-17T11:45:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 shutdown_connections 2023-05-17T11:45:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7f2a59ffb640 1 -- 172.21.15.3:0/1796337469 wait complete. 2023-05-17T11:45:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] conn(0x7fd10806ea80 msgr2=0x7fd108070e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6808/2348065528,v1:172.21.15.3:6810/2348065528] conn(0x7fd10806ea80 0x7fd108070e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd1080662d0 msgr2=0x7fd108068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd1080662d0 0x7fd108068780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd110006f50 tx=0x7fd110006ea0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1280b1680 msgr2=0x7fd1280b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 --2- 172.21.15.3:0/3692575516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1280b1680 0x7fd1280b2530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd118019fb0 tx=0x7fd11801abc0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12759e640 1 -- 172.21.15.3:0/3692575516 reap_dead start 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 shutdown_connections 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 >> 172.21.15.3:0/3692575516 conn(0x7fd12809b950 msgr2=0x7fd1280af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 shutdown_connections 2023-05-17T11:45:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.375+0000 7fd12c88b640 1 -- 172.21.15.3:0/3692575516 wait complete. 2023-05-17T11:45:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 --> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb280d2570 con 0x7fcb1406ea90 2023-05-17T11:45:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb2d7fa640 1 -- 172.21.15.3:0/3709463587 <== osd.7 v2:172.21.15.60:6824/1617182656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb30094040 con 0x7fcb1406ea90 2023-05-17T11:45:41.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] conn(0x7fcb1406ea90 msgr2=0x7fcb14070ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:6824/1617182656,v1:172.21.15.60:6825/1617182656] conn(0x7fcb1406ea90 0x7fcb14070ea0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcb14066350 msgr2=0x7fcb14068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcb14066350 0x7fcb14068800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c004710 tx=0x7fcb1c009060 comp rx=0 tx=0).stop 2023-05-17T11:45:41.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb20005180 msgr2=0x7fcb280d56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 --2- 172.21.15.3:0/3709463587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb20005180 0x7fcb280d56d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400d7d0 tx=0x7fcb2400dc90 comp rx=0 tx=0).stop 2023-05-17T11:45:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 --> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e20005bc0 con 0x7f0e200015f0 2023-05-17T11:45:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb350d6640 1 -- 172.21.15.3:0/3709463587 reap_dead start 2023-05-17T11:45:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 shutdown_connections 2023-05-17T11:45:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 >> 172.21.15.3:0/3709463587 conn(0x7fcb28053740 msgr2=0x7fcb280d8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 shutdown_connections 2023-05-17T11:45:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7f0e2effd640 1 -- 172.21.15.3:0/770550728 <== osd.6 v2:172.21.15.60:6808/3529818869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e20005bc0 con 0x7f0e200015f0 2023-05-17T11:45:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.379+0000 7fcb358d7640 1 -- 172.21.15.3:0/3709463587 wait complete. 2023-05-17T11:45:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] conn(0x7f0e200015f0 msgr2=0x7f0e20003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:6808/3529818869,v1:172.21.15.60:6810/3529818869] conn(0x7f0e200015f0 0x7f0e20003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0e1c066350 msgr2=0x7f0e1c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f0e1c066350 0x7f0e1c068800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e34000fc0 tx=0x7f0e34007dd0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e3004f750 msgr2=0x7f0e3017ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 --2- 172.21.15.3:0/770550728 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0e3004f750 0x7f0e3017ec80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e280097f0 tx=0x7f0e28019150 comp rx=0 tx=0).stop 2023-05-17T11:45:41.442 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-05-17T11:45:41.443 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-17T11:45:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3e829640 1 -- 172.21.15.3:0/770550728 reap_dead start 2023-05-17T11:45:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 shutdown_connections 2023-05-17T11:45:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 >> 172.21.15.3:0/770550728 conn(0x7f0e30051640 msgr2=0x7f0e30052920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 shutdown_connections 2023-05-17T11:45:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.383+0000 7f0e3f02a640 1 -- 172.21.15.3:0/770550728 wait complete. 2023-05-17T11:45:41.445 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:41.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-17T11:45:41.446 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:41.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-17T11:45:41.447 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:41.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-17T11:45:41.448 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:41.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-17T11:45:41.449 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:41.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-17T11:45:41.450 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:41.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-17T11:45:41.451 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:41.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-17T11:45:41.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb168fc640 1 Processor -- start 2023-05-17T11:45:41.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb168fc640 1 -- start start 2023-05-17T11:45:41.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb168fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb10160010 0x7fdb1006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb0ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb10160010 0x7fdb1006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb0ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb10160010 0x7fdb1006fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51716/0 (socket says 172.21.15.3:51716) 2023-05-17T11:45:41.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb0ffff640 1 -- 172.21.15.3:0/280760952 learned_addr learned my addr 172.21.15.3:0/280760952 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.711+0000 7fdb168fc640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb100afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb10071b30 con 0x7fdb1006a600 2023-05-17T11:45:41.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb10070060 con 0x7fdb10160010 2023-05-17T11:45:41.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10164850 con 0x7fdb100b2820 2023-05-17T11:45:41.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0f7fe640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb100afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0effd640 1 -- 172.21.15.3:0/280760952 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537683949 0 0) 0x7fdb10071b30 con 0x7fdb1006a600 2023-05-17T11:45:41.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0effd640 1 -- 172.21.15.3:0/280760952 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf8003530 con 0x7fdb1006a600 2023-05-17T11:45:41.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0ffff640 1 -- 172.21.15.3:0/280760952 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 msgr2=0x7fdb100afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0ffff640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb100afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0ffff640 1 -- 172.21.15.3:0/280760952 >> v1:172.21.15.60:6789/0 conn(0x7fdb1006a600 legacy=0x7fdb101603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0ffff640 1 -- 172.21.15.3:0/280760952 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100717c0 con 0x7fdb10160010 2023-05-17T11:45:41.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7fdb0f7fe640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb100afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:41.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7f9058760640 1 Processor -- start 2023-05-17T11:45:41.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.715+0000 7f9058760640 1 -- start start 2023-05-17T11:45:41.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9058760640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90500b04e0 0x7f90500b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9058760640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90500cb600 con 0x7f9050158e60 2023-05-17T11:45:41.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9058760640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90500b33e0 con 0x7f9050070ed0 2023-05-17T11:45:41.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9058760640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500cbc10 con 0x7f90500b04e0 2023-05-17T11:45:41.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f90564fc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9050158e60 0x7f90500afdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46822/0 (socket says 172.21.15.3:46822) 2023-05-17T11:45:41.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f90564fc640 1 -- 172.21.15.3:0/2388162447 learned_addr learned my addr 172.21.15.3:0/2388162447 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9055cfb640 1 --2- 172.21.15.3:0/2388162447 >> v2:172.21.15.60:3300/0 conn(0x7f90500b04e0 0x7f90500b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f90554fa640 1 -- 172.21.15.3:0/2388162447 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653365911 0 0) 0x7f90500b33e0 con 0x7f9050070ed0 2023-05-17T11:45:41.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f90554fa640 1 -- 172.21.15.3:0/2388162447 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f903c003530 con 0x7f9050070ed0 2023-05-17T11:45:41.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9055cfb640 1 -- 172.21.15.3:0/2388162447 >> v1:172.21.15.60:6789/0 conn(0x7f9050070ed0 legacy=0x7f90500cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9055cfb640 1 -- 172.21.15.3:0/2388162447 >> v1:172.21.15.3:6789/0 conn(0x7f9050158e60 legacy=0x7f90500afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f90554fa640 1 -- 172.21.15.3:0/2388162447 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163617697 0 0) 0x7f90500cb600 con 0x7f9050158e60 2023-05-17T11:45:41.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7f9055cfb640 1 -- 172.21.15.3:0/2388162447 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500b2e20 con 0x7f90500b04e0 2023-05-17T11:45:41.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.719+0000 7fdb0ffff640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb1006fb20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009e50 tx=0x7fdb0801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac289dbe8c78d259 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb0effd640 1 -- 172.21.15.3:0/280760952 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a5750 con 0x7fdb10160010 2023-05-17T11:45:41.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb0effd640 1 -- 172.21.15.3:0/280760952 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb080a58b0 con 0x7fdb10160010 2023-05-17T11:45:41.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb0effd640 1 -- 172.21.15.3:0/280760952 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a5c40 con 0x7fdb10160010 2023-05-17T11:45:41.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 Processor -- start 2023-05-17T11:45:41.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 -- start start 2023-05-17T11:45:41.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 msgr2=0x7fdb1006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb1006fb20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009e50 tx=0x7fdb0801c9a0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 shutdown_connections 2023-05-17T11:45:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb100afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 --2- 172.21.15.3:0/280760952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb1006fb20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 >> 172.21.15.3:0/280760952 conn(0x7fdb10069ab0 msgr2=0x7fdb10069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 shutdown_connections 2023-05-17T11:45:41.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7fdb168fc640 1 -- 172.21.15.3:0/280760952 wait complete. 2023-05-17T11:45:41.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14a8036530 0x7f14a8036900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a804bb80 0x7f14a804c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f9055cfb640 1 --2- 172.21.15.3:0/2388162447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90500b04e0 0x7f90500b2720 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90400097c0 tx=0x7f904001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=505c906318a5bea5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a8053cc0 con 0x7f14a8054150 2023-05-17T11:45:41.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14aeffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f14a8054150 0x7f14a80525f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46838/0 (socket says 172.21.15.3:46838) 2023-05-17T11:45:41.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a80dec10 con 0x7f14a8036530 2023-05-17T11:45:41.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14aeffd640 1 -- 172.21.15.3:0/4065415286 learned_addr learned my addr 172.21.15.3:0/4065415286 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f90554fa640 1 -- 172.21.15.3:0/2388162447 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400ab680 con 0x7f90500b04e0 2023-05-17T11:45:41.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f90554fa640 1 -- 172.21.15.3:0/2388162447 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400ab7e0 con 0x7f90500b04e0 2023-05-17T11:45:41.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f90554fa640 1 -- 172.21.15.3:0/2388162447 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400abb70 con 0x7f90500b04e0 2023-05-17T11:45:41.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14affff640 1 --2- 172.21.15.3:0/4065415286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a804bb80 0x7f14a804c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.723+0000 7f14b61cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80530b0 con 0x7f14a804bb80 2023-05-17T11:45:41.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14af7fe640 1 --2- 172.21.15.3:0/4065415286 >> v2:172.21.15.60:3300/0 conn(0x7f14a8036530 0x7f14a8036900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14ae7fc640 1 -- 172.21.15.3:0/4065415286 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559098560 0 0) 0x7f14a8053cc0 con 0x7f14a8054150 2023-05-17T11:45:41.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14ae7fc640 1 -- 172.21.15.3:0/4065415286 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a0003530 con 0x7f14a8054150 2023-05-17T11:45:41.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f9058760640 1 -- 172.21.15.3:0/2388162447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90500b04e0 msgr2=0x7f90500b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f9058760640 1 --2- 172.21.15.3:0/2388162447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90500b04e0 0x7f90500b2720 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90400097c0 tx=0x7f904001c480 comp rx=0 tx=0).stop 2023-05-17T11:45:41.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7fdb168fc640 1 Processor -- start 2023-05-17T11:45:41.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f9058760640 1 -- 172.21.15.3:0/2388162447 shutdown_connections 2023-05-17T11:45:41.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f9058760640 1 --2- 172.21.15.3:0/2388162447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90500b04e0 0x7f90500b2720 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f9058760640 1 -- 172.21.15.3:0/2388162447 >> 172.21.15.3:0/2388162447 conn(0x7f9050069ab0 msgr2=0x7f9050069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14ae7fc640 1 -- 172.21.15.3:0/4065415286 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 262499020 0 0) 0x7f14a0003530 con 0x7f14a8054150 2023-05-17T11:45:41.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14affff640 1 -- 172.21.15.3:0/4065415286 >> v2:172.21.15.60:3300/0 conn(0x7f14a8036530 msgr2=0x7f14a8036900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14affff640 1 --2- 172.21.15.3:0/4065415286 >> v2:172.21.15.60:3300/0 conn(0x7f14a8036530 0x7f14a8036900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14affff640 1 -- 172.21.15.3:0/4065415286 >> v1:172.21.15.3:6789/0 conn(0x7f14a8054150 legacy=0x7f14a80525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f14affff640 1 -- 172.21.15.3:0/4065415286 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8053390 con 0x7f14a804bb80 2023-05-17T11:45:41.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7fec8286f640 1 Processor -- start 2023-05-17T11:45:41.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7fec8286f640 1 -- start start 2023-05-17T11:45:41.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7f9058760640 1 -- 172.21.15.3:0/2388162447 shutdown_connections 2023-05-17T11:45:41.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f9058760640 1 -- 172.21.15.3:0/2388162447 wait complete. 2023-05-17T11:45:41.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.727+0000 7fdb168fc640 1 -- start start 2023-05-17T11:45:41.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb168fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb1006a600 0x7fdb10143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb168fc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb10162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 Processor -- start 2023-05-17T11:45:41.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb168fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb10162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8286f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8286f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fec7c06d940 0x7fec7c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8286f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c15fa20 con 0x7fec7c0ceac0 2023-05-17T11:45:41.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8286f640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c1608a0 con 0x7fec7c06d940 2023-05-17T11:45:41.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8286f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c071740 con 0x7fec7c0cee90 2023-05-17T11:45:41.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb10162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb10162620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53850/0 (socket says 172.21.15.3:53850) 2023-05-17T11:45:41.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb0ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb1006a600 0x7fdb10143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb0ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb1006a600 0x7fdb10143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56448/0 (socket says 172.21.15.3:56448) 2023-05-17T11:45:41.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f14affff640 1 --2- 172.21.15.3:0/4065415286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a804bb80 0x7f14a804c000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14b004f0c0 tx=0x7f14b009ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f0d5ce530788f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8206e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fec7c06d940 0x7fec7c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8106c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8206e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fec7c06d940 0x7fec7c0cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51720/0 (socket says 172.21.15.3:51720) 2023-05-17T11:45:41.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8206e640 1 -- 172.21.15.3:0/170099975 learned_addr learned my addr 172.21.15.3:0/170099975 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb0f7fe640 1 -- 172.21.15.3:0/2184570159 learned_addr learned my addr 172.21.15.3:0/2184570159 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10157600 con 0x7fdb10160010 2023-05-17T11:45:41.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb10162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f14ae7fc640 1 -- 172.21.15.3:0/4065415286 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c001680 con 0x7f14a804bb80 2023-05-17T11:45:41.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f14ae7fc640 1 -- 172.21.15.3:0/4065415286 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b0123a50 con 0x7f14a804bb80 2023-05-17T11:45:41.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f14ae7fc640 1 -- 172.21.15.3:0/4065415286 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0123e40 con 0x7f14a804bb80 2023-05-17T11:45:41.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10163900 con 0x7fdb1006a600 2023-05-17T11:45:41.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f97441f3640 1 Processor -- start 2023-05-17T11:45:41.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f97441f3640 1 -- start start 2023-05-17T11:45:41.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101569c0 con 0x7fdb100b2820 2023-05-17T11:45:41.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f9058760640 1 Processor -- start 2023-05-17T11:45:41.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f14b61cb640 1 -- 172.21.15.3:0/4065415286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a804bb80 msgr2=0x7f14a804c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f14b61cb640 1 --2- 172.21.15.3:0/4065415286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a804bb80 0x7f14a804c000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14b004f0c0 tx=0x7f14b009ad20 comp rx=0 tx=0).stop 2023-05-17T11:45:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 -- 172.21.15.3:0/2184570159 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 msgr2=0x7fdb10162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb10162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 -- 172.21.15.3:0/2184570159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb1006a600 msgr2=0x7fdb10143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb1006a600 0x7fdb10143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009420 con 0x7fdb10160010 2023-05-17T11:45:41.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f9058760640 1 -- start start 2023-05-17T11:45:41.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 -- start start 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb7e0160530 0x7fb7e0164930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7e00d07c0 0x7fb7e0160900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0164e70 con 0x7fb7e00d0380 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00d0d20 con 0x7fb7e0160530 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7e4a12640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00d1000 con 0x7fb7e00d07c0 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7deffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb7e00d0380 0x7fb7e00cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46844/0 (socket says 172.21.15.3:46844) 2023-05-17T11:45:41.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7deffd640 1 -- 172.21.15.3:0/202336225 learned_addr learned my addr 172.21.15.3:0/202336225 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fb7dffff640 1 --2- 172.21.15.3:0/202336225 >> v2:172.21.15.60:3300/0 conn(0x7fb7e00d07c0 0x7fb7e0160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fdb14e99640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb10162b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c390 tx=0x7fdb0400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f9eed10b640 1 Processor -- start 2023-05-17T11:45:41.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7f9eed10b640 1 -- start start 2023-05-17T11:45:41.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb040052d0 con 0x7fdb10160010 2023-05-17T11:45:41.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04005430 con 0x7fdb10160010 2023-05-17T11:45:41.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04003840 con 0x7fdb10160010 2023-05-17T11:45:41.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb08009b30 con 0x7fdb10160010 2023-05-17T11:45:41.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1016cfc0 con 0x7fdb10160010 2023-05-17T11:45:41.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9058760640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9050070ed0 0x7f905014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f97441f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c0c5d30 0x7f973c06b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f97441f3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f973c06a9f0 0x7f973c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f97441f3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f973c0d08f0 0x7f973c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8106c640 1 -- 172.21.15.3:0/170099975 >> v2:172.21.15.3:3300/0 conn(0x7fec7c06d940 msgr2=0x7fec7c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8106c640 1 --2- 172.21.15.3:0/170099975 >> v2:172.21.15.3:3300/0 conn(0x7fec7c06d940 0x7fec7c0cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8106c640 1 -- 172.21.15.3:0/170099975 >> v1:172.21.15.60:6789/0 conn(0x7fec7c0ceac0 legacy=0x7fec7c160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.731+0000 7fec8106c640 1 -- 172.21.15.3:0/170099975 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c071a20 con 0x7fec7c0cee90 2023-05-17T11:45:41.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f97441f3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0d0d50 con 0x7f973c0d08f0 2023-05-17T11:45:41.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f97441f3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0d3250 con 0x7f973c06a9f0 2023-05-17T11:45:41.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f97441f3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0d2920 con 0x7f973c0c5d30 2023-05-17T11:45:41.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eed10b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 0x7f9ee80d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eed10b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9ee80b1680 0x7f9ee80d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eed10b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee80b14d0 con 0x7f9ee815c0d0 2023-05-17T11:45:41.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fec8106c640 1 --2- 172.21.15.3:0/170099975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c06d400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec78009d90 tx=0x7fec7801c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46de3dc9b5dd4809 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eed10b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee80d1090 con 0x7f9ee80b1680 2023-05-17T11:45:41.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eed10b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee80b1040 con 0x7f9ee815c4a0 2023-05-17T11:45:41.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1016ce30 con 0x7fdb10160010 2023-05-17T11:45:41.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb040039a0 con 0x7fdb10160010 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9058760640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90500b04e0 0x7f9050158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9058760640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9050158e60 0x7f905014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9058760640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90501586d0 con 0x7f9050070ed0 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9058760640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905014ce00 con 0x7f9050158e60 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9058760640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905014b820 con 0x7f90500b04e0 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90500b04e0 0x7f9050158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9056cfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9050158e60 0x7f905014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9056cfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9050158e60 0x7f905014c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56480/0 (socket says 172.21.15.3:56480) 2023-05-17T11:45:41.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9056cfd640 1 -- 172.21.15.3:0/3524105404 learned_addr learned my addr 172.21.15.3:0/3524105404 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f14b61cb640 1 -- 172.21.15.3:0/4065415286 shutdown_connections 2023-05-17T11:45:41.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f14b61cb640 1 --2- 172.21.15.3:0/4065415286 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a804bb80 0x7f14a804c000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f14b61cb640 1 --2- 172.21.15.3:0/4065415286 >> v2:172.21.15.60:3300/0 conn(0x7f14a8036530 0x7f14a8036900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f14b61cb640 1 -- 172.21.15.3:0/4065415286 >> 172.21.15.3:0/4065415286 conn(0x7f14a8051530 msgr2=0x7f14a8051930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f14b61cb640 1 -- 172.21.15.3:0/4065415286 shutdown_connections 2023-05-17T11:45:41.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fb7dffff640 1 -- 172.21.15.3:0/202336225 >> v2:172.21.15.3:3300/0 conn(0x7fb7e0160530 msgr2=0x7fb7e0164930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T11:45:41.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fb7dffff640 1 --2- 172.21.15.3:0/202336225 >> v2:172.21.15.3:3300/0 conn(0x7fb7e0160530 0x7fb7e0164930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fb7dffff640 1 -- 172.21.15.3:0/202336225 >> v1:172.21.15.3:6789/0 conn(0x7fb7e00d0380 legacy=0x7fb7e00cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fb7dffff640 1 -- 172.21.15.3:0/202336225 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0164130 con 0x7fb7e00d07c0 2023-05-17T11:45:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9ee77fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 0x7f9ee80d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9ee77fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 0x7f9ee80d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56466/0 (socket says 172.21.15.3:56466) 2023-05-17T11:45:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9ee77fe640 1 -- 172.21.15.3:0/1232044251 learned_addr learned my addr 172.21.15.3:0/1232044251 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eec90a640 1 --2- 172.21.15.3:0/1232044251 >> v2:172.21.15.3:3300/0 conn(0x7f9ee80b1680 0x7f9ee80d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eec90a640 1 -- 172.21.15.3:0/1232044251 >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 msgr2=0x7f9ee80d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eec90a640 1 --2- 172.21.15.3:0/1232044251 >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 0x7f9ee80d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eec90a640 1 -- 172.21.15.3:0/1232044251 >> v1:172.21.15.3:6789/0 conn(0x7f9ee815c0d0 legacy=0x7f9ee80afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9eec90a640 1 -- 172.21.15.3:0/1232044251 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80b0430 con 0x7f9ee80b1680 2023-05-17T11:45:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9ee77fe640 1 --2- 172.21.15.3:0/1232044251 >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 0x7f9ee80d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f973c06a9f0 0x7f973c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f973c06a9f0 0x7f973c0d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56474/0 (socket says 172.21.15.3:56474) 2023-05-17T11:45:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 -- 172.21.15.3:0/4097608778 learned_addr learned my addr 172.21.15.3:0/4097608778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f9742790640 1 --2- 172.21.15.3:0/4097608778 >> v2:172.21.15.3:3300/0 conn(0x7f973c0d08f0 0x7f973c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 -- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c0c5d30 msgr2=0x7f973c06b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T11:45:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 --2- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c0c5d30 0x7f973c06b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 -- 172.21.15.3:0/4097608778 >> v2:172.21.15.3:3300/0 conn(0x7f973c0d08f0 msgr2=0x7f973c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 --2- 172.21.15.3:0/4097608778 >> v2:172.21.15.3:3300/0 conn(0x7f973c0d08f0 0x7f973c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7f974178e640 1 -- 172.21.15.3:0/4097608778 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0d2c00 con 0x7f973c06a9f0 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fec8086b640 1 -- 172.21.15.3:0/170099975 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780a58a0 con 0x7fec7c0cee90 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fec8086b640 1 -- 172.21.15.3:0/170099975 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec780a5a00 con 0x7fec7c0cee90 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fec8086b640 1 -- 172.21.15.3:0/170099975 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780a5d90 con 0x7fec7c0cee90 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fec8286f640 1 -- 172.21.15.3:0/170099975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 msgr2=0x7fec7c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.735+0000 7fec8286f640 1 --2- 172.21.15.3:0/170099975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c06d400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec78009d90 tx=0x7fec7801c910 comp rx=0 tx=0).stop 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 -- 172.21.15.3:0/170099975 shutdown_connections 2023-05-17T11:45:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 --2- 172.21.15.3:0/170099975 >> v2:172.21.15.3:3300/0 conn(0x7fec7c06d940 0x7fec7c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 --2- 172.21.15.3:0/170099975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c06d400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 -- 172.21.15.3:0/170099975 >> 172.21.15.3:0/170099975 conn(0x7fec7c0b0e50 msgr2=0x7fec7c0b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 -- 172.21.15.3:0/170099975 shutdown_connections 2023-05-17T11:45:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 -- 172.21.15.3:0/170099975 wait complete. 2023-05-17T11:45:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 -- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9050158e60 msgr2=0x7f905014c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9050158e60 0x7f905014c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 -- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9050070ed0 msgr2=0x7f905014b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9050070ed0 0x7f905014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 -- 172.21.15.3:0/3524105404 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009420 con 0x7f90500b04e0 2023-05-17T11:45:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f9055cfb640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90500b04e0 0x7f9050158190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f90400ac000 tx=0x7f904001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f14b61cb640 1 -- 172.21.15.3:0/4065415286 wait complete. 2023-05-17T11:45:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f14b61cb640 1 Processor -- start 2023-05-17T11:45:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7f14b61cb640 1 -- start start 2023-05-17T11:45:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fb7dffff640 1 --2- 172.21.15.3:0/202336225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d07c0 0x7fb7e0160900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00b6560 tx=0x7fb7d001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6384a1e3232fa2f1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fb7de7fc640 1 -- 172.21.15.3:0/202336225 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00ab600 con 0x7fb7e00d07c0 2023-05-17T11:45:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fb7de7fc640 1 -- 172.21.15.3:0/202336225 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d00a7050 con 0x7fb7e00d07c0 2023-05-17T11:45:41.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fb7de7fc640 1 -- 172.21.15.3:0/202336225 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00ab980 con 0x7fb7e00d07c0 2023-05-17T11:45:41.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 Processor -- start 2023-05-17T11:45:41.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fec8286f640 1 -- start start 2023-05-17T11:45:41.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fdb0cff9640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdafc0662d0 0x7fdafc068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb04083240 con 0x7fdb10160010 2023-05-17T11:45:41.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fdb0ffff640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdafc0662d0 0x7fdafc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.739+0000 7fdb0ffff640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdafc0662d0 0x7fdafc068780 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb080ae000 tx=0x7fdb080a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 -- 172.21.15.3:0/202336225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d07c0 msgr2=0x7fb7e0160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 --2- 172.21.15.3:0/202336225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d07c0 0x7fb7e0160900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00b6560 tx=0x7fb7d001c4a0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 -- 172.21.15.3:0/202336225 shutdown_connections 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 --2- 172.21.15.3:0/202336225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d07c0 0x7fb7e0160900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 --2- 172.21.15.3:0/202336225 >> v2:172.21.15.3:3300/0 conn(0x7fb7e0160530 0x7fb7e0164930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 -- 172.21.15.3:0/202336225 >> 172.21.15.3:0/202336225 conn(0x7fb7e006de50 msgr2=0x7fb7e006e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 -- 172.21.15.3:0/202336225 shutdown_connections 2023-05-17T11:45:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 -- 172.21.15.3:0/202336225 wait complete. 2023-05-17T11:45:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8286f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 0x7fec7c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8286f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 0x7fec7c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8286f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8286f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c15a2d0 con 0x7fec7c06d940 2023-05-17T11:45:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8286f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0c3100 con 0x7fec7c0ceac0 2023-05-17T11:45:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8286f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c15db70 con 0x7fec7c0cee90 2023-05-17T11:45:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f14b61cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a8036530 0x7f14a8049bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 0x7fec7c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8106c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 0x7fec7c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 0x7fec7c151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51748/0 (socket says 172.21.15.3:51748) 2023-05-17T11:45:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 -- 172.21.15.3:0/545279513 learned_addr learned my addr 172.21.15.3:0/545279513 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8106c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 0x7fec7c15d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56492/0 (socket says 172.21.15.3:56492) 2023-05-17T11:45:41.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8206e640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9eec90a640 1 --2- 172.21.15.3:0/1232044251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee80b1680 0x7f9ee80d0800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ee808bfc0 tx=0x7f9ed801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8561d76f9f88a917 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f14b61cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 0x7f14a804abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f974178e640 1 --2- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c06a9f0 0x7f973c0d03b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f973c0721c0 tx=0x7f972c01c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daba371c840a2fb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9740f8d640 1 -- 172.21.15.3:0/4097608778 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab600 con 0x7f973c06a9f0 2023-05-17T11:45:41.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9740f8d640 1 -- 172.21.15.3:0/4097608778 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0a7050 con 0x7f973c06a9f0 2023-05-17T11:45:41.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9740f8d640 1 -- 172.21.15.3:0/4097608778 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab980 con 0x7f973c06a9f0 2023-05-17T11:45:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 -- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 msgr2=0x7fec7c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c0b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 -- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 msgr2=0x7fec7c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 0x7fec7c15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 -- 172.21.15.3:0/545279513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78009a70 con 0x7fec7c06d940 2023-05-17T11:45:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8186d640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 0x7fec7c151c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec7400c450 tx=0x7fec7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fec8106c640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 0x7fec7c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:41.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f97441f3640 1 -- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c06a9f0 msgr2=0x7f973c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f97441f3640 1 --2- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c06a9f0 0x7f973c0d03b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f973c0721c0 tx=0x7f972c01c230 comp rx=0 tx=0).stop 2023-05-17T11:45:41.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400b5810 con 0x7f90500b04e0 2023-05-17T11:45:41.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400b5990 con 0x7f90500b04e0 2023-05-17T11:45:41.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400b5d40 con 0x7f90500b04e0 2023-05-17T11:45:41.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f14af7fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a8036530 0x7f14a8049bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f14af7fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a8036530 0x7f14a8049bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53902/0 (socket says 172.21.15.3:53902) 2023-05-17T11:45:41.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f14aeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 0x7f14a804abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f14aeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 0x7f14a804abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51758/0 (socket says 172.21.15.3:51758) 2023-05-17T11:45:41.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14b61cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a8054150 0x7f14a8039ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90500ccf50 con 0x7f90500b04e0 2023-05-17T11:45:41.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90500712d0 con 0x7f90500b04e0 2023-05-17T11:45:41.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7f9044ff9640 1 -- 172.21.15.3:0/3524105404 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90500cd0e0 con 0x7f90500b04e0 2023-05-17T11:45:41.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.743+0000 7fb7e4a12640 1 Processor -- start 2023-05-17T11:45:41.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90400059a0 con 0x7f90500b04e0 2023-05-17T11:45:41.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 -- start start 2023-05-17T11:45:41.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14b61cb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80df540 con 0x7f14a804bb80 2023-05-17T11:45:41.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14b61cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8187900 con 0x7f14a8054150 2023-05-17T11:45:41.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14b61cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a804b530 con 0x7f14a8036530 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 -- 172.21.15.3:0/1552597631 learned_addr learned my addr 172.21.15.3:0/1552597631 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14affff640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a8054150 0x7f14a8039ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 -- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a8036530 msgr2=0x7f14a8049bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a8036530 0x7f14a8049bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 -- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a8054150 msgr2=0x7f14a8039ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a8054150 0x7f14a8039ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 -- 172.21.15.3:0/1552597631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0067d90 con 0x7f14a804bb80 2023-05-17T11:45:41.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f14aeffd640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 0x7f14a804abb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f149c00c750 tx=0x7f149c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 -- 172.21.15.3:0/4097608778 shutdown_connections 2023-05-17T11:45:41.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 --2- 172.21.15.3:0/4097608778 >> v2:172.21.15.3:3300/0 conn(0x7f973c0d08f0 0x7f973c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 --2- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c06a9f0 0x7f973c0d03b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 --2- 172.21.15.3:0/4097608778 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c0c5d30 0x7f973c06b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 -- 172.21.15.3:0/4097608778 >> 172.21.15.3:0/4097608778 conn(0x7f973c071b00 msgr2=0x7f973c09bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 -- 172.21.15.3:0/4097608778 shutdown_connections 2023-05-17T11:45:41.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f9046ffd640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9034066380 0x7f9034068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d0380 0x7fb7e00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7e00d07c0 0x7fb7e014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e0160530 0x7fb7e00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f904011eb70 con 0x7f90500b04e0 2023-05-17T11:45:41.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0153d60 con 0x7fb7e0160530 2023-05-17T11:45:41.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00ccd30 con 0x7fb7e00d0380 2023-05-17T11:45:41.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7e4a12640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00ccfd0 con 0x7fb7e00d07c0 2023-05-17T11:45:41.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f97441f3640 1 -- 172.21.15.3:0/4097608778 wait complete. 2023-05-17T11:45:41.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f56735f0640 1 Processor -- start 2023-05-17T11:45:41.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d0380 0x7fb7e00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7e00d07c0 0x7fb7e014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d0380 0x7fb7e00c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56500/0 (socket says 172.21.15.3:56500) 2023-05-17T11:45:41.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7df7fe640 1 -- 172.21.15.3:0/2563267591 learned_addr learned my addr 172.21.15.3:0/2563267591 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f56735f0640 1 -- start start 2023-05-17T11:45:41.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f90564fc640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9034066380 0x7f9034068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7f90564fc640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9034066380 0x7f9034068830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f90501fb620 tx=0x7f904c007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 -- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d0380 msgr2=0x7fb7e00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d0380 0x7fb7e00c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 -- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e0160530 msgr2=0x7fb7e00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e0160530 0x7fb7e00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 -- 172.21.15.3:0/2563267591 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d0009420 con 0x7fb7e00d07c0 2023-05-17T11:45:41.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.747+0000 7fb7deffd640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7e00d07c0 0x7fb7e014b570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800ca50 tx=0x7fb7d800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74012830 con 0x7fec7c06d940 2023-05-17T11:45:41.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdb040507e0 con 0x7fdb10160010 2023-05-17T11:45:41.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800abb0 con 0x7fb7e00d07c0 2023-05-17T11:45:41.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c168dc0 con 0x7fec7c06d940 2023-05-17T11:45:41.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c0713f0 con 0x7fec7c06d940 2023-05-17T11:45:41.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800ad10 con 0x7fb7e00d07c0 2023-05-17T11:45:41.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8012620 con 0x7fb7e00d07c0 2023-05-17T11:45:41.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fb7e4a12640 1 -- 172.21.15.3:0/2563267591 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e016b470 con 0x7fb7e00d07c0 2023-05-17T11:45:41.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9ee6ffd640 1 -- 172.21.15.3:0/1232044251 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80ad660 con 0x7f9ee80b1680 2023-05-17T11:45:41.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9ee6ffd640 1 -- 172.21.15.3:0/1232044251 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed80ad7c0 con 0x7f9ee80b1680 2023-05-17T11:45:41.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9ee6ffd640 1 -- 172.21.15.3:0/1232044251 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80adb50 con 0x7f9ee80b1680 2023-05-17T11:45:41.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74012990 con 0x7fec7c06d940 2023-05-17T11:45:41.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74012d00 con 0x7fec7c06d940 2023-05-17T11:45:41.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64005260 con 0x7fec7c06d940 2023-05-17T11:45:41.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9eed10b640 1 -- 172.21.15.3:0/1232044251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee80b1680 msgr2=0x7f9ee80d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9eed10b640 1 --2- 172.21.15.3:0/1232044251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee80b1680 0x7f9ee80d0800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ee808bfc0 tx=0x7f9ed801c360 comp rx=0 tx=0).stop 2023-05-17T11:45:41.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fb7e4a12640 1 -- 172.21.15.3:0/2563267591 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e016b2e0 con 0x7fb7e00d07c0 2023-05-17T11:45:41.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c005ae0 con 0x7f14a804bb80 2023-05-17T11:45:41.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c005c60 con 0x7f14a804bb80 2023-05-17T11:45:41.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c007070 con 0x7f14a804bb80 2023-05-17T11:45:41.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f14b61cb640 1 -- 172.21.15.3:0/1552597631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a804c950 con 0x7f14a804bb80 2023-05-17T11:45:41.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9eed10b640 1 -- 172.21.15.3:0/1232044251 shutdown_connections 2023-05-17T11:45:41.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9eed10b640 1 --2- 172.21.15.3:0/1232044251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee80b1680 0x7f9ee80d0800 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9eed10b640 1 --2- 172.21.15.3:0/1232044251 >> v2:172.21.15.60:3300/0 conn(0x7f9ee815c4a0 0x7f9ee80d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9eed10b640 1 -- 172.21.15.3:0/1232044251 >> 172.21.15.3:0/1232044251 conn(0x7f9ee809b950 msgr2=0x7f9ee80d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f90400ec080 con 0x7f90500b04e0 2023-05-17T11:45:41.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f14b61cb640 1 -- 172.21.15.3:0/1552597631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a8036e40 con 0x7f14a804bb80 2023-05-17T11:45:41.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f97441f3640 1 Processor -- start 2023-05-17T11:45:41.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e016b600 con 0x7fb7e00d07c0 2023-05-17T11:45:41.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec7401c460 con 0x7fec7c06d940 2023-05-17T11:45:41.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f9eed10b640 1 -- 172.21.15.3:0/1232044251 shutdown_connections 2023-05-17T11:45:41.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.751+0000 7f97441f3640 1 -- start start 2023-05-17T11:45:41.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f97441f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c06a9f0 0x7f973c0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f97441f3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 0x7f973c1fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f56735f0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f566c0b1e00 0x7f566c0d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f56735f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f56735f0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0d0d60 con 0x7f566c0b2710 2023-05-17T11:45:41.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f56735f0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c0b3440 con 0x7f566c0b1e00 2023-05-17T11:45:41.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f56735f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0d27f0 con 0x7f566c0d03d0 2023-05-17T11:45:41.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f567138c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f566c0b1e00 0x7f566c0d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f5671b8d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f566c0b2710 0x7f566c0b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:32818/0 (socket says 172.21.15.3:32818) 2023-05-17T11:45:41.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f5671b8d640 1 -- 172.21.15.3:0/4074544103 learned_addr learned my addr 172.21.15.3:0/4074544103 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:41.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f14b61cb640 1 -- 172.21.15.3:0/1552597631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1490005260 con 0x7f14a804bb80 2023-05-17T11:45:41.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 0x7f973c1fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 0x7f973c1fcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51770/0 (socket says 172.21.15.3:51770) 2023-05-17T11:45:41.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 -- 172.21.15.3:0/2700906836 learned_addr learned my addr 172.21.15.3:0/2700906836 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c0d08f0 0x7f973c1fd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f567138c640 1 -- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 msgr2=0x7f566c0d0820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T11:45:41.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f567138c640 1 --2- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c0d0820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f567138c640 1 -- 172.21.15.3:0/4074544103 >> v1:172.21.15.60:6789/0 conn(0x7f566c0b2710 legacy=0x7f566c0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f567138c640 1 -- 172.21.15.3:0/4074544103 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0d2ad0 con 0x7f566c0b1e00 2023-05-17T11:45:41.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c16a220 con 0x7f973c0c5d30 2023-05-17T11:45:41.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c16a500 con 0x7f973c0d08f0 2023-05-17T11:45:41.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c16a7e0 con 0x7f973c06a9f0 2023-05-17T11:45:41.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f9742790640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c0d08f0 0x7f973c1fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7fec6e7fc640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec600662b0 0x7fec60068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7fec8106c640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec600662b0 0x7fec60068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f9eed10b640 1 -- 172.21.15.3:0/1232044251 wait complete. 2023-05-17T11:45:41.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f9eed10b640 1 Processor -- start 2023-05-17T11:45:41.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fec8106c640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec600662b0 0x7fec60068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec780af000 tx=0x7fec780a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 -- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c06a9f0 msgr2=0x7f973c0afbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T11:45:41.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c06a9f0 0x7f973c0afbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 -- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c0d08f0 msgr2=0x7f973c1fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c0d08f0 0x7f973c1fd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7f974178e640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0094d0 con 0x7f973c0c5d30 2023-05-17T11:45:41.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f974178e640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 0x7f973c1fcf50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f972c019e60 tx=0x7f972c018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 -- start start 2023-05-17T11:45:41.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f567138c640 1 --2- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b1e00 0x7f566c0d32d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56680097a0 tx=0x7f566801bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c059674359b27828 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.755+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7d8012780 con 0x7fb7e00d07c0 2023-05-17T11:45:41.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fb7c7fff640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7cc066280 0x7fb7cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec74059730 con 0x7fec7c06d940 2023-05-17T11:45:41.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7d8083b70 con 0x7fb7e00d07c0 2023-05-17T11:45:41.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f5663fff640 1 -- 172.21.15.3:0/4074544103 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680a7640 con 0x7f566c0b1e00 2023-05-17T11:45:41.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fb7df7fe640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7cc066280 0x7fb7cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f5663fff640 1 -- 172.21.15.3:0/4074544103 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56680a77a0 con 0x7f566c0b1e00 2023-05-17T11:45:41.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f5663fff640 1 -- 172.21.15.3:0/4074544103 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680a7b30 con 0x7f566c0b1e00 2023-05-17T11:45:41.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 0x7f9ee80cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fb7df7fe640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7cc066280 0x7fb7cc068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009a00 tx=0x7fb7d4009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9ee815c0d0 0x7f9ee815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 0x7f9ee80cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 0x7f9ee80cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56518/0 (socket says 172.21.15.3:56518) 2023-05-17T11:45:41.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9ee7fff640 1 -- 172.21.15.3:0/3177820679 learned_addr learned my addr 172.21.15.3:0/3177820679 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9ee77fe640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9ee815c0d0 0x7f9ee815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee815c4a0 0x7f9ee815f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb7d8051210 con 0x7fb7e00d07c0 2023-05-17T11:45:41.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee82018b0 con 0x7f9ee815c4a0 2023-05-17T11:45:41.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee80cad50 con 0x7f9ee80b1680 2023-05-17T11:45:41.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f56735f0640 1 -- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b1e00 msgr2=0x7f566c0d32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f56735f0640 1 --2- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b1e00 0x7f566c0d32d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56680097a0 tx=0x7f566801bf60 comp rx=0 tx=0).stop 2023-05-17T11:45:41.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee80ca180 con 0x7f9ee815c0d0 2023-05-17T11:45:41.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f56735f0640 1 -- 172.21.15.3:0/4074544103 shutdown_connections 2023-05-17T11:45:41.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.759+0000 7f56735f0640 1 --2- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f56735f0640 1 --2- 172.21.15.3:0/4074544103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b1e00 0x7f566c0d32d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f149c0071d0 con 0x7f14a804bb80 2023-05-17T11:45:41.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f56735f0640 1 -- 172.21.15.3:0/4074544103 >> 172.21.15.3:0/4074544103 conn(0x7f566c071b00 msgr2=0x7f566c09bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:41.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9eec90a640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee815c4a0 0x7f9ee815f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee7fff640 1 -- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9ee815c0d0 msgr2=0x7f9ee815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee7fff640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9ee815c0d0 0x7f9ee815ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee7fff640 1 -- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee815c4a0 msgr2=0x7f9ee815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee7fff640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee815c4a0 0x7f9ee815f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee7fff640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009420 con 0x7f9ee80b1680 2023-05-17T11:45:41.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9eec90a640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee815c4a0 0x7f9ee815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:41.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f56735f0640 1 -- 172.21.15.3:0/4074544103 shutdown_connections 2023-05-17T11:45:41.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee7fff640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 0x7f9ee80cb1e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c4b0 tx=0x7f9edc00c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f56735f0640 1 -- 172.21.15.3:0/4074544103 wait complete. 2023-05-17T11:45:41.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc012830 con 0x7f9ee80b1680 2023-05-17T11:45:41.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc0129b0 con 0x7f9ee80b1680 2023-05-17T11:45:41.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc012d60 con 0x7f9ee80b1680 2023-05-17T11:45:41.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f149bfff640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f14940662b0 0x7f1494068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f14af7fe640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f14940662b0 0x7f1494068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee80cd550 con 0x7f9ee80b1680 2023-05-17T11:45:41.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee80b0cd0 con 0x7f9ee80b1680 2023-05-17T11:45:41.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f14af7fe640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f14940662b0 0x7f1494068760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ba70 tx=0x7f14a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.763+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee80cd6e0 con 0x7f9ee80b1680 2023-05-17T11:45:41.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f56735f0640 1 Processor -- start 2023-05-17T11:45:41.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f56735f0640 1 -- start start 2023-05-17T11:45:41.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f56735f0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566c0b1e00 0x7f566c0c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9edc01c460 con 0x7f9ee80b1680 2023-05-17T11:45:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f56735f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b2710 0x7f566c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f567138c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566c0b1e00 0x7f566c0c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f567138c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566c0b1e00 0x7f566c0c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51778/0 (socket says 172.21.15.3:51778) 2023-05-17T11:45:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f567138c640 1 -- 172.21.15.3:0/3126629675 learned_addr learned my addr 172.21.15.3:0/3126629675 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.767+0000 7f5670b8b640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b2710 0x7f566c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c06b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f9ee4ff9640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9ed4066280 0x7f9ed4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9edc084620 con 0x7f9ee80b1680 2023-05-17T11:45:41.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c153e20 con 0x7f566c0b1e00 2023-05-17T11:45:41.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0b74b0 con 0x7f566c0b2710 2023-05-17T11:45:41.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c15a3a0 con 0x7f566c0d03d0 2023-05-17T11:45:41.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f149c0588f0 con 0x7f14a804bb80 2023-05-17T11:45:41.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f9ee77fe640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9ed4066280 0x7f9ed4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0b5400 con 0x7f973c0c5d30 2023-05-17T11:45:41.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fec74051ab0 con 0x7fec7c06d940 2023-05-17T11:45:41.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f9ee77fe640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9ed4066280 0x7f9ed4068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80b5370 tx=0x7f9ee00091b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c0d26f0 con 0x7f973c0c5d30 2023-05-17T11:45:41.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c0d2560 con 0x7f973c0c5d30 2023-05-17T11:45:41.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c0ccfc0 con 0x7f973c0c5d30 2023-05-17T11:45:41.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5671b8d640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5670b8b640 1 -- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 msgr2=0x7f566c06b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5670b8b640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c06b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5670b8b640 1 -- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566c0b1e00 msgr2=0x7f566c0c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:41.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5670b8b640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566c0b1e00 0x7f566c0c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:41.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5670b8b640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680093b0 con 0x7f566c0b2710 2023-05-17T11:45:41.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9edc051a80 con 0x7f9ee80b1680 2023-05-17T11:45:41.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5670b8b640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b2710 0x7f566c1532c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b410 tx=0x7f565c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.771+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c011830 con 0x7f566c0b2710 2023-05-17T11:45:41.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.775+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c011990 con 0x7f566c0b2710 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.775+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c011d40 con 0x7f566c0b2710 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.775+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c169b20 con 0x7f566c0b2710 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.775+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c169990 con 0x7f566c0b2710 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.775+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c169cb0 con 0x7f566c0b2710 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f565c01a400 con 0x7f566c0b2710 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f5661ffb640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5650066350 0x7f5650068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f565c0842c0 con 0x7f566c0b2710 2023-05-17T11:45:41.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f567138c640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5650066350 0x7f5650068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f565c051720 con 0x7f566c0b2710 2023-05-17T11:45:41.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f149c050d20 con 0x7f14a804bb80 2023-05-17T11:45:41.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0b5560 con 0x7f973c0c5d30 2023-05-17T11:45:41.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.779+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0b58f0 con 0x7f973c0c5d30 2023-05-17T11:45:41.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.783+0000 7f567138c640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5650066350 0x7f5650068800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f566801bfa0 tx=0x7f56680a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.783+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f972c0b5a50 con 0x7f973c0c5d30 2023-05-17T11:45:41.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.787+0000 7f97327fc640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9720066280 0x7f9720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:41.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.787+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f972c11d9d0 con 0x7f973c0c5d30 2023-05-17T11:45:41.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.787+0000 7f9741f8f640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9720066280 0x7f9720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:41.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.787+0000 7f9741f8f640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9720066280 0x7f9720068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9738009670 tx=0x7f9738006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:41.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:41.791+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f972c0eae70 con 0x7f973c0c5d30 2023-05-17T11:45:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.079+0000 7f9044ff9640 1 -- 172.21.15.3:0/3524105404 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9050067130 con 0x7f90500b04e0 2023-05-17T11:45:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.079+0000 7f9046ffd640 1 -- 172.21.15.3:0/3524105404 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90400ab640 con 0x7f90500b04e0 2023-05-17T11:45:42.092 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9034066380 msgr2=0x7f9034068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9034066380 0x7f9034068830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f90501fb620 tx=0x7f904c007970 comp rx=0 tx=0).stop 2023-05-17T11:45:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90500b04e0 msgr2=0x7f9050158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90500b04e0 0x7f9050158190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f90400ac000 tx=0x7f904001acc0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 shutdown_connections 2023-05-17T11:45:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9034066380 0x7f9034068830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9050158e60 0x7f905014c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90500b04e0 0x7f9050158190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 --2- 172.21.15.3:0/3524105404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9050070ed0 0x7f905014b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.083+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 >> 172.21.15.3:0/3524105404 conn(0x7f9050069ab0 msgr2=0x7f90500afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.087+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 shutdown_connections 2023-05-17T11:45:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.087+0000 7f9058760640 1 -- 172.21.15.3:0/3524105404 wait complete. 2023-05-17T11:45:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.087+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7e0067130 con 0x7fb7e00d07c0 2023-05-17T11:45:42.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.087+0000 7fb7c7fff640 1 -- 172.21.15.3:0/2563267591 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7d8017090 con 0x7fb7e00d07c0 2023-05-17T11:45:42.097 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:42.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.087+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb1016d150 con 0x7fdb10160010 2023-05-17T11:45:42.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.087+0000 7fdb0cff9640 1 -- 172.21.15.3:0/2184570159 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb04053e00 con 0x7fdb10160010 2023-05-17T11:45:42.099 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-05-17T11:45:42.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7cc066280 msgr2=0x7fb7cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7cc066280 0x7fb7cc068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009a00 tx=0x7fb7d4009110 comp rx=0 tx=0).stop 2023-05-17T11:45:42.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7e00d07c0 msgr2=0x7fb7e014b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7e00d07c0 0x7fb7e014b570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800ca50 tx=0x7fb7d800cf10 comp rx=0 tx=0).stop 2023-05-17T11:45:42.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdafc0662d0 msgr2=0x7fdafc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdafc0662d0 0x7fdafc068780 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb080ae000 tx=0x7fdb080a7070 comp rx=0 tx=0).stop 2023-05-17T11:45:42.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 msgr2=0x7fdb10162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb10162b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c390 tx=0x7fdb0400c850 comp rx=0 tx=0).stop 2023-05-17T11:45:42.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 shutdown_connections 2023-05-17T11:45:42.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7cc066280 0x7fb7cc068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e0160530 0x7fb7e00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7e00d07c0 0x7fb7e014b570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 --2- 172.21.15.3:0/2563267591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00d0380 0x7fb7e00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 >> 172.21.15.3:0/2563267591 conn(0x7fb7e006de50 msgr2=0x7fb7e006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 shutdown_connections 2023-05-17T11:45:42.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fb7bdffb640 1 -- 172.21.15.3:0/2563267591 wait complete. 2023-05-17T11:45:42.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 shutdown_connections 2023-05-17T11:45:42.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdafc0662d0 0x7fdafc068780 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb10160010 0x7fdb10162b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdb100b2820 0x7fdb10162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 --2- 172.21.15.3:0/2184570159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb1006a600 0x7fdb10143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.091+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 >> 172.21.15.3:0/2184570159 conn(0x7fdb10069ab0 msgr2=0x7fdb101614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.095+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 shutdown_connections 2023-05-17T11:45:42.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.095+0000 7fdb168fc640 1 -- 172.21.15.3:0/2184570159 wait complete. 2023-05-17T11:45:42.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.103+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fec640057e0 con 0x7fec7c06d940 2023-05-17T11:45:42.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.103+0000 7fec6e7fc640 1 -- 172.21.15.3:0/545279513 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec740550d0 con 0x7fec7c06d940 2023-05-17T11:45:42.115 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:42.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec600662b0 msgr2=0x7fec60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec600662b0 0x7fec60068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec780af000 tx=0x7fec780a7070 comp rx=0 tx=0).stop 2023-05-17T11:45:42.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 msgr2=0x7fec7c151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 0x7fec7c151c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec7400c450 tx=0x7fec7400c910 comp rx=0 tx=0).stop 2023-05-17T11:45:42.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 shutdown_connections 2023-05-17T11:45:42.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec600662b0 0x7fec60068760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec7c0cee90 0x7fec7c0b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c0ceac0 0x7fec7c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 --2- 172.21.15.3:0/545279513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec7c06d940 0x7fec7c151c10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 >> 172.21.15.3:0/545279513 conn(0x7fec7c0b0e50 msgr2=0x7fec7c0b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 shutdown_connections 2023-05-17T11:45:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.107+0000 7fec8286f640 1 -- 172.21.15.3:0/545279513 wait complete. 2023-05-17T11:45:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.111+0000 7f14b61cb640 1 -- 172.21.15.3:0/1552597631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14900057e0 con 0x7f14a804bb80 2023-05-17T11:45:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.111+0000 7f149bfff640 1 -- 172.21.15.3:0/1552597631 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f149c017070 con 0x7f14a804bb80 2023-05-17T11:45:42.120 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-05-17T11:45:42.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.111+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9ee8067130 con 0x7f9ee80b1680 2023-05-17T11:45:42.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 -- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f14940662b0 msgr2=0x7f1494068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f14940662b0 0x7f1494068760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ba70 tx=0x7f14a4008040 comp rx=0 tx=0).stop 2023-05-17T11:45:42.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 -- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 msgr2=0x7f14a804abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 0x7f14a804abb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f149c00c750 tx=0x7f149c00cc10 comp rx=0 tx=0).stop 2023-05-17T11:45:42.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f9ee4ff9640 1 -- 172.21.15.3:0/3177820679 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9edc0550a0 con 0x7f9ee80b1680 2023-05-17T11:45:42.124 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:42.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 -- 172.21.15.3:0/1552597631 shutdown_connections 2023-05-17T11:45:42.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f14940662b0 0x7f1494068760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a8054150 0x7f14a8039ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14a804bb80 0x7f14a804abb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 --2- 172.21.15.3:0/1552597631 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14a8036530 0x7f14a8049bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 -- 172.21.15.3:0/1552597631 >> 172.21.15.3:0/1552597631 conn(0x7f14a8051530 msgr2=0x7f14a80064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 -- 172.21.15.3:0/1552597631 shutdown_connections 2023-05-17T11:45:42.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.115+0000 7f1499ffb640 1 -- 172.21.15.3:0/1552597631 wait complete. 2023-05-17T11:45:42.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9ed4066280 msgr2=0x7f9ed4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9ed4066280 0x7f9ed4068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80b5370 tx=0x7f9ee00091b0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 msgr2=0x7f9ee80cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 0x7f9ee80cb1e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c4b0 tx=0x7f9edc00c970 comp rx=0 tx=0).stop 2023-05-17T11:45:42.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f566c04de80 con 0x7f566c0b2710 2023-05-17T11:45:42.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 shutdown_connections 2023-05-17T11:45:42.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9ed4066280 0x7f9ed4068730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ee815c4a0 0x7f9ee815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9ee815c0d0 0x7f9ee815ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 --2- 172.21.15.3:0/3177820679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b1680 0x7f9ee80cb1e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 >> 172.21.15.3:0/3177820679 conn(0x7f9ee809b950 msgr2=0x7f9ee8160560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f5661ffb640 1 -- 172.21.15.3:0/3126629675 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f565c054d40 con 0x7f566c0b2710 2023-05-17T11:45:42.129 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-05-17T11:45:42.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 shutdown_connections 2023-05-17T11:45:42.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f9eed10b640 1 -- 172.21.15.3:0/3177820679 wait complete. 2023-05-17T11:45:42.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f973c06c770 con 0x7f973c0c5d30 2023-05-17T11:45:42.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.119+0000 7f97327fc640 1 -- 172.21.15.3:0/2700906836 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f972c0ee490 con 0x7f973c0c5d30 2023-05-17T11:45:42.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-05-17T11:45:42.131 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-05-17T11:45:42.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5650066350 msgr2=0x7f5650068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5650066350 0x7f5650068800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f566801bfa0 tx=0x7f56680a6000 comp rx=0 tx=0).stop 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b2710 msgr2=0x7f566c1532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b2710 0x7f566c1532c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b410 tx=0x7f565c00b8d0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 shutdown_connections 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5650066350 0x7f5650068800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f566c0d03d0 0x7f566c06b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f566c0b2710 0x7f566c1532c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 --2- 172.21.15.3:0/3126629675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566c0b1e00 0x7f566c0c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 >> 172.21.15.3:0/3126629675 conn(0x7f566c071b00 msgr2=0x7f566c0b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9720066280 msgr2=0x7f9720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9720066280 0x7f9720068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9738009670 tx=0x7f9738006bd0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 shutdown_connections 2023-05-17T11:45:42.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f56735f0640 1 -- 172.21.15.3:0/3126629675 wait complete. 2023-05-17T11:45:42.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 msgr2=0x7f973c1fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:42.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 0x7f973c1fcf50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f972c019e60 tx=0x7f972c018fd0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 shutdown_connections 2023-05-17T11:45:42.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9720066280 0x7f9720068730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f973c0d08f0 0x7f973c1fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f973c0c5d30 0x7f973c1fcf50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 --2- 172.21.15.3:0/2700906836 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f973c06a9f0 0x7f973c0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:42.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 >> 172.21.15.3:0/2700906836 conn(0x7f973c071b00 msgr2=0x7f973c164bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:42.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 shutdown_connections 2023-05-17T11:45:42.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:42.123+0000 7f97441f3640 1 -- 172.21.15.3:0/2700906836 wait complete. 2023-05-17T11:45:42.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-05-17T11:45:42.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-05-17T11:45:42.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-05-17T11:45:42.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-05-17T11:45:42.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-05-17T11:45:42.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-05-17T11:45:42.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-05-17T11:45:43.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-17T11:45:43.143 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-17T11:45:43.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-17T11:45:43.157 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-17T11:45:43.160 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-17T11:45:43.165 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-17T11:45:43.172 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-17T11:45:43.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-17T11:45:43.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.339+0000 7fb80bf6d640 1 Processor -- start 2023-05-17T11:45:43.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.339+0000 7fb80bf6d640 1 -- start start 2023-05-17T11:45:43.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb80bf6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb804159020 0x7fb80406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb80bf6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb80406d4b0 0x7fb8040b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb80bf6d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80406d950 con 0x7fb8040b24f0 2023-05-17T11:45:43.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb80bf6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80406dc30 con 0x7fb80406d4b0 2023-05-17T11:45:43.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb80bf6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80406df10 con 0x7fb804159020 2023-05-17T11:45:43.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb80406d4b0 0x7fb8040b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb80406d4b0 0x7fb8040b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56534/0 (socket says 172.21.15.3:56534) 2023-05-17T11:45:43.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 -- 172.21.15.3:0/385769691 learned_addr learned my addr 172.21.15.3:0/385769691 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809d09640 1 --2- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb804159020 0x7fb80406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 -- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb804159020 msgr2=0x7fb80406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 --2- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb804159020 0x7fb80406cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 -- 172.21.15.3:0/385769691 >> v1:172.21.15.3:6789/0 conn(0x7fb8040b24f0 legacy=0x7fb80406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.343+0000 7fb809508640 1 -- 172.21.15.3:0/385769691 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040b17b0 con 0x7fb80406d4b0 2023-05-17T11:45:43.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb809508640 1 --2- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80406d4b0 0x7fb8040b1fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00d370 tx=0x7fb7fc01ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b71a816581daf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb808d07640 1 -- 172.21.15.3:0/385769691 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0a7c80 con 0x7fb80406d4b0 2023-05-17T11:45:43.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb808d07640 1 -- 172.21.15.3:0/385769691 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc0ab070 con 0x7fb80406d4b0 2023-05-17T11:45:43.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb808d07640 1 -- 172.21.15.3:0/385769691 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0b1400 con 0x7fb80406d4b0 2023-05-17T11:45:43.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 -- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80406d4b0 msgr2=0x7fb8040b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80406d4b0 0x7fb8040b1fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00d370 tx=0x7fb7fc01ece0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 -- 172.21.15.3:0/385769691 shutdown_connections 2023-05-17T11:45:43.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80406d4b0 0x7fb8040b1fb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/385769691 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb804159020 0x7fb80406cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 -- 172.21.15.3:0/385769691 >> 172.21.15.3:0/385769691 conn(0x7fb80406bb60 msgr2=0x7fb80406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 -- 172.21.15.3:0/385769691 shutdown_connections 2023-05-17T11:45:43.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.351+0000 7fb80bf6d640 1 -- 172.21.15.3:0/385769691 wait complete. 2023-05-17T11:45:43.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.355+0000 7fb80bf6d640 1 Processor -- start 2023-05-17T11:45:43.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.355+0000 7fb80bf6d640 1 -- start start 2023-05-17T11:45:43.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 0x7fb804201790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb8040b24f0 0x7fb80414c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb804159020 0x7fb8041fddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb809d09640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 0x7fb804201790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb809d09640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 0x7fb804201790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51786/0 (socket says 172.21.15.3:51786) 2023-05-17T11:45:43.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804201cd0 con 0x7fb80406d4b0 2023-05-17T11:45:43.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804201ed0 con 0x7fb804159020 2023-05-17T11:45:43.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb804202170 con 0x7fb8040b24f0 2023-05-17T11:45:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb809d09640 1 -- 172.21.15.3:0/3947642362 learned_addr learned my addr 172.21.15.3:0/3947642362 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb809508640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb8040b24f0 0x7fb80414c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb804159020 0x7fb8041fddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 -- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb8040b24f0 msgr2=0x7fb80414c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb8040b24f0 0x7fb80414c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 -- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 msgr2=0x7fb804201790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 0x7fb804201790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 -- 172.21.15.3:0/3947642362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc00d050 con 0x7fb804159020 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb809508640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb8040b24f0 0x7fb80414c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb809d09640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 0x7fb804201790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80a50a640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb804159020 0x7fb8041fddd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400c410 tx=0x7fb7f400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4005230 con 0x7fb804159020 2023-05-17T11:45:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb804159d90 con 0x7fb804159020 2023-05-17T11:45:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb804159c00 con 0x7fb804159020 2023-05-17T11:45:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4005390 con 0x7fb804159020 2023-05-17T11:45:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.359+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011890 con 0x7fb804159020 2023-05-17T11:45:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.363+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7f40119f0 con 0x7fb804159020 2023-05-17T11:45:43.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.367+0000 7fb7fa7fc640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7e8066350 0x7fb7e8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.367+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7f40831f0 con 0x7fb804159020 2023-05-17T11:45:43.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.367+0000 7fb809d09640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7e8066350 0x7fb7e8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.367+0000 7fb809d09640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7e8066350 0x7fb7e8068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb800011310 tx=0x7fb800009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.367+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec005260 con 0x7fb804159020 2023-05-17T11:45:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.375+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb7f4050700 con 0x7fb804159020 2023-05-17T11:45:43.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.411+0000 7f680b88c640 1 Processor -- start 2023-05-17T11:45:43.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.411+0000 7f680b88c640 1 -- start start 2023-05-17T11:45:43.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f680b88c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 0x7f680406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f680b88c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f680406d680 0x7f68040cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f680b88c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6804070100 con 0x7f68040b2ac0 2023-05-17T11:45:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f680b88c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040cf150 con 0x7f68041586e0 2023-05-17T11:45:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f680b88c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040705d0 con 0x7f680406d680 2023-05-17T11:45:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f6809628640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 0x7f680406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f6809628640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 0x7f680406fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51792/0 (socket says 172.21.15.3:51792) 2023-05-17T11:45:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f6809628640 1 -- 172.21.15.3:0/1801749356 learned_addr learned my addr 172.21.15.3:0/1801749356 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.415+0000 7f6809e29640 1 --2- 172.21.15.3:0/1801749356 >> v2:172.21.15.60:3300/0 conn(0x7f680406d680 0x7f68040cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f6809e29640 1 -- 172.21.15.3:0/1801749356 >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 msgr2=0x7f680406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f6809e29640 1 --2- 172.21.15.3:0/1801749356 >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 0x7f680406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f6809e29640 1 -- 172.21.15.3:0/1801749356 >> v1:172.21.15.60:6789/0 conn(0x7f68040b2ac0 legacy=0x7f680406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f67fbfff640 1 -- 172.21.15.3:0/1801749356 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464348971 0 0) 0x7f6804070100 con 0x7f68040b2ac0 2023-05-17T11:45:43.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f6809e29640 1 -- 172.21.15.3:0/1801749356 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040708b0 con 0x7f680406d680 2023-05-17T11:45:43.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f6809628640 1 --2- 172.21.15.3:0/1801749356 >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 0x7f680406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 Processor -- start 2023-05-17T11:45:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 -- start start 2023-05-17T11:45:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a141603c0 0x7f4a140b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4a140cabe0 0x7f4a1406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a14071a70 0x7f4a1406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140b2590 con 0x7f4a140cabe0 2023-05-17T11:45:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1406d110 con 0x7f4a141603c0 2023-05-17T11:45:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a198f9640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14160790 con 0x7f4a14071a70 2023-05-17T11:45:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a137fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a14071a70 0x7f4a1406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a137fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a14071a70 0x7f4a1406ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53954/0 (socket says 172.21.15.3:53954) 2023-05-17T11:45:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a137fe640 1 -- 172.21.15.3:0/2746504373 learned_addr learned my addr 172.21.15.3:0/2746504373 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.419+0000 7f4a127fc640 1 --2- 172.21.15.3:0/2746504373 >> v2:172.21.15.3:3300/0 conn(0x7f4a140cabe0 0x7f4a1406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f4a12ffd640 1 --2- 172.21.15.3:0/2746504373 >> v2:172.21.15.60:3300/0 conn(0x7f4a141603c0 0x7f4a140b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f6809e29640 1 --2- 172.21.15.3:0/1801749356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680406d680 0x7f68040cb900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6804072290 tx=0x7f67fc01ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d203235c532b7e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f67fbfff640 1 -- 172.21.15.3:0/1801749356 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc0a7900 con 0x7f680406d680 2023-05-17T11:45:43.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f67fbfff640 1 -- 172.21.15.3:0/1801749356 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc0a7a60 con 0x7f680406d680 2023-05-17T11:45:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 -- 172.21.15.3:0/1801749356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680406d680 msgr2=0x7f68040cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f67fbfff640 1 -- 172.21.15.3:0/1801749356 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc0a7900 con 0x7f680406d680 2023-05-17T11:45:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 --2- 172.21.15.3:0/1801749356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680406d680 0x7f68040cb900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6804072290 tx=0x7f67fc01ea20 comp rx=0 tx=0).stop 2023-05-17T11:45:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 -- 172.21.15.3:0/1801749356 shutdown_connections 2023-05-17T11:45:43.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 --2- 172.21.15.3:0/1801749356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680406d680 0x7f68040cb900 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 --2- 172.21.15.3:0/1801749356 >> v2:172.21.15.3:3300/0 conn(0x7f68041586e0 0x7f680406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 -- 172.21.15.3:0/1801749356 >> 172.21.15.3:0/1801749356 conn(0x7f680406bb60 msgr2=0x7f680406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 -- 172.21.15.3:0/1801749356 shutdown_connections 2023-05-17T11:45:43.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f680b88c640 1 -- 172.21.15.3:0/1801749356 wait complete. 2023-05-17T11:45:43.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f4a127fc640 1 -- 172.21.15.3:0/2746504373 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a14071a70 msgr2=0x7f4a1406ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f4a127fc640 1 --2- 172.21.15.3:0/2746504373 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a14071a70 0x7f4a1406ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f4a127fc640 1 -- 172.21.15.3:0/2746504373 >> v2:172.21.15.60:3300/0 conn(0x7f4a141603c0 msgr2=0x7f4a140b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f4a127fc640 1 --2- 172.21.15.3:0/2746504373 >> v2:172.21.15.60:3300/0 conn(0x7f4a141603c0 0x7f4a140b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.423+0000 7f4a127fc640 1 -- 172.21.15.3:0/2746504373 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140b1a20 con 0x7f4a140cabe0 2023-05-17T11:45:43.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f4a127fc640 1 --2- 172.21.15.3:0/2746504373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a1406fa90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406ec00 tx=0x7f49fc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fee43ea87f71e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f4a11ffb640 1 -- 172.21.15.3:0/2746504373 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0ab5f0 con 0x7f4a140cabe0 2023-05-17T11:45:43.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f4a11ffb640 1 -- 172.21.15.3:0/2746504373 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0ab750 con 0x7f4a140cabe0 2023-05-17T11:45:43.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f4a11ffb640 1 -- 172.21.15.3:0/2746504373 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0ab5f0 con 0x7f4a140cabe0 2023-05-17T11:45:43.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f54418c3640 1 Processor -- start 2023-05-17T11:45:43.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f4a198f9640 1 -- 172.21.15.3:0/2746504373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 msgr2=0x7f4a1406fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2746504373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a1406fa90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406ec00 tx=0x7f49fc01c450 comp rx=0 tx=0).stop 2023-05-17T11:45:43.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f54418c3640 1 -- start start 2023-05-17T11:45:43.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 -- 172.21.15.3:0/2746504373 shutdown_connections 2023-05-17T11:45:43.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2746504373 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a14071a70 0x7f4a1406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2746504373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a1406fa90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2746504373 >> v2:172.21.15.60:3300/0 conn(0x7f4a141603c0 0x7f4a140b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 -- 172.21.15.3:0/2746504373 >> 172.21.15.3:0/2746504373 conn(0x7f4a1406bb60 msgr2=0x7f4a1406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 -- 172.21.15.3:0/2746504373 shutdown_connections 2023-05-17T11:45:43.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 -- 172.21.15.3:0/2746504373 wait complete. 2023-05-17T11:45:43.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f680b88c640 1 Processor -- start 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.427+0000 7f680b88c640 1 -- start start 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 0x7f680414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68040b2ac0 0x7f680414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68041586e0 0x7f6804158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 0x7f680414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 0x7f680414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53956/0 (socket says 172.21.15.3:53956) 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 -- 172.21.15.3:0/2456427056 learned_addr learned my addr 172.21.15.3:0/2456427056 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6808e27640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68040b2ac0 0x7f680414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680414d8d0 con 0x7f68040b2ac0 2023-05-17T11:45:43.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809e29640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68041586e0 0x7f6804158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680414d5f0 con 0x7f68041586e0 2023-05-17T11:45:43.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680414e1c0 con 0x7f680406d680 2023-05-17T11:45:43.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f3b6818f640 1 Processor -- start 2023-05-17T11:45:43.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54418c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c0c9f10 0x7f543c06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54418c3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f543c0ad450 0x7f543c0ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f3b6818f640 1 -- start start 2023-05-17T11:45:43.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 -- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68041586e0 msgr2=0x7f6804158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68041586e0 0x7f6804158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54418c3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f543c1605c0 0x7f543c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 -- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68040b2ac0 msgr2=0x7f680414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68040b2ac0 0x7f680414eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40094d0 con 0x7f680406d680 2023-05-17T11:45:43.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54418c3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c15c250 con 0x7f543c0ad450 2023-05-17T11:45:43.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54418c3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0ad950 con 0x7f543c1605c0 2023-05-17T11:45:43.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54418c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c15fae0 con 0x7f543c0c9f10 2023-05-17T11:45:43.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54408c1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c0c9f10 0x7f543c06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f6809628640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 0x7f680414cf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e930 tx=0x7f67f400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54410c2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f543c1605c0 0x7f543c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54410c2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f543c1605c0 0x7f543c0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56580/0 (socket says 172.21.15.3:56580) 2023-05-17T11:45:43.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54410c2640 1 -- 172.21.15.3:0/1163772555 learned_addr learned my addr 172.21.15.3:0/1163772555 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f543bfff640 1 --2- 172.21.15.3:0/1163772555 >> v2:172.21.15.3:3300/0 conn(0x7f543c0ad450 0x7f543c0ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400ca00 con 0x7f680406d680 2023-05-17T11:45:43.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f400cb60 con 0x7f680406d680 2023-05-17T11:45:43.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4013470 con 0x7f680406d680 2023-05-17T11:45:43.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f4a198f9640 1 Processor -- start 2023-05-17T11:45:43.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc009a70 con 0x7f680406d680 2023-05-17T11:45:43.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6818f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b580393d0 0x7f3b58036530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6818f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3b58036a70 0x7f3b5804f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6818f640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b58036ed0 con 0x7f3b580e04d0 2023-05-17T11:45:43.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6818f640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5804f070 con 0x7f3b58036a70 2023-05-17T11:45:43.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6818f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b58037f60 con 0x7f3b580393d0 2023-05-17T11:45:43.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68040b2910 con 0x7f680406d680 2023-05-17T11:45:43.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 -- start start 2023-05-17T11:45:43.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3b58036a70 0x7f3b5804f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3b58036a70 0x7f3b5804f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51828/0 (socket says 172.21.15.3:51828) 2023-05-17T11:45:43.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 -- 172.21.15.3:0/1080970731 learned_addr learned my addr 172.21.15.3:0/1080970731 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 0x7f4a14152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040b2780 con 0x7f680406d680 2023-05-17T11:45:43.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 -- 172.21.15.3:0/1080970731 >> v2:172.21.15.60:3300/0 conn(0x7f3b580393d0 msgr2=0x7f3b58036530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 --2- 172.21.15.3:0/1080970731 >> v2:172.21.15.60:3300/0 conn(0x7f3b580393d0 0x7f3b58036530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 -- 172.21.15.3:0/1080970731 >> v1:172.21.15.3:6789/0 conn(0x7f3b580e04d0 legacy=0x7f3b580e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a14159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a141603c0 0x7f4a14152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14160f00 con 0x7f4a140cabe0 2023-05-17T11:45:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a127fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a14159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a141608d0 con 0x7f4a14071a70 2023-05-17T11:45:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 0x7f4a14152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a127fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a14159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51836/0 (socket says 172.21.15.3:51836) 2023-05-17T11:45:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 0x7f4a14152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56602/0 (socket says 172.21.15.3:56602) 2023-05-17T11:45:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a127fc640 1 -- 172.21.15.3:0/2918589569 learned_addr learned my addr 172.21.15.3:0/2918589569 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a198f9640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a141570f0 con 0x7f4a141603c0 2023-05-17T11:45:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.431+0000 7f54410c2640 1 -- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c0c9f10 msgr2=0x7f543c06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f54410c2640 1 --2- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c0c9f10 0x7f543c06dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f54410c2640 1 -- 172.21.15.3:0/1163772555 >> v2:172.21.15.3:3300/0 conn(0x7f543c0ad450 msgr2=0x7f543c0ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f54410c2640 1 --2- 172.21.15.3:0/1163772555 >> v2:172.21.15.3:3300/0 conn(0x7f543c0ad450 0x7f543c0ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f54410c2640 1 -- 172.21.15.3:0/1163772555 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c15fdc0 con 0x7f543c1605c0 2023-05-17T11:45:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f54408c1640 1 --2- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c0c9f10 0x7f543c06dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 -- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a141603c0 msgr2=0x7f4a14152680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T11:45:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a141603c0 0x7f4a14152680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 -- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 msgr2=0x7f4a14159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a14159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 -- 172.21.15.3:0/2918589569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009420 con 0x7f4a14071a70 2023-05-17T11:45:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f111702a640 1 Processor -- start 2023-05-17T11:45:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a12ffd640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 0x7f4a14152cb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400ebc0 tx=0x7f4a0400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f111702a640 1 -- start start 2023-05-17T11:45:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f543bfff640 1 --2- 172.21.15.3:0/1163772555 >> v2:172.21.15.3:3300/0 conn(0x7f543c0ad450 0x7f543c0ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67f40135d0 con 0x7f680406d680 2023-05-17T11:45:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400cda0 con 0x7f4a14071a70 2023-05-17T11:45:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f57cd39b640 1 Processor -- start 2023-05-17T11:45:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1406de00 con 0x7f4a14071a70 2023-05-17T11:45:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a140b22b0 con 0x7f4a14071a70 2023-05-17T11:45:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0400f040 con 0x7f4a14071a70 2023-05-17T11:45:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040146c0 con 0x7f4a14071a70 2023-05-17T11:45:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57cd39b640 1 -- start start 2023-05-17T11:45:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f54410c2640 1 --2- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c1605c0 0x7f543c0cae00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f543c0ad860 tx=0x7f543401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66843966cb99bc87 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f67f9ffb640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f67e8066280 0x7f67e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f111702a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f110803a4a0 0x7f11080543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f111702a640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110804f210 con 0x7f1108036640 2023-05-17T11:45:43.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f111702a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1108054900 con 0x7f1108050f80 2023-05-17T11:45:43.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f111702a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110804fa20 con 0x7f110803a4a0 2023-05-17T11:45:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67f4083ff0 con 0x7f680406d680 2023-05-17T11:45:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.435+0000 7f3b6672c640 1 -- 172.21.15.3:0/1080970731 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580e18b0 con 0x7f3b58036a70 2023-05-17T11:45:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116028640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f110803a4a0 0x7f11080543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f6808e27640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f67e8066280 0x7f67e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f88ba96d640 1 Processor -- start 2023-05-17T11:45:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116028640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f110803a4a0 0x7f11080543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56614/0 (socket says 172.21.15.3:56614) 2023-05-17T11:45:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116028640 1 -- 172.21.15.3:0/2788691847 learned_addr learned my addr 172.21.15.3:0/2788691847 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116829640 1 --1- 172.21.15.3:0/2788691847 >> v1:172.21.15.3:6789/0 conn(0x7f1108036640 0x7f11080e2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46884/0 (socket says 172.21.15.3:46884) 2023-05-17T11:45:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1406df90 con 0x7f4a14071a70 2023-05-17T11:45:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f6808e27640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f67e8066280 0x7f67e8068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6804155280 tx=0x7f6800009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116028640 1 -- 172.21.15.3:0/2788691847 >> v1:172.21.15.60:6789/0 conn(0x7f1108050f80 legacy=0x7f11080068e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116028640 1 -- 172.21.15.3:0/2788691847 >> v1:172.21.15.3:6789/0 conn(0x7f1108036640 legacy=0x7f11080e2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f1116028640 1 -- 172.21.15.3:0/2788691847 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110804f460 con 0x7f110803a4a0 2023-05-17T11:45:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f543b7fe640 1 -- 172.21.15.3:0/1163772555 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340a5820 con 0x7f543c1605c0 2023-05-17T11:45:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f543b7fe640 1 -- 172.21.15.3:0/1163772555 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54340a5980 con 0x7f543c1605c0 2023-05-17T11:45:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f543b7fe640 1 -- 172.21.15.3:0/1163772555 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340a5d10 con 0x7f543c1605c0 2023-05-17T11:45:43.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f3b6672c640 1 --2- 172.21.15.3:0/1080970731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b58036a70 0x7f3b5804f500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3b600637a0 tx=0x7f3b60096670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a699c0e0d79652 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f3b64f29640 1 -- 172.21.15.3:0/1080970731 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60125640 con 0x7f3b58036a70 2023-05-17T11:45:43.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f3b64f29640 1 -- 172.21.15.3:0/1080970731 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60121070 con 0x7f3b58036a70 2023-05-17T11:45:43.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f3b64f29640 1 -- 172.21.15.3:0/1080970731 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60125640 con 0x7f3b58036a70 2023-05-17T11:45:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57cd39b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c8071ac0 0x7f57c806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57cd39b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f57c80ca620 0x7f57c80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57cd39b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c8071630 con 0x7f57c8158e00 2023-05-17T11:45:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57cd39b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c8071f10 con 0x7f57c80ca620 2023-05-17T11:45:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57cd39b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c806db00 con 0x7f57c8071ac0 2023-05-17T11:45:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f88ba96d640 1 -- start start 2023-05-17T11:45:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57ccb9a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f57c80ca620 0x7f57c80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57ccb9a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f57c80ca620 0x7f57c80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51846/0 (socket says 172.21.15.3:51846) 2023-05-17T11:45:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f57ccb9a640 1 -- 172.21.15.3:0/4106487957 learned_addr learned my addr 172.21.15.3:0/4106487957 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f54418c3640 1 -- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c1605c0 msgr2=0x7f543c0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.439+0000 7f54418c3640 1 --2- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c1605c0 0x7f543c0cae00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f543c0ad860 tx=0x7f543401c9e0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 -- 172.21.15.3:0/1163772555 shutdown_connections 2023-05-17T11:45:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 --2- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c1605c0 0x7f543c0cae00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 --2- 172.21.15.3:0/1163772555 >> v2:172.21.15.3:3300/0 conn(0x7f543c0ad450 0x7f543c0ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 --2- 172.21.15.3:0/1163772555 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c0c9f10 0x7f543c06dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 -- 172.21.15.3:0/1163772555 >> 172.21.15.3:0/1163772555 conn(0x7f543c0afdd0 msgr2=0x7f543c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 -- 172.21.15.3:0/1163772555 shutdown_connections 2023-05-17T11:45:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 -- 172.21.15.3:0/1163772555 wait complete. 2023-05-17T11:45:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 -- 172.21.15.3:0/1080970731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b58036a70 msgr2=0x7f3b5804f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 --2- 172.21.15.3:0/1080970731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b58036a70 0x7f3b5804f500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3b600637a0 tx=0x7f3b60096670 comp rx=0 tx=0).stop 2023-05-17T11:45:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88ba96d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88b40b2820 0x7f88b40afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88ba96d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88b406a600 0x7f88b40b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88ba96d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b4071b30 con 0x7f88b4160010 2023-05-17T11:45:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88ba96d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b4164850 con 0x7f88b40b2820 2023-05-17T11:45:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88ba96d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b40717c0 con 0x7f88b406a600 2023-05-17T11:45:43.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 -- 172.21.15.3:0/1080970731 shutdown_connections 2023-05-17T11:45:43.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 --2- 172.21.15.3:0/1080970731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b58036a70 0x7f3b5804f500 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 --2- 172.21.15.3:0/1080970731 >> v2:172.21.15.60:3300/0 conn(0x7f3b580393d0 0x7f3b58036530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 -- 172.21.15.3:0/1080970731 >> 172.21.15.3:0/1080970731 conn(0x7f3b58051530 msgr2=0x7f3b58051930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f57ccb9a640 1 -- 172.21.15.3:0/4106487957 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c8071ac0 msgr2=0x7f57c806d5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T11:45:43.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f57ccb9a640 1 --2- 172.21.15.3:0/4106487957 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c8071ac0 0x7f57c806d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f57ccb9a640 1 -- 172.21.15.3:0/4106487957 >> v1:172.21.15.60:6789/0 conn(0x7f57c8158e00 legacy=0x7f57c80c9f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T11:45:43.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f57ccb9a640 1 -- 172.21.15.3:0/4106487957 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8070d00 con 0x7f57c80ca620 2023-05-17T11:45:43.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88b4160010 0x7f88b406fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:32856/0 (socket says 172.21.15.3:32856) 2023-05-17T11:45:43.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b3fff640 1 -- 172.21.15.3:0/2557318410 learned_addr learned my addr 172.21.15.3:0/2557318410 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:43.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b8f0a640 1 --2- 172.21.15.3:0/2557318410 >> v2:172.21.15.60:3300/0 conn(0x7f88b406a600 0x7f88b40b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 -- 172.21.15.3:0/1080970731 shutdown_connections 2023-05-17T11:45:43.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f3b6818f640 1 -- 172.21.15.3:0/1080970731 wait complete. 2023-05-17T11:45:43.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a04014820 con 0x7f4a14071a70 2023-05-17T11:45:43.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b37fe640 1 --2- 172.21.15.3:0/2557318410 >> v2:172.21.15.3:3300/0 conn(0x7f88b40b2820 0x7f88b40afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b8f0a640 1 -- 172.21.15.3:0/2557318410 >> v2:172.21.15.3:3300/0 conn(0x7f88b40b2820 msgr2=0x7f88b40afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:43.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f4a0bfff640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f49f4066380 0x7f49f4068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a04084940 con 0x7f4a14071a70 2023-05-17T11:45:43.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 Processor -- start 2023-05-17T11:45:43.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f4a127fc640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f49f4066380 0x7f49f4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f1116028640 1 --2- 172.21.15.3:0/2788691847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110803a4a0 0x7f11080543c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1100009870 tx=0x7f110001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5606831332f63cfa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f54418c3640 1 -- start start 2023-05-17T11:45:43.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f67f4051430 con 0x7f680406d680 2023-05-17T11:45:43.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b8f0a640 1 --2- 172.21.15.3:0/2557318410 >> v2:172.21.15.3:3300/0 conn(0x7f88b40b2820 0x7f88b40afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b8f0a640 1 -- 172.21.15.3:0/2557318410 >> v1:172.21.15.60:6789/0 conn(0x7f88b4160010 legacy=0x7f88b406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b8f0a640 1 -- 172.21.15.3:0/2557318410 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4164b30 con 0x7f88b406a600 2023-05-17T11:45:43.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.443+0000 7f88b37fe640 1 --2- 172.21.15.3:0/2557318410 >> v2:172.21.15.3:3300/0 conn(0x7f88b40b2820 0x7f88b40afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:43.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 Processor -- start 2023-05-17T11:45:43.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 -- start start 2023-05-17T11:45:43.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f4a127fc640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f49f4066380 0x7f49f4068830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49fc01ccf0 tx=0x7f49fc004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57ccb9a640 1 --2- 172.21.15.3:0/4106487957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c80ca620 0x7f57c80cb6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d150 tx=0x7f57c001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47362c8d4ea8174 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54418c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c0ad450 0x7f543c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57c6ffd640 1 -- 172.21.15.3:0/4106487957 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c000b2d0 con 0x7f57c80ca620 2023-05-17T11:45:43.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57c6ffd640 1 -- 172.21.15.3:0/4106487957 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c000b430 con 0x7f57c80ca620 2023-05-17T11:45:43.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f1115026640 1 -- 172.21.15.3:0/2788691847 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000ac410 con 0x7f110803a4a0 2023-05-17T11:45:43.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f1115026640 1 -- 172.21.15.3:0/2788691847 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000ac570 con 0x7f110803a4a0 2023-05-17T11:45:43.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f1115026640 1 -- 172.21.15.3:0/2788691847 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000ac900 con 0x7f110803a4a0 2023-05-17T11:45:43.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54418c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 0x7f543c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54418c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f543c0c1350 0x7f543c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57c6ffd640 1 -- 172.21.15.3:0/4106487957 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c00a7af0 con 0x7f57c80ca620 2023-05-17T11:45:43.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 -- 172.21.15.3:0/4106487957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c80ca620 msgr2=0x7f57c80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 --2- 172.21.15.3:0/4106487957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c80ca620 0x7f57c80cb6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d150 tx=0x7f57c001eb30 comp rx=0 tx=0).stop 2023-05-17T11:45:43.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54408c1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c0ad450 0x7f543c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f543bfff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 0x7f543c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f543bfff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 0x7f543c156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53982/0 (socket says 172.21.15.3:53982) 2023-05-17T11:45:43.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 0x7f3b581881e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54410c2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f543c0c1350 0x7f543c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54410c2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f543c0c1350 0x7f543c156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51872/0 (socket says 172.21.15.3:51872) 2023-05-17T11:45:43.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f543bfff640 1 -- 172.21.15.3:0/1726657429 learned_addr learned my addr 172.21.15.3:0/1726657429 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b580393d0 0x7f3b5800a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b580e04d0 0x7f3b580defc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58188720 con 0x7f3b580e04d0 2023-05-17T11:45:43.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5818ad10 con 0x7f3b580393d0 2023-05-17T11:45:43.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0c1d10 con 0x7f543c0c1350 2023-05-17T11:45:43.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6818f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581875e0 con 0x7f3b58036a70 2023-05-17T11:45:43.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c156ca0 con 0x7f543c0ad450 2023-05-17T11:45:43.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0b2620 con 0x7f543c1605c0 2023-05-17T11:45:43.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4a04051e30 con 0x7f4a14071a70 2023-05-17T11:45:43.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b65f2b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 0x7f3b581881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b6572a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b580393d0 0x7f3b5800a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b65f2b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 0x7f3b581881e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53984/0 (socket says 172.21.15.3:53984) 2023-05-17T11:45:43.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f3b65f2b640 1 -- 172.21.15.3:0/749283788 learned_addr learned my addr 172.21.15.3:0/749283788 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 -- 172.21.15.3:0/4106487957 shutdown_connections 2023-05-17T11:45:43.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 --2- 172.21.15.3:0/4106487957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c80ca620 0x7f57c80cb6f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 --2- 172.21.15.3:0/4106487957 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c8071ac0 0x7f57c806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 -- 172.21.15.3:0/4106487957 >> 172.21.15.3:0/4106487957 conn(0x7f57c806b7f0 msgr2=0x7f57c80b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.447+0000 7f57cd39b640 1 -- 172.21.15.3:0/4106487957 shutdown_connections 2023-05-17T11:45:43.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88b8f0a640 1 --2- 172.21.15.3:0/2557318410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b406a600 0x7f88b40b0310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88b40b2e90 tx=0x7f88a401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8209e393a6529411 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b6672c640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b580e04d0 0x7f3b580defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b65f2b640 1 -- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b580393d0 msgr2=0x7f3b5800a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b65f2b640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b580393d0 0x7f3b5800a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b65f2b640 1 -- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b580e04d0 msgr2=0x7f3b580defc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b65f2b640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b580e04d0 0x7f3b580defc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b65f2b640 1 -- 172.21.15.3:0/749283788 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b600616e0 con 0x7f3b58036a70 2023-05-17T11:45:43.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f111702a640 1 -- 172.21.15.3:0/2788691847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110803a4a0 msgr2=0x7f11080543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f111702a640 1 --2- 172.21.15.3:0/2788691847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110803a4a0 0x7f11080543c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1100009870 tx=0x7f110001c4c0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f57cd39b640 1 -- 172.21.15.3:0/4106487957 wait complete. 2023-05-17T11:45:43.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88b2ffd640 1 -- 172.21.15.3:0/2557318410 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40ab600 con 0x7f88b406a600 2023-05-17T11:45:43.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88b2ffd640 1 -- 172.21.15.3:0/2557318410 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a40a7050 con 0x7f88b406a600 2023-05-17T11:45:43.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b65f2b640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 0x7f3b581881e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00c500 tx=0x7f3b5c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88b2ffd640 1 -- 172.21.15.3:0/2557318410 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40ab600 con 0x7f88b406a600 2023-05-17T11:45:43.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c005220 con 0x7f3b58036a70 2023-05-17T11:45:43.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c005380 con 0x7f3b58036a70 2023-05-17T11:45:43.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c007270 con 0x7f3b58036a70 2023-05-17T11:45:43.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b58033ab0 con 0x7f3b58036a70 2023-05-17T11:45:43.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 -- 172.21.15.3:0/2557318410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b406a600 msgr2=0x7f88b40b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 --2- 172.21.15.3:0/2557318410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b406a600 0x7f88b40b0310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88b40b2e90 tx=0x7f88a401c460 comp rx=0 tx=0).stop 2023-05-17T11:45:43.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b580511b0 con 0x7f3b58036a70 2023-05-17T11:45:43.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 -- 172.21.15.3:0/2557318410 shutdown_connections 2023-05-17T11:45:43.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 --2- 172.21.15.3:0/2557318410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b406a600 0x7f88b40b0310 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 --2- 172.21.15.3:0/2557318410 >> v2:172.21.15.3:3300/0 conn(0x7f88b40b2820 0x7f88b40afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 -- 172.21.15.3:0/2557318410 >> 172.21.15.3:0/2557318410 conn(0x7f88b4069ab0 msgr2=0x7f88b4069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f57cd39b640 1 Processor -- start 2023-05-17T11:45:43.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 -- 172.21.15.3:0/2557318410 shutdown_connections 2023-05-17T11:45:43.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f88ba96d640 1 -- 172.21.15.3:0/2557318410 wait complete. 2023-05-17T11:45:43.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f57cd39b640 1 -- start start 2023-05-17T11:45:43.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f57cd39b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 0x7f57c8154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f57cd39b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c8158e00 0x7f57c8157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57cd39b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57c8158170 0x7f57c80b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57cd39b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c81585e0 con 0x7f57c8158e00 2023-05-17T11:45:43.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 0x7f57c8154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 0x7f57c8154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:53998/0 (socket says 172.21.15.3:53998) 2023-05-17T11:45:43.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 -- 172.21.15.3:0/3804793181 learned_addr learned my addr 172.21.15.3:0/3804793181 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b3e70 con 0x7f57c8158170 2023-05-17T11:45:43.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b39e0 con 0x7f57c80ca620 2023-05-17T11:45:43.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57ccb9a640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57c8158170 0x7f57c80b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f88ba96d640 1 Processor -- start 2023-05-17T11:45:43.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f111702a640 1 -- 172.21.15.3:0/2788691847 shutdown_connections 2023-05-17T11:45:43.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f111702a640 1 --2- 172.21.15.3:0/2788691847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110803a4a0 0x7f11080543c0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1100009870 tx=0x7f110001c4c0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f111702a640 1 -- 172.21.15.3:0/2788691847 >> 172.21.15.3:0/2788691847 conn(0x7f1108051640 msgr2=0x7f1108051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 -- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57c8158170 msgr2=0x7f57c80b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57c8158170 0x7f57c80b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 -- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c8158e00 msgr2=0x7f57c8157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c8158e00 0x7f57c8157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c000bd40 con 0x7f57c80ca620 2023-05-17T11:45:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c7fff640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 0x7f57c8154e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b420 tx=0x7f57bc00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc011830 con 0x7f57c80ca620 2023-05-17T11:45:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.451+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58037900 con 0x7f3b58036a70 2023-05-17T11:45:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b5c0073d0 con 0x7f3b58036a70 2023-05-17T11:45:43.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c8069c40 con 0x7f57c80ca620 2023-05-17T11:45:43.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8069ab0 con 0x7f57c80ca620 2023-05-17T11:45:43.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f88ba96d640 1 -- start start 2023-05-17T11:45:43.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f111702a640 1 -- 172.21.15.3:0/2788691847 shutdown_connections 2023-05-17T11:45:43.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f543bfff640 1 -- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c0ad450 msgr2=0x7f543c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f543bfff640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c0ad450 0x7f543c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f543bfff640 1 -- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f543c0c1350 msgr2=0x7f543c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f543bfff640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f543c0c1350 0x7f543c156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f543bfff640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009420 con 0x7f543c1605c0 2023-05-17T11:45:43.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f543bfff640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 0x7f543c156220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f542c00ec10 tx=0x7f542c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f3b567fc640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b44066280 0x7f3b44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b5c083610 con 0x7f3b58036a70 2023-05-17T11:45:43.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f88ba96d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 0x7f88b4150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f88ba96d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b40b2820 0x7f88b4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88ba96d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88b4160010 0x7f88b414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f3b6572a640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b44066280 0x7f3b44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0119b0 con 0x7f57c80ca620 2023-05-17T11:45:43.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc011d60 con 0x7f57c80ca620 2023-05-17T11:45:43.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b40b2820 0x7f88b4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b40b2820 0x7f88b4153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56656/0 (socket says 172.21.15.3:56656) 2023-05-17T11:45:43.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.455+0000 7f111702a640 1 -- 172.21.15.3:0/2788691847 wait complete. 2023-05-17T11:45:43.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b8f0a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88b4160010 0x7f88b414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 0x7f88b4150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b8f0a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88b4160010 0x7f88b414bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51900/0 (socket says 172.21.15.3:51900) 2023-05-17T11:45:43.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 0x7f88b4150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:54010/0 (socket says 172.21.15.3:54010) 2023-05-17T11:45:43.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b37fe640 1 -- 172.21.15.3:0/1357487642 learned_addr learned my addr 172.21.15.3:0/1357487642 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b414d7c0 con 0x7f88b4160010 2023-05-17T11:45:43.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b414daa0 con 0x7f88b40b2820 2023-05-17T11:45:43.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b414dd80 con 0x7f88b406a600 2023-05-17T11:45:43.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 Processor -- start 2023-05-17T11:45:43.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 -- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b40b2820 msgr2=0x7f88b4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b40b2820 0x7f88b4153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 -- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88b4160010 msgr2=0x7f88b414bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88b4160010 0x7f88b414bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a4009420 con 0x7f88b406a600 2023-05-17T11:45:43.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b3fff640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 0x7f88b4150f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00caa0 tx=0x7f88ac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57bc01b460 con 0x7f57c80ca620 2023-05-17T11:45:43.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f3b6572a640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b44066280 0x7f3b44068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b580d46a0 tx=0x7f3b50009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 -- start start 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1108036640 0x7f1108180a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1108050f80 0x7f11080da4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f11080d8a50 0x7f11080e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11080486d0 con 0x7f1108036640 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108180f90 con 0x7f1108050f80 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f111702a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110804dc90 con 0x7f11080d8a50 2023-05-17T11:45:43.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f1116028640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1108036640 0x7f1108180a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f1116028640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1108036640 0x7f1108180a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51912/0 (socket says 172.21.15.3:51912) 2023-05-17T11:45:43.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f1116028640 1 -- 172.21.15.3:0/2622115056 learned_addr learned my addr 172.21.15.3:0/2622115056 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:43.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00aba0 con 0x7f88b406a600 2023-05-17T11:45:43.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b4160d80 con 0x7f88b406a600 2023-05-17T11:45:43.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b4160bf0 con 0x7f88b406a600 2023-05-17T11:45:43.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f1115827640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1108050f80 0x7f11080da4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f1116829640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f11080d8a50 0x7f11080e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1115827640 1 -- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f11080d8a50 msgr2=0x7f11080e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1115827640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f11080d8a50 0x7f11080e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1115827640 1 -- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1108036640 msgr2=0x7f1108180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1115827640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1108036640 0x7f1108180a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1115827640 1 -- 172.21.15.3:0/2622115056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000094d0 con 0x7f1108050f80 2023-05-17T11:45:43.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac00ad00 con 0x7f88b406a600 2023-05-17T11:45:43.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac012600 con 0x7f88b406a600 2023-05-17T11:45:43.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1115827640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1108050f80 0x7f11080da4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1110069440 tx=0x7f1110066df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00cc30 con 0x7f543c1605c0 2023-05-17T11:45:43.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c00cd90 con 0x7f543c1605c0 2023-05-17T11:45:43.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.459+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c013670 con 0x7f543c1605c0 2023-05-17T11:45:43.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5434009b30 con 0x7f543c1605c0 2023-05-17T11:45:43.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c06c300 con 0x7f543c1605c0 2023-05-17T11:45:43.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110070a40 con 0x7f1108050f80 2023-05-17T11:45:43.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110070be0 con 0x7f1108050f80 2023-05-17T11:45:43.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11100926c0 con 0x7f1108050f80 2023-05-17T11:45:43.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c8069dd0 con 0x7f57c80ca620 2023-05-17T11:45:43.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88ac007070 con 0x7f88b406a600 2023-05-17T11:45:43.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1108036eb0 con 0x7f1108050f80 2023-05-17T11:45:43.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11080063c0 con 0x7f1108050f80 2023-05-17T11:45:43.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8894005260 con 0x7f88b406a600 2023-05-17T11:45:43.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11080e37f0 con 0x7f1108050f80 2023-05-17T11:45:43.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c06c170 con 0x7f543c1605c0 2023-05-17T11:45:43.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.463+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3b5c050a00 con 0x7f3b58036a70 2023-05-17T11:45:43.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f88b0ff9640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f88a0066250 0x7f88a0068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88ac083b10 con 0x7f88b406a600 2023-05-17T11:45:43.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1110092820 con 0x7f1108050f80 2023-05-17T11:45:43.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f1106ffd640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10f4066350 0x7f10f4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f111008d070 con 0x7f1108050f80 2023-05-17T11:45:43.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f542c0137d0 con 0x7f543c1605c0 2023-05-17T11:45:43.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f54397fa640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5428066280 0x7f5428068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f542c083fa0 con 0x7f543c1605c0 2023-05-17T11:45:43.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f57c4ff9640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f57b4066300 0x7f57b40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:43.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57bc0839d0 con 0x7f57c80ca620 2023-05-17T11:45:43.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f54408c1640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5428066280 0x7f5428068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f1116028640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10f4066350 0x7f10f4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f88b37fe640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f88a0066250 0x7f88a0068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.467+0000 7f57c77fe640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f57b4066300 0x7f57b40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:43.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.471+0000 7f57c77fe640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f57b4066300 0x7f57b40687b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57c815b870 tx=0x7f57b8006c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.471+0000 7f54408c1640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5428066280 0x7f5428068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5430006fd0 tx=0x7f5430008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.471+0000 7f1116028640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10f4066350 0x7f10f4068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1100009870 tx=0x7f11000a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.471+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f88ac050fa0 con 0x7f88b406a600 2023-05-17T11:45:43.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.471+0000 7f88b37fe640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f88a0066250 0x7f88a0068700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88b4154ef0 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:43.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.471+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f11100ca600 con 0x7f1108050f80 2023-05-17T11:45:43.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.479+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f542c051430 con 0x7f543c1605c0 2023-05-17T11:45:43.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.479+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f57bc054930 con 0x7f57c80ca620 2023-05-17T11:45:43.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.707+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb7ec005510 con 0x7fb804159020 2023-05-17T11:45:43.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.707+0000 7fb7fa7fc640 1 -- 172.21.15.3:0/3947642362 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7f4017020 con 0x7fb804159020 2023-05-17T11:45:43.721 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:43.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.711+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7e8066350 msgr2=0x7fb7e8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.711+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7e8066350 0x7fb7e8068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb800011310 tx=0x7fb800009190 comp rx=0 tx=0).stop 2023-05-17T11:45:43.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.711+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb804159020 msgr2=0x7fb8041fddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.711+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb804159020 0x7fb8041fddd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400c410 tx=0x7fb7f400c8d0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 shutdown_connections 2023-05-17T11:45:43.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb7e8066350 0x7fb7e8068800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb804159020 0x7fb8041fddd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb8040b24f0 0x7fb80414c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 --2- 172.21.15.3:0/3947642362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80406d4b0 0x7fb804201790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 >> 172.21.15.3:0/3947642362 conn(0x7fb80406bb60 msgr2=0x7fb80406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 shutdown_connections 2023-05-17T11:45:43.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.715+0000 7fb80bf6d640 1 -- 172.21.15.3:0/3947642362 wait complete. 2023-05-17T11:45:43.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-05-17T11:45:43.754 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.759+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f68040cbe40 con 0x7f680406d680 2023-05-17T11:45:43.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.759+0000 7f67f9ffb640 1 -- 172.21.15.3:0/2456427056 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67f4054a50 con 0x7f680406d680 2023-05-17T11:45:43.769 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-05-17T11:45:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f67e8066280 msgr2=0x7f67e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f67e8066280 0x7f67e8068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6804155280 tx=0x7f6800009040 comp rx=0 tx=0).stop 2023-05-17T11:45:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 msgr2=0x7f680414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 0x7f680414cf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e930 tx=0x7f67f400edf0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 shutdown_connections 2023-05-17T11:45:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f67e8066280 0x7f67e8068730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68041586e0 0x7f6804158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68040b2ac0 0x7f680414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 --2- 172.21.15.3:0/2456427056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f680406d680 0x7f680414cf50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 >> 172.21.15.3:0/2456427056 conn(0x7f680406bb60 msgr2=0x7f68040cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 shutdown_connections 2023-05-17T11:45:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.763+0000 7f680b88c640 1 -- 172.21.15.3:0/2456427056 wait complete. 2023-05-17T11:45:43.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-05-17T11:45:43.792 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.783+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a14066060 con 0x7f4a14071a70 2023-05-17T11:45:43.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.783+0000 7f4a0bfff640 1 -- 172.21.15.3:0/2918589569 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a04055450 con 0x7f4a14071a70 2023-05-17T11:45:43.794 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:43.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f49f4066380 msgr2=0x7f49f4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f49f4066380 0x7f49f4068830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49fc01ccf0 tx=0x7f49fc004740 comp rx=0 tx=0).stop 2023-05-17T11:45:43.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 msgr2=0x7f4a14152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 0x7f4a14152cb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400ebc0 tx=0x7f4a0400c490 comp rx=0 tx=0).stop 2023-05-17T11:45:43.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 shutdown_connections 2023-05-17T11:45:43.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f49f4066380 0x7f49f4068830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4a141603c0 0x7f4a14152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a140cabe0 0x7f4a14159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 --2- 172.21.15.3:0/2918589569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a14071a70 0x7f4a14152cb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 >> 172.21.15.3:0/2918589569 conn(0x7f4a1406bb60 msgr2=0x7f4a140cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 shutdown_connections 2023-05-17T11:45:43.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.787+0000 7f4a198f9640 1 -- 172.21.15.3:0/2918589569 wait complete. 2023-05-17T11:45:43.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.791+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b58005280 con 0x7f3b58036a70 2023-05-17T11:45:43.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b567fc640 1 -- 172.21.15.3:0/749283788 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b5c054020 con 0x7f3b58036a70 2023-05-17T11:45:43.803 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:43.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b44066280 msgr2=0x7f3b44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b44066280 0x7f3b44068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b580d46a0 tx=0x7f3b50009110 comp rx=0 tx=0).stop 2023-05-17T11:45:43.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 msgr2=0x7f3b581881e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 0x7f3b581881e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00c500 tx=0x7f3b5c00c9c0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 shutdown_connections 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b44066280 0x7f3b44068730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b580e04d0 0x7f3b580defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b580393d0 0x7f3b5800a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 --2- 172.21.15.3:0/749283788 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b58036a70 0x7f3b581881e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 >> 172.21.15.3:0/749283788 conn(0x7f3b58051530 msgr2=0x7f3b580dd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 shutdown_connections 2023-05-17T11:45:43.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.795+0000 7f3b6818f640 1 -- 172.21.15.3:0/749283788 wait complete. 2023-05-17T11:45:43.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.803+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f543c06c490 con 0x7f543c1605c0 2023-05-17T11:45:43.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.803+0000 7f54397fa640 1 -- 172.21.15.3:0/1726657429 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f542c017090 con 0x7f543c1605c0 2023-05-17T11:45:43.812 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-05-17T11:45:43.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.803+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1108005390 con 0x7f1108050f80 2023-05-17T11:45:43.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f1106ffd640 1 -- 172.21.15.3:0/2622115056 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11100cdc20 con 0x7f1108050f80 2023-05-17T11:45:43.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5428066280 msgr2=0x7f5428068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5428066280 0x7f5428068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5430006fd0 tx=0x7f5430008040 comp rx=0 tx=0).stop 2023-05-17T11:45:43.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 msgr2=0x7f543c156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 0x7f543c156220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f542c00ec10 tx=0x7f542c00c520 comp rx=0 tx=0).stop 2023-05-17T11:45:43.816 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:43.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f57c8067130 con 0x7f57c80ca620 2023-05-17T11:45:43.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 shutdown_connections 2023-05-17T11:45:43.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5428066280 0x7f5428068730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f543c0c1350 0x7f543c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f543c1605c0 0x7f543c156220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 --2- 172.21.15.3:0/1726657429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f543c0ad450 0x7f543c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 >> 172.21.15.3:0/1726657429 conn(0x7f543c0afdd0 msgr2=0x7f543c154260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 shutdown_connections 2023-05-17T11:45:43.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f57c4ff9640 1 -- 172.21.15.3:0/3804793181 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57bc0544c0 con 0x7f57c80ca620 2023-05-17T11:45:43.818 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:43.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.807+0000 7f54418c3640 1 -- 172.21.15.3:0/1726657429 wait complete. 2023-05-17T11:45:43.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10f4066350 msgr2=0x7f10f4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10f4066350 0x7f10f4068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1100009870 tx=0x7f11000a6040 comp rx=0 tx=0).stop 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1108050f80 msgr2=0x7f11080da4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1108050f80 0x7f11080da4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1110069440 tx=0x7f1110066df0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 shutdown_connections 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10f4066350 0x7f10f4068800 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f11080d8a50 0x7f11080e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1108050f80 0x7f11080da4d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 --2- 172.21.15.3:0/2622115056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1108036640 0x7f1108180a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 >> 172.21.15.3:0/2622115056 conn(0x7f1108051640 msgr2=0x7f11080e0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f57b4066300 msgr2=0x7f57b40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f57b4066300 0x7f57b40687b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57c815b870 tx=0x7f57b8006c50 comp rx=0 tx=0).stop 2023-05-17T11:45:43.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 shutdown_connections 2023-05-17T11:45:43.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f111702a640 1 -- 172.21.15.3:0/2622115056 wait complete. 2023-05-17T11:45:43.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 msgr2=0x7f57c8154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 0x7f57c8154e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b420 tx=0x7f57bc00b8e0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 shutdown_connections 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f57b4066300 0x7f57b40687b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57c8158170 0x7f57c80b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57c8158e00 0x7f57c8157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 --2- 172.21.15.3:0/3804793181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f57c80ca620 0x7f57c8154e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 >> 172.21.15.3:0/3804793181 conn(0x7f57c8071ac0 msgr2=0x7f57c80b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 shutdown_connections 2023-05-17T11:45:43.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f57cd39b640 1 -- 172.21.15.3:0/3804793181 wait complete. 2023-05-17T11:45:43.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8894005510 con 0x7f88b406a600 2023-05-17T11:45:43.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.811+0000 7f88b0ff9640 1 -- 172.21.15.3:0/1357487642 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88ac017090 con 0x7f88b406a600 2023-05-17T11:45:43.825 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-05-17T11:45:43.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f88a0066250 msgr2=0x7f88a0068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f88a0066250 0x7f88a0068700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88b4154ef0 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2023-05-17T11:45:43.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 msgr2=0x7f88b4150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 0x7f88b4150f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00caa0 tx=0x7f88ac00cf60 comp rx=0 tx=0).stop 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 shutdown_connections 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f88a0066250 0x7f88a0068700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88b4160010 0x7f88b414bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b40b2820 0x7f88b4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 --2- 172.21.15.3:0/1357487642 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f88b406a600 0x7f88b4150f10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:43.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 >> 172.21.15.3:0/1357487642 conn(0x7f88b4069ab0 msgr2=0x7f88b415cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:43.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 shutdown_connections 2023-05-17T11:45:43.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:43.815+0000 7f88ba96d640 1 -- 172.21.15.3:0/1357487642 wait complete. 2023-05-17T11:45:43.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-05-17T11:45:43.831 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-05-17T11:45:43.832 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-05-17T11:45:43.851 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-05-17T11:45:43.851 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-05-17T11:45:43.853 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-05-17T11:45:43.856 DEBUG:teuthology.parallel:result is None 2023-05-17T11:45:43.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-17T11:45:43.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T11:45:44.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 Processor -- start 2023-05-17T11:45:44.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 -- start start 2023-05-17T11:45:44.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f912415be40 0x7f91240d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91240d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91240cf010 0x7f91240cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91240d0710 con 0x7f91240cf010 2023-05-17T11:45:44.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91240cf9d0 con 0x7f912415be40 2023-05-17T11:45:44.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91291df640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240d0900 con 0x7f91240ccf00 2023-05-17T11:45:44.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91240cf010 0x7f91240cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91240cf010 0x7f91240cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51928/0 (socket says 172.21.15.3:51928) 2023-05-17T11:45:44.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 -- 172.21.15.3:0/945906762 learned_addr learned my addr 172.21.15.3:0/945906762 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:44.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f9123fff640 1 --2- 172.21.15.3:0/945906762 >> v2:172.21.15.60:3300/0 conn(0x7f912415be40 0x7f91240d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91237fe640 1 --2- 172.21.15.3:0/945906762 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91240d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 -- 172.21.15.3:0/945906762 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 msgr2=0x7f91240d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:44.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 --2- 172.21.15.3:0/945906762 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91240d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 -- 172.21.15.3:0/945906762 >> v2:172.21.15.60:3300/0 conn(0x7f912415be40 msgr2=0x7f91240d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:44.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 --2- 172.21.15.3:0/945906762 >> v2:172.21.15.60:3300/0 conn(0x7f912415be40 0x7f91240d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.027+0000 7f91289de640 1 -- 172.21.15.3:0/945906762 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240d0be0 con 0x7f91240cf010 2023-05-17T11:45:44.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91289de640 1 --2- 172.21.15.3:0/945906762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91240cf490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f91240cefe0 tx=0x7f911c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697046d46eb4eb53 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f9122ffd640 1 -- 172.21.15.3:0/945906762 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0af400 con 0x7f91240cf010 2023-05-17T11:45:44.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f9122ffd640 1 -- 172.21.15.3:0/945906762 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0ab050 con 0x7f91240cf010 2023-05-17T11:45:44.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f9122ffd640 1 -- 172.21.15.3:0/945906762 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0af780 con 0x7f91240cf010 2023-05-17T11:45:44.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 -- 172.21.15.3:0/945906762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 msgr2=0x7f91240cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 --2- 172.21.15.3:0/945906762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91240cf490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f91240cefe0 tx=0x7f911c01f1c0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 -- 172.21.15.3:0/945906762 shutdown_connections 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 --2- 172.21.15.3:0/945906762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91240cf490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 --2- 172.21.15.3:0/945906762 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91240d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 --2- 172.21.15.3:0/945906762 >> v2:172.21.15.60:3300/0 conn(0x7f912415be40 0x7f91240d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 -- 172.21.15.3:0/945906762 >> 172.21.15.3:0/945906762 conn(0x7f9124065a90 msgr2=0x7f91240711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 -- 172.21.15.3:0/945906762 shutdown_connections 2023-05-17T11:45:44.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 -- 172.21.15.3:0/945906762 wait complete. 2023-05-17T11:45:44.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 Processor -- start 2023-05-17T11:45:44.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.031+0000 7f91291df640 1 -- start start 2023-05-17T11:45:44.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91241589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91241f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912415be40 0x7f912415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91241f2830 con 0x7f91240cf010 2023-05-17T11:45:44.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91241f2270 con 0x7f912415be40 2023-05-17T11:45:44.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91241f2550 con 0x7f91240ccf00 2023-05-17T11:45:44.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91241f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91241f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51940/0 (socket says 172.21.15.3:51940) 2023-05-17T11:45:44.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 -- 172.21.15.3:0/4105699457 learned_addr learned my addr 172.21.15.3:0/4105699457 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:44.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91289de640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912415be40 0x7f912415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f9123fff640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91241589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 -- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 msgr2=0x7f91241589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91241589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 -- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912415be40 msgr2=0x7f912415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912415be40 0x7f912415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 -- 172.21.15.3:0/4105699457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c009b30 con 0x7f91240cf010 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f9123fff640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91241589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:44.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91289de640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912415be40 0x7f912415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:44.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91237fe640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91241f1890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f911800d800 tx=0x7f911800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180096a0 con 0x7f91240cf010 2023-05-17T11:45:44.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118009800 con 0x7f91240cf010 2023-05-17T11:45:44.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118009b70 con 0x7f91240cf010 2023-05-17T11:45:44.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91240d11a0 con 0x7f91240cf010 2023-05-17T11:45:44.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91240d0ec0 con 0x7f91240cf010 2023-05-17T11:45:44.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91240d1480 con 0x7f91240cf010 2023-05-17T11:45:44.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.035+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9118009cd0 con 0x7f91240cf010 2023-05-17T11:45:44.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.039+0000 7f9120ff9640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9110066280 0x7f9110068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.039+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91180844c0 con 0x7f91240cf010 2023-05-17T11:45:44.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.039+0000 7f9123fff640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9110066280 0x7f9110068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.039+0000 7f9123fff640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9110066280 0x7f9110068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91240b0e30 tx=0x7f9114008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.043+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9118051930 con 0x7f91240cf010 2023-05-17T11:45:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.191+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 --> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91240cae80 con 0x7f9110066280 2023-05-17T11:45:44.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.199+0000 7f9120ff9640 1 -- 172.21.15.3:0/4105699457 <== mgr.4110 v2:172.21.15.3:6832/2126677587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286648 (secure 0 0 0) 0x7f91240cae80 con 0x7f9110066280 2023-05-17T11:45:44.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:44.213 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-05-17T11:45:44.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9110066280 msgr2=0x7f9110068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9110066280 0x7f9110068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91240b0e30 tx=0x7f9114008040 comp rx=0 tx=0).stop 2023-05-17T11:45:44.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 msgr2=0x7f91241f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91241f1890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f911800d800 tx=0x7f911800dcc0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 shutdown_connections 2023-05-17T11:45:44.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9110066280 0x7f9110068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912415be40 0x7f912415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91240cf010 0x7f91241f1890 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 --2- 172.21.15.3:0/4105699457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f91240ccf00 0x7f91241589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 >> 172.21.15.3:0/4105699457 conn(0x7f9124065a90 msgr2=0x7f91240b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:44.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 shutdown_connections 2023-05-17T11:45:44.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.203+0000 7f91291df640 1 -- 172.21.15.3:0/4105699457 wait complete. 2023-05-17T11:45:44.231 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-05-17T11:45:42.528328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82600,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":754892120,"statfs":{"total":773094113280,"available":773009530880,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.413752"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678059+0000","last_change":"2023-05-17T11:45:35.531488+0000","last_active":"2023-05-17T11:45:37.678059+0000","last_peered":"2023-05-17T11:45:37.678059+0000","last_clean":"2023-05-17T11:45:37.678059+0000","last_became_active":"2023-05-17T11:45:35.531185+0000","last_became_peered":"2023-05-17T11:45:35.531185+0000","last_unstale":"2023-05-17T11:45:37.678059+0000","last_undegraded":"2023-05-17T11:45:37.678059+0000","last_fullsized":"2023-05-17T11:45:37.678059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:05.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521624+0000","last_change":"2023-05-17T11:45:35.539055+0000","last_active":"2023-05-17T11:45:36.521624+0000","last_peered":"2023-05-17T11:45:36.521624+0000","last_clean":"2023-05-17T11:45:36.521624+0000","last_became_active":"2023-05-17T11:45:35.538706+0000","last_became_peered":"2023-05-17T11:45:35.538706+0000","last_unstale":"2023-05-17T11:45:36.521624+0000","last_undegraded":"2023-05-17T11:45:36.521624+0000","last_fullsized":"2023-05-17T11:45:36.521624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680035+0000","last_change":"2023-05-17T11:45:35.543264+0000","last_active":"2023-05-17T11:45:37.680035+0000","last_peered":"2023-05-17T11:45:37.680035+0000","last_clean":"2023-05-17T11:45:37.680035+0000","last_became_active":"2023-05-17T11:45:35.542323+0000","last_became_peered":"2023-05-17T11:45:35.542323+0000","last_unstale":"2023-05-17T11:45:37.680035+0000","last_undegraded":"2023-05-17T11:45:37.680035+0000","last_fullsized":"2023-05-17T11:45:37.680035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:43.113254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178187+0000","last_change":"2023-05-17T11:45:35.547666+0000","last_active":"2023-05-17T11:45:37.178187+0000","last_peered":"2023-05-17T11:45:37.178187+0000","last_clean":"2023-05-17T11:45:37.178187+0000","last_became_active":"2023-05-17T11:45:35.547228+0000","last_became_peered":"2023-05-17T11:45:35.547228+0000","last_unstale":"2023-05-17T11:45:37.178187+0000","last_undegraded":"2023-05-17T11:45:37.178187+0000","last_fullsized":"2023-05-17T11:45:37.178187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678846+0000","last_change":"2023-05-17T11:45:35.530614+0000","last_active":"2023-05-17T11:45:37.678846+0000","last_peered":"2023-05-17T11:45:37.678846+0000","last_clean":"2023-05-17T11:45:37.678846+0000","last_became_active":"2023-05-17T11:45:35.529983+0000","last_became_peered":"2023-05-17T11:45:35.529983+0000","last_unstale":"2023-05-17T11:45:37.678846+0000","last_undegraded":"2023-05-17T11:45:37.678846+0000","last_fullsized":"2023-05-17T11:45:37.678846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679176+0000","last_change":"2023-05-17T11:45:35.534671+0000","last_active":"2023-05-17T11:45:37.679176+0000","last_peered":"2023-05-17T11:45:37.679176+0000","last_clean":"2023-05-17T11:45:37.679176+0000","last_became_active":"2023-05-17T11:45:35.534089+0000","last_became_peered":"2023-05-17T11:45:35.534089+0000","last_unstale":"2023-05-17T11:45:37.679176+0000","last_undegraded":"2023-05-17T11:45:37.679176+0000","last_fullsized":"2023-05-17T11:45:37.679176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679917+0000","last_change":"2023-05-17T11:45:35.556495+0000","last_active":"2023-05-17T11:45:37.679917+0000","last_peered":"2023-05-17T11:45:37.679917+0000","last_clean":"2023-05-17T11:45:37.679917+0000","last_became_active":"2023-05-17T11:45:35.556172+0000","last_became_peered":"2023-05-17T11:45:35.556172+0000","last_unstale":"2023-05-17T11:45:37.679917+0000","last_undegraded":"2023-05-17T11:45:37.679917+0000","last_fullsized":"2023-05-17T11:45:37.679917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:28.142771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521284+0000","last_change":"2023-05-17T11:45:35.545750+0000","last_active":"2023-05-17T11:45:36.521284+0000","last_peered":"2023-05-17T11:45:36.521284+0000","last_clean":"2023-05-17T11:45:36.521284+0000","last_became_active":"2023-05-17T11:45:35.543809+0000","last_became_peered":"2023-05-17T11:45:35.543809+0000","last_unstale":"2023-05-17T11:45:36.521284+0000","last_undegraded":"2023-05-17T11:45:36.521284+0000","last_fullsized":"2023-05-17T11:45:36.521284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678291+0000","last_change":"2023-05-17T11:45:35.533284+0000","last_active":"2023-05-17T11:45:37.678291+0000","last_peered":"2023-05-17T11:45:37.678291+0000","last_clean":"2023-05-17T11:45:37.678291+0000","last_became_active":"2023-05-17T11:45:35.533036+0000","last_became_peered":"2023-05-17T11:45:35.533036+0000","last_unstale":"2023-05-17T11:45:37.678291+0000","last_undegraded":"2023-05-17T11:45:37.678291+0000","last_fullsized":"2023-05-17T11:45:37.678291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521791+0000","last_change":"2023-05-17T11:45:35.536658+0000","last_active":"2023-05-17T11:45:36.521791+0000","last_peered":"2023-05-17T11:45:36.521791+0000","last_clean":"2023-05-17T11:45:36.521791+0000","last_became_active":"2023-05-17T11:45:35.536150+0000","last_became_peered":"2023-05-17T11:45:35.536150+0000","last_unstale":"2023-05-17T11:45:36.521791+0000","last_undegraded":"2023-05-17T11:45:36.521791+0000","last_fullsized":"2023-05-17T11:45:36.521791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680236+0000","last_change":"2023-05-17T11:45:35.543512+0000","last_active":"2023-05-17T11:45:37.680236+0000","last_peered":"2023-05-17T11:45:37.680236+0000","last_clean":"2023-05-17T11:45:37.680236+0000","last_became_active":"2023-05-17T11:45:35.540333+0000","last_became_peered":"2023-05-17T11:45:35.540333+0000","last_unstale":"2023-05-17T11:45:37.680236+0000","last_undegraded":"2023-05-17T11:45:37.680236+0000","last_fullsized":"2023-05-17T11:45:37.680236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:34.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.677931+0000","last_change":"2023-05-17T11:45:35.542466+0000","last_active":"2023-05-17T11:45:37.677931+0000","last_peered":"2023-05-17T11:45:37.677931+0000","last_clean":"2023-05-17T11:45:37.677931+0000","last_became_active":"2023-05-17T11:45:35.542211+0000","last_became_peered":"2023-05-17T11:45:35.542211+0000","last_unstale":"2023-05-17T11:45:37.677931+0000","last_undegraded":"2023-05-17T11:45:37.677931+0000","last_fullsized":"2023-05-17T11:45:37.677931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:24:13.270647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678158+0000","last_change":"2023-05-17T11:45:35.528858+0000","last_active":"2023-05-17T11:45:37.678158+0000","last_peered":"2023-05-17T11:45:37.678158+0000","last_clean":"2023-05-17T11:45:37.678158+0000","last_became_active":"2023-05-17T11:45:35.527334+0000","last_became_peered":"2023-05-17T11:45:35.527334+0000","last_unstale":"2023-05-17T11:45:37.678158+0000","last_undegraded":"2023-05-17T11:45:37.678158+0000","last_fullsized":"2023-05-17T11:45:37.678158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:54.806823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521378+0000","last_change":"2023-05-17T11:45:35.533168+0000","last_active":"2023-05-17T11:45:36.521378+0000","last_peered":"2023-05-17T11:45:36.521378+0000","last_clean":"2023-05-17T11:45:36.521378+0000","last_became_active":"2023-05-17T11:45:35.532752+0000","last_became_peered":"2023-05-17T11:45:35.532752+0000","last_unstale":"2023-05-17T11:45:36.521378+0000","last_undegraded":"2023-05-17T11:45:36.521378+0000","last_fullsized":"2023-05-17T11:45:36.521378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680090+0000","last_change":"2023-05-17T11:45:35.556519+0000","last_active":"2023-05-17T11:45:37.680090+0000","last_peered":"2023-05-17T11:45:37.680090+0000","last_clean":"2023-05-17T11:45:37.680090+0000","last_became_active":"2023-05-17T11:45:35.556187+0000","last_became_peered":"2023-05-17T11:45:35.556187+0000","last_unstale":"2023-05-17T11:45:37.680090+0000","last_undegraded":"2023-05-17T11:45:37.680090+0000","last_fullsized":"2023-05-17T11:45:37.680090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:46:21.218076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679061+0000","last_change":"2023-05-17T11:45:35.535436+0000","last_active":"2023-05-17T11:45:37.679061+0000","last_peered":"2023-05-17T11:45:37.679061+0000","last_clean":"2023-05-17T11:45:37.679061+0000","last_became_active":"2023-05-17T11:45:35.535014+0000","last_became_peered":"2023-05-17T11:45:35.535014+0000","last_unstale":"2023-05-17T11:45:37.679061+0000","last_undegraded":"2023-05-17T11:45:37.679061+0000","last_fullsized":"2023-05-17T11:45:37.679061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678441+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:37.678441+0000","last_peered":"2023-05-17T11:45:37.678441+0000","last_clean":"2023-05-17T11:45:37.678441+0000","last_became_active":"2023-05-17T11:45:35.530050+0000","last_became_peered":"2023-05-17T11:45:35.530050+0000","last_unstale":"2023-05-17T11:45:37.678441+0000","last_undegraded":"2023-05-17T11:45:37.678441+0000","last_fullsized":"2023-05-17T11:45:37.678441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680310+0000","last_change":"2023-05-17T11:45:35.540996+0000","last_active":"2023-05-17T11:45:37.680310+0000","last_peered":"2023-05-17T11:45:37.680310+0000","last_clean":"2023-05-17T11:45:37.680310+0000","last_became_active":"2023-05-17T11:45:35.539704+0000","last_became_peered":"2023-05-17T11:45:35.539704+0000","last_unstale":"2023-05-17T11:45:37.680310+0000","last_undegraded":"2023-05-17T11:45:37.680310+0000","last_fullsized":"2023-05-17T11:45:37.680310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:52:04.952023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678015+0000","last_change":"2023-05-17T11:45:35.545437+0000","last_active":"2023-05-17T11:45:37.678015+0000","last_peered":"2023-05-17T11:45:37.678015+0000","last_clean":"2023-05-17T11:45:37.678015+0000","last_became_active":"2023-05-17T11:45:35.545111+0000","last_became_peered":"2023-05-17T11:45:35.545111+0000","last_unstale":"2023-05-17T11:45:37.678015+0000","last_undegraded":"2023-05-17T11:45:37.678015+0000","last_fullsized":"2023-05-17T11:45:37.678015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680036+0000","last_change":"2023-05-17T11:45:35.553620+0000","last_active":"2023-05-17T11:45:37.680036+0000","last_peered":"2023-05-17T11:45:37.680036+0000","last_clean":"2023-05-17T11:45:37.680036+0000","last_became_active":"2023-05-17T11:45:35.550862+0000","last_became_peered":"2023-05-17T11:45:35.550862+0000","last_unstale":"2023-05-17T11:45:37.680036+0000","last_undegraded":"2023-05-17T11:45:37.680036+0000","last_fullsized":"2023-05-17T11:45:37.680036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679614+0000","last_change":"2023-05-17T11:45:35.559364+0000","last_active":"2023-05-17T11:45:37.679614+0000","last_peered":"2023-05-17T11:45:37.679614+0000","last_clean":"2023-05-17T11:45:37.679614+0000","last_became_active":"2023-05-17T11:45:35.558911+0000","last_became_peered":"2023-05-17T11:45:35.558911+0000","last_unstale":"2023-05-17T11:45:37.679614+0000","last_undegraded":"2023-05-17T11:45:37.679614+0000","last_fullsized":"2023-05-17T11:45:37.679614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678310+0000","last_change":"2023-05-17T11:45:35.540513+0000","last_active":"2023-05-17T11:45:37.678310+0000","last_peered":"2023-05-17T11:45:37.678310+0000","last_clean":"2023-05-17T11:45:37.678310+0000","last_became_active":"2023-05-17T11:45:35.540257+0000","last_became_peered":"2023-05-17T11:45:35.540257+0000","last_unstale":"2023-05-17T11:45:37.678310+0000","last_undegraded":"2023-05-17T11:45:37.678310+0000","last_fullsized":"2023-05-17T11:45:37.678310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521091+0000","last_change":"2023-05-17T11:45:35.531180+0000","last_active":"2023-05-17T11:45:36.521091+0000","last_peered":"2023-05-17T11:45:36.521091+0000","last_clean":"2023-05-17T11:45:36.521091+0000","last_became_active":"2023-05-17T11:45:35.530904+0000","last_became_peered":"2023-05-17T11:45:35.530904+0000","last_unstale":"2023-05-17T11:45:36.521091+0000","last_undegraded":"2023-05-17T11:45:36.521091+0000","last_fullsized":"2023-05-17T11:45:36.521091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:19.803154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679441+0000","last_change":"2023-05-17T11:45:35.543609+0000","last_active":"2023-05-17T11:45:37.679441+0000","last_peered":"2023-05-17T11:45:37.679441+0000","last_clean":"2023-05-17T11:45:37.679441+0000","last_became_active":"2023-05-17T11:45:35.543225+0000","last_became_peered":"2023-05-17T11:45:35.543225+0000","last_unstale":"2023-05-17T11:45:37.679441+0000","last_undegraded":"2023-05-17T11:45:37.679441+0000","last_fullsized":"2023-05-17T11:45:37.679441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519623+0000","last_change":"2023-05-17T11:45:35.546917+0000","last_active":"2023-05-17T11:45:36.519623+0000","last_peered":"2023-05-17T11:45:36.519623+0000","last_clean":"2023-05-17T11:45:36.519623+0000","last_became_active":"2023-05-17T11:45:35.546616+0000","last_became_peered":"2023-05-17T11:45:35.546616+0000","last_unstale":"2023-05-17T11:45:36.519623+0000","last_undegraded":"2023-05-17T11:45:36.519623+0000","last_fullsized":"2023-05-17T11:45:36.519623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520007+0000","last_change":"2023-05-17T11:45:35.535060+0000","last_active":"2023-05-17T11:45:36.520007+0000","last_peered":"2023-05-17T11:45:36.520007+0000","last_clean":"2023-05-17T11:45:36.520007+0000","last_became_active":"2023-05-17T11:45:35.534805+0000","last_became_peered":"2023-05-17T11:45:35.534805+0000","last_unstale":"2023-05-17T11:45:36.520007+0000","last_undegraded":"2023-05-17T11:45:36.520007+0000","last_fullsized":"2023-05-17T11:45:36.520007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521780+0000","last_change":"2023-05-17T11:45:35.542414+0000","last_active":"2023-05-17T11:45:36.521780+0000","last_peered":"2023-05-17T11:45:36.521780+0000","last_clean":"2023-05-17T11:45:36.521780+0000","last_became_active":"2023-05-17T11:45:35.542083+0000","last_became_peered":"2023-05-17T11:45:35.542083+0000","last_unstale":"2023-05-17T11:45:36.521780+0000","last_undegraded":"2023-05-17T11:45:36.521780+0000","last_fullsized":"2023-05-17T11:45:36.521780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519826+0000","last_change":"2023-05-17T11:45:35.538026+0000","last_active":"2023-05-17T11:45:36.519826+0000","last_peered":"2023-05-17T11:45:36.519826+0000","last_clean":"2023-05-17T11:45:36.519826+0000","last_became_active":"2023-05-17T11:45:35.534906+0000","last_became_peered":"2023-05-17T11:45:35.534906+0000","last_unstale":"2023-05-17T11:45:36.519826+0000","last_undegraded":"2023-05-17T11:45:36.519826+0000","last_fullsized":"2023-05-17T11:45:36.519826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521427+0000","last_change":"2023-05-17T11:45:35.545248+0000","last_active":"2023-05-17T11:45:36.521427+0000","last_peered":"2023-05-17T11:45:36.521427+0000","last_clean":"2023-05-17T11:45:36.521427+0000","last_became_active":"2023-05-17T11:45:35.544970+0000","last_became_peered":"2023-05-17T11:45:35.544970+0000","last_unstale":"2023-05-17T11:45:36.521427+0000","last_undegraded":"2023-05-17T11:45:36.521427+0000","last_fullsized":"2023-05-17T11:45:36.521427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679450+0000","last_change":"2023-05-17T11:45:35.553537+0000","last_active":"2023-05-17T11:45:37.679450+0000","last_peered":"2023-05-17T11:45:37.679450+0000","last_clean":"2023-05-17T11:45:37.679450+0000","last_became_active":"2023-05-17T11:45:35.551558+0000","last_became_peered":"2023-05-17T11:45:35.551558+0000","last_unstale":"2023-05-17T11:45:37.679450+0000","last_undegraded":"2023-05-17T11:45:37.679450+0000","last_fullsized":"2023-05-17T11:45:37.679450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521229+0000","last_change":"2023-05-17T11:45:35.534702+0000","last_active":"2023-05-17T11:45:36.521229+0000","last_peered":"2023-05-17T11:45:36.521229+0000","last_clean":"2023-05-17T11:45:36.521229+0000","last_became_active":"2023-05-17T11:45:35.534447+0000","last_became_peered":"2023-05-17T11:45:35.534447+0000","last_unstale":"2023-05-17T11:45:36.521229+0000","last_undegraded":"2023-05-17T11:45:36.521229+0000","last_fullsized":"2023-05-17T11:45:36.521229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.177990+0000","last_change":"2023-05-17T11:45:35.546069+0000","last_active":"2023-05-17T11:45:37.177990+0000","last_peered":"2023-05-17T11:45:37.177990+0000","last_clean":"2023-05-17T11:45:37.177990+0000","last_became_active":"2023-05-17T11:45:35.545768+0000","last_became_peered":"2023-05-17T11:45:35.545768+0000","last_unstale":"2023-05-17T11:45:37.177990+0000","last_undegraded":"2023-05-17T11:45:37.177990+0000","last_fullsized":"2023-05-17T11:45:37.177990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521500+0000","last_change":"2023-05-17T11:45:35.541053+0000","last_active":"2023-05-17T11:45:36.521500+0000","last_peered":"2023-05-17T11:45:36.521500+0000","last_clean":"2023-05-17T11:45:36.521500+0000","last_became_active":"2023-05-17T11:45:35.540780+0000","last_became_peered":"2023-05-17T11:45:35.540780+0000","last_unstale":"2023-05-17T11:45:36.521500+0000","last_undegraded":"2023-05-17T11:45:36.521500+0000","last_fullsized":"2023-05-17T11:45:36.521500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679690+0000","last_change":"2023-05-17T11:45:35.148198+0000","last_active":"2023-05-17T11:45:37.679690+0000","last_peered":"2023-05-17T11:45:37.679690+0000","last_clean":"2023-05-17T11:45:37.679690+0000","last_became_active":"2023-05-17T11:45:35.147893+0000","last_became_peered":"2023-05-17T11:45:35.147893+0000","last_unstale":"2023-05-17T11:45:37.679690+0000","last_undegraded":"2023-05-17T11:45:37.679690+0000","last_fullsized":"2023-05-17T11:45:37.679690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:07.960059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521783+0000","last_change":"2023-05-17T11:45:35.546006+0000","last_active":"2023-05-17T11:45:36.521783+0000","last_peered":"2023-05-17T11:45:36.521783+0000","last_clean":"2023-05-17T11:45:36.521783+0000","last_became_active":"2023-05-17T11:45:35.545532+0000","last_became_peered":"2023-05-17T11:45:35.545532+0000","last_unstale":"2023-05-17T11:45:36.521783+0000","last_undegraded":"2023-05-17T11:45:36.521783+0000","last_fullsized":"2023-05-17T11:45:36.521783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678314+0000","last_change":"2023-05-17T11:45:35.138861+0000","last_active":"2023-05-17T11:45:37.678314+0000","last_peered":"2023-05-17T11:45:37.678314+0000","last_clean":"2023-05-17T11:45:37.678314+0000","last_became_active":"2023-05-17T11:45:35.138231+0000","last_became_peered":"2023-05-17T11:45:35.138231+0000","last_unstale":"2023-05-17T11:45:37.678314+0000","last_undegraded":"2023-05-17T11:45:37.678314+0000","last_fullsized":"2023-05-17T11:45:37.678314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678607+0000","last_change":"2023-05-17T11:45:35.532498+0000","last_active":"2023-05-17T11:45:37.678607+0000","last_peered":"2023-05-17T11:45:37.678607+0000","last_clean":"2023-05-17T11:45:37.678607+0000","last_became_active":"2023-05-17T11:45:35.532219+0000","last_became_peered":"2023-05-17T11:45:35.532219+0000","last_unstale":"2023-05-17T11:45:37.678607+0000","last_undegraded":"2023-05-17T11:45:37.678607+0000","last_fullsized":"2023-05-17T11:45:37.678607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680219+0000","last_change":"2023-05-17T11:45:35.143472+0000","last_active":"2023-05-17T11:45:37.680219+0000","last_peered":"2023-05-17T11:45:37.680219+0000","last_clean":"2023-05-17T11:45:37.680219+0000","last_became_active":"2023-05-17T11:45:35.142889+0000","last_became_peered":"2023-05-17T11:45:35.142889+0000","last_unstale":"2023-05-17T11:45:37.680219+0000","last_undegraded":"2023-05-17T11:45:37.680219+0000","last_fullsized":"2023-05-17T11:45:37.680219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:36:28.339027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521564+0000","last_change":"2023-05-17T11:45:35.544687+0000","last_active":"2023-05-17T11:45:36.521564+0000","last_peered":"2023-05-17T11:45:36.521564+0000","last_clean":"2023-05-17T11:45:36.521564+0000","last_became_active":"2023-05-17T11:45:35.544357+0000","last_became_peered":"2023-05-17T11:45:35.544357+0000","last_unstale":"2023-05-17T11:45:36.521564+0000","last_undegraded":"2023-05-17T11:45:36.521564+0000","last_fullsized":"2023-05-17T11:45:36.521564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178143+0000","last_change":"2023-05-17T11:45:35.132466+0000","last_active":"2023-05-17T11:45:37.178143+0000","last_peered":"2023-05-17T11:45:37.178143+0000","last_clean":"2023-05-17T11:45:37.178143+0000","last_became_active":"2023-05-17T11:45:35.132140+0000","last_became_peered":"2023-05-17T11:45:35.132140+0000","last_unstale":"2023-05-17T11:45:37.178143+0000","last_undegraded":"2023-05-17T11:45:37.178143+0000","last_fullsized":"2023-05-17T11:45:37.178143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:04.077222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679942+0000","last_change":"2023-05-17T11:45:35.148167+0000","last_active":"2023-05-17T11:45:37.679942+0000","last_peered":"2023-05-17T11:45:37.679942+0000","last_clean":"2023-05-17T11:45:37.679942+0000","last_became_active":"2023-05-17T11:45:35.147381+0000","last_became_peered":"2023-05-17T11:45:35.147381+0000","last_unstale":"2023-05-17T11:45:37.679942+0000","last_undegraded":"2023-05-17T11:45:37.679942+0000","last_fullsized":"2023-05-17T11:45:37.679942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:28:39.219260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521316+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:36.521316+0000","last_peered":"2023-05-17T11:45:36.521316+0000","last_clean":"2023-05-17T11:45:36.521316+0000","last_became_active":"2023-05-17T11:45:35.529813+0000","last_became_peered":"2023-05-17T11:45:35.529813+0000","last_unstale":"2023-05-17T11:45:36.521316+0000","last_undegraded":"2023-05-17T11:45:36.521316+0000","last_fullsized":"2023-05-17T11:45:36.521316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680527+0000","last_change":"2023-05-17T11:45:35.148428+0000","last_active":"2023-05-17T11:45:37.680527+0000","last_peered":"2023-05-17T11:45:37.680527+0000","last_clean":"2023-05-17T11:45:37.680527+0000","last_became_active":"2023-05-17T11:45:35.147509+0000","last_became_peered":"2023-05-17T11:45:35.147509+0000","last_unstale":"2023-05-17T11:45:37.680527+0000","last_undegraded":"2023-05-17T11:45:37.680527+0000","last_fullsized":"2023-05-17T11:45:37.680527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:26:12.080076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679160+0000","last_change":"2023-05-17T11:45:35.541926+0000","last_active":"2023-05-17T11:45:37.679160+0000","last_peered":"2023-05-17T11:45:37.679160+0000","last_clean":"2023-05-17T11:45:37.679160+0000","last_became_active":"2023-05-17T11:45:35.540338+0000","last_became_peered":"2023-05-17T11:45:35.540338+0000","last_unstale":"2023-05-17T11:45:37.679160+0000","last_undegraded":"2023-05-17T11:45:37.679160+0000","last_fullsized":"2023-05-17T11:45:37.679160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679882+0000","last_change":"2023-05-17T11:45:35.140919+0000","last_active":"2023-05-17T11:45:37.679882+0000","last_peered":"2023-05-17T11:45:37.679882+0000","last_clean":"2023-05-17T11:45:37.679882+0000","last_became_active":"2023-05-17T11:45:35.140533+0000","last_became_peered":"2023-05-17T11:45:35.140533+0000","last_unstale":"2023-05-17T11:45:37.679882+0000","last_undegraded":"2023-05-17T11:45:37.679882+0000","last_fullsized":"2023-05-17T11:45:37.679882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:50:49.698249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178078+0000","last_change":"2023-05-17T11:45:35.544834+0000","last_active":"2023-05-17T11:45:37.178078+0000","last_peered":"2023-05-17T11:45:37.178078+0000","last_clean":"2023-05-17T11:45:37.178078+0000","last_became_active":"2023-05-17T11:45:35.544565+0000","last_became_peered":"2023-05-17T11:45:35.544565+0000","last_unstale":"2023-05-17T11:45:37.178078+0000","last_undegraded":"2023-05-17T11:45:37.178078+0000","last_fullsized":"2023-05-17T11:45:37.178078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521886+0000","last_change":"2023-05-17T11:45:35.141712+0000","last_active":"2023-05-17T11:45:36.521886+0000","last_peered":"2023-05-17T11:45:36.521886+0000","last_clean":"2023-05-17T11:45:36.521886+0000","last_became_active":"2023-05-17T11:45:35.141301+0000","last_became_peered":"2023-05-17T11:45:35.141301+0000","last_unstale":"2023-05-17T11:45:36.521886+0000","last_undegraded":"2023-05-17T11:45:36.521886+0000","last_fullsized":"2023-05-17T11:45:36.521886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678561+0000","last_change":"2023-05-17T11:45:35.541253+0000","last_active":"2023-05-17T11:45:37.678561+0000","last_peered":"2023-05-17T11:45:37.678561+0000","last_clean":"2023-05-17T11:45:37.678561+0000","last_became_active":"2023-05-17T11:45:35.540949+0000","last_became_peered":"2023-05-17T11:45:35.540949+0000","last_unstale":"2023-05-17T11:45:37.678561+0000","last_undegraded":"2023-05-17T11:45:37.678561+0000","last_fullsized":"2023-05-17T11:45:37.678561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521633+0000","last_change":"2023-05-17T11:45:35.144268+0000","last_active":"2023-05-17T11:45:36.521633+0000","last_peered":"2023-05-17T11:45:36.521633+0000","last_clean":"2023-05-17T11:45:36.521633+0000","last_became_active":"2023-05-17T11:45:35.143991+0000","last_became_peered":"2023-05-17T11:45:35.143991+0000","last_unstale":"2023-05-17T11:45:36.521633+0000","last_undegraded":"2023-05-17T11:45:36.521633+0000","last_fullsized":"2023-05-17T11:45:36.521633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680219+0000","last_change":"2023-05-17T11:45:35.542321+0000","last_active":"2023-05-17T11:45:37.680219+0000","last_peered":"2023-05-17T11:45:37.680219+0000","last_clean":"2023-05-17T11:45:37.680219+0000","last_became_active":"2023-05-17T11:45:35.539632+0000","last_became_peered":"2023-05-17T11:45:35.539632+0000","last_unstale":"2023-05-17T11:45:37.680219+0000","last_undegraded":"2023-05-17T11:45:37.680219+0000","last_fullsized":"2023-05-17T11:45:37.680219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:08.967305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178234+0000","last_change":"2023-05-17T11:45:35.142904+0000","last_active":"2023-05-17T11:45:37.178234+0000","last_peered":"2023-05-17T11:45:37.178234+0000","last_clean":"2023-05-17T11:45:37.178234+0000","last_became_active":"2023-05-17T11:45:35.142584+0000","last_became_peered":"2023-05-17T11:45:35.142584+0000","last_unstale":"2023-05-17T11:45:37.178234+0000","last_undegraded":"2023-05-17T11:45:37.178234+0000","last_fullsized":"2023-05-17T11:45:37.178234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:53.799577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680254+0000","last_change":"2023-05-17T11:45:35.536915+0000","last_active":"2023-05-17T11:45:37.680254+0000","last_peered":"2023-05-17T11:45:37.680254+0000","last_clean":"2023-05-17T11:45:37.680254+0000","last_became_active":"2023-05-17T11:45:35.536543+0000","last_became_peered":"2023-05-17T11:45:35.536543+0000","last_unstale":"2023-05-17T11:45:37.680254+0000","last_undegraded":"2023-05-17T11:45:37.680254+0000","last_fullsized":"2023-05-17T11:45:37.680254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:50:50.705495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679411+0000","last_change":"2023-05-17T11:45:35.137585+0000","last_active":"2023-05-17T11:45:37.679411+0000","last_peered":"2023-05-17T11:45:37.679411+0000","last_clean":"2023-05-17T11:45:37.679411+0000","last_became_active":"2023-05-17T11:45:35.137054+0000","last_became_peered":"2023-05-17T11:45:35.137054+0000","last_unstale":"2023-05-17T11:45:37.679411+0000","last_undegraded":"2023-05-17T11:45:37.679411+0000","last_fullsized":"2023-05-17T11:45:37.679411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680484+0000","last_change":"2023-05-17T11:45:35.550175+0000","last_active":"2023-05-17T11:45:37.680484+0000","last_peered":"2023-05-17T11:45:37.680484+0000","last_clean":"2023-05-17T11:45:37.680484+0000","last_became_active":"2023-05-17T11:45:35.549881+0000","last_became_peered":"2023-05-17T11:45:35.549881+0000","last_unstale":"2023-05-17T11:45:37.680484+0000","last_undegraded":"2023-05-17T11:45:37.680484+0000","last_fullsized":"2023-05-17T11:45:37.680484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:28:40.226506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521247+0000","last_change":"2023-05-17T11:45:35.144989+0000","last_active":"2023-05-17T11:45:36.521247+0000","last_peered":"2023-05-17T11:45:36.521247+0000","last_clean":"2023-05-17T11:45:36.521247+0000","last_became_active":"2023-05-17T11:45:35.144819+0000","last_became_peered":"2023-05-17T11:45:35.144819+0000","last_unstale":"2023-05-17T11:45:36.521247+0000","last_undegraded":"2023-05-17T11:45:36.521247+0000","last_fullsized":"2023-05-17T11:45:36.521247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:03.684194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519767+0000","last_change":"2023-05-17T11:45:35.537836+0000","last_active":"2023-05-17T11:45:36.519767+0000","last_peered":"2023-05-17T11:45:36.519767+0000","last_clean":"2023-05-17T11:45:36.519767+0000","last_became_active":"2023-05-17T11:45:35.536405+0000","last_became_peered":"2023-05-17T11:45:35.536405+0000","last_unstale":"2023-05-17T11:45:36.519767+0000","last_undegraded":"2023-05-17T11:45:36.519767+0000","last_fullsized":"2023-05-17T11:45:36.519767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679876+0000","last_change":"2023-05-17T11:45:23.894807+0000","last_active":"2023-05-17T11:45:37.679876+0000","last_peered":"2023-05-17T11:45:37.679876+0000","last_clean":"2023-05-17T11:45:37.679876+0000","last_became_active":"2023-05-17T11:45:23.894516+0000","last_became_peered":"2023-05-17T11:45:23.894516+0000","last_unstale":"2023-05-17T11:45:37.679876+0000","last_undegraded":"2023-05-17T11:45:37.679876+0000","last_fullsized":"2023-05-17T11:45:37.679876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_clean_scrub_stamp":"2023-05-17T11:45:22.596969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:51:52.439084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521380+0000","last_change":"2023-05-17T11:45:30.089866+0000","last_active":"2023-05-17T11:45:36.521380+0000","last_peered":"2023-05-17T11:45:36.521380+0000","last_clean":"2023-05-17T11:45:36.521380+0000","last_became_active":"2023-05-17T11:45:30.089207+0000","last_became_peered":"2023-05-17T11:45:30.089207+0000","last_unstale":"2023-05-17T11:45:36.521380+0000","last_undegraded":"2023-05-17T11:45:36.521380+0000","last_fullsized":"2023-05-17T11:45:36.521380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:27.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521342+0000","last_change":"2023-05-17T11:45:35.140973+0000","last_active":"2023-05-17T11:45:36.521342+0000","last_peered":"2023-05-17T11:45:36.521342+0000","last_clean":"2023-05-17T11:45:36.521342+0000","last_became_active":"2023-05-17T11:45:35.140590+0000","last_became_peered":"2023-05-17T11:45:35.140590+0000","last_unstale":"2023-05-17T11:45:36.521342+0000","last_undegraded":"2023-05-17T11:45:36.521342+0000","last_fullsized":"2023-05-17T11:45:36.521342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:32.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178394+0000","last_change":"2023-05-17T11:45:35.552628+0000","last_active":"2023-05-17T11:45:37.178394+0000","last_peered":"2023-05-17T11:45:37.178394+0000","last_clean":"2023-05-17T11:45:37.178394+0000","last_became_active":"2023-05-17T11:45:35.552298+0000","last_became_peered":"2023-05-17T11:45:35.552298+0000","last_unstale":"2023-05-17T11:45:37.178394+0000","last_undegraded":"2023-05-17T11:45:37.178394+0000","last_fullsized":"2023-05-17T11:45:37.178394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679588+0000","last_change":"2023-05-17T11:45:30.093107+0000","last_active":"2023-05-17T11:45:37.679588+0000","last_peered":"2023-05-17T11:45:37.679588+0000","last_clean":"2023-05-17T11:45:37.679588+0000","last_became_active":"2023-05-17T11:45:30.092684+0000","last_became_peered":"2023-05-17T11:45:30.092684+0000","last_unstale":"2023-05-17T11:45:37.679588+0000","last_undegraded":"2023-05-17T11:45:37.679588+0000","last_fullsized":"2023-05-17T11:45:37.679588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:37.071002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678112+0000","last_change":"2023-05-17T11:45:35.135037+0000","last_active":"2023-05-17T11:45:37.678112+0000","last_peered":"2023-05-17T11:45:37.678112+0000","last_clean":"2023-05-17T11:45:37.678112+0000","last_became_active":"2023-05-17T11:45:35.134656+0000","last_became_peered":"2023-05-17T11:45:35.134656+0000","last_unstale":"2023-05-17T11:45:37.678112+0000","last_undegraded":"2023-05-17T11:45:37.678112+0000","last_fullsized":"2023-05-17T11:45:37.678112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:18.795908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678574+0000","last_change":"2023-05-17T11:45:35.541264+0000","last_active":"2023-05-17T11:45:37.678574+0000","last_peered":"2023-05-17T11:45:37.678574+0000","last_clean":"2023-05-17T11:45:37.678574+0000","last_became_active":"2023-05-17T11:45:35.541014+0000","last_became_peered":"2023-05-17T11:45:35.541014+0000","last_unstale":"2023-05-17T11:45:37.678574+0000","last_undegraded":"2023-05-17T11:45:37.678574+0000","last_fullsized":"2023-05-17T11:45:37.678574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678001+0000","last_change":"2023-05-17T11:45:30.096072+0000","last_active":"2023-05-17T11:45:37.678001+0000","last_peered":"2023-05-17T11:45:37.678001+0000","last_clean":"2023-05-17T11:45:37.678001+0000","last_became_active":"2023-05-17T11:45:30.095647+0000","last_became_peered":"2023-05-17T11:45:30.095647+0000","last_unstale":"2023-05-17T11:45:37.678001+0000","last_undegraded":"2023-05-17T11:45:37.678001+0000","last_fullsized":"2023-05-17T11:45:37.678001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:22.142981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519445+0000","last_change":"2023-05-17T11:45:35.129591+0000","last_active":"2023-05-17T11:45:36.519445+0000","last_peered":"2023-05-17T11:45:36.519445+0000","last_clean":"2023-05-17T11:45:36.519445+0000","last_became_active":"2023-05-17T11:45:35.129301+0000","last_became_peered":"2023-05-17T11:45:35.129301+0000","last_unstale":"2023-05-17T11:45:36.519445+0000","last_undegraded":"2023-05-17T11:45:36.519445+0000","last_fullsized":"2023-05-17T11:45:36.519445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:18.795908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520150+0000","last_change":"2023-05-17T11:45:35.534133+0000","last_active":"2023-05-17T11:45:36.520150+0000","last_peered":"2023-05-17T11:45:36.520150+0000","last_clean":"2023-05-17T11:45:36.520150+0000","last_became_active":"2023-05-17T11:45:35.533661+0000","last_became_peered":"2023-05-17T11:45:35.533661+0000","last_unstale":"2023-05-17T11:45:36.520150+0000","last_undegraded":"2023-05-17T11:45:36.520150+0000","last_fullsized":"2023-05-17T11:45:36.520150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521322+0000","last_change":"2023-05-17T11:45:30.084716+0000","last_active":"2023-05-17T11:45:36.521322+0000","last_peered":"2023-05-17T11:45:36.521322+0000","last_clean":"2023-05-17T11:45:36.521322+0000","last_became_active":"2023-05-17T11:45:30.084340+0000","last_became_peered":"2023-05-17T11:45:30.084340+0000","last_unstale":"2023-05-17T11:45:36.521322+0000","last_undegraded":"2023-05-17T11:45:36.521322+0000","last_fullsized":"2023-05-17T11:45:36.521322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:35:58.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679774+0000","last_change":"2023-05-17T11:45:35.142948+0000","last_active":"2023-05-17T11:45:37.679774+0000","last_peered":"2023-05-17T11:45:37.679774+0000","last_clean":"2023-05-17T11:45:37.679774+0000","last_became_active":"2023-05-17T11:45:35.142653+0000","last_became_peered":"2023-05-17T11:45:35.142653+0000","last_unstale":"2023-05-17T11:45:37.679774+0000","last_undegraded":"2023-05-17T11:45:37.679774+0000","last_fullsized":"2023-05-17T11:45:37.679774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519660+0000","last_change":"2023-05-17T11:45:35.534568+0000","last_active":"2023-05-17T11:45:36.519660+0000","last_peered":"2023-05-17T11:45:36.519660+0000","last_clean":"2023-05-17T11:45:36.519660+0000","last_became_active":"2023-05-17T11:45:35.534170+0000","last_became_peered":"2023-05-17T11:45:35.534170+0000","last_unstale":"2023-05-17T11:45:36.519660+0000","last_undegraded":"2023-05-17T11:45:36.519660+0000","last_fullsized":"2023-05-17T11:45:36.519660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521950+0000","last_change":"2023-05-17T11:45:35.146757+0000","last_active":"2023-05-17T11:45:36.521950+0000","last_peered":"2023-05-17T11:45:36.521950+0000","last_clean":"2023-05-17T11:45:36.521950+0000","last_became_active":"2023-05-17T11:45:35.146469+0000","last_became_peered":"2023-05-17T11:45:35.146469+0000","last_unstale":"2023-05-17T11:45:36.521950+0000","last_undegraded":"2023-05-17T11:45:36.521950+0000","last_fullsized":"2023-05-17T11:45:36.521950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:07.960059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519815+0000","last_change":"2023-05-17T11:45:30.647020+0000","last_active":"2023-05-17T11:45:36.519815+0000","last_peered":"2023-05-17T11:45:36.519815+0000","last_clean":"2023-05-17T11:45:36.519815+0000","last_became_active":"2023-05-17T11:45:30.646621+0000","last_became_peered":"2023-05-17T11:45:30.646621+0000","last_unstale":"2023-05-17T11:45:36.519815+0000","last_undegraded":"2023-05-17T11:45:36.519815+0000","last_fullsized":"2023-05-17T11:45:36.519815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:43.929512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519875+0000","last_change":"2023-05-17T11:45:35.534583+0000","last_active":"2023-05-17T11:45:36.519875+0000","last_peered":"2023-05-17T11:45:36.519875+0000","last_clean":"2023-05-17T11:45:36.519875+0000","last_became_active":"2023-05-17T11:45:35.533116+0000","last_became_peered":"2023-05-17T11:45:35.533116+0000","last_unstale":"2023-05-17T11:45:36.519875+0000","last_undegraded":"2023-05-17T11:45:36.519875+0000","last_fullsized":"2023-05-17T11:45:36.519875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519724+0000","last_change":"2023-05-17T11:45:35.129695+0000","last_active":"2023-05-17T11:45:36.519724+0000","last_peered":"2023-05-17T11:45:36.519724+0000","last_clean":"2023-05-17T11:45:36.519724+0000","last_became_active":"2023-05-17T11:45:35.129376+0000","last_became_peered":"2023-05-17T11:45:35.129376+0000","last_unstale":"2023-05-17T11:45:36.519724+0000","last_undegraded":"2023-05-17T11:45:36.519724+0000","last_fullsized":"2023-05-17T11:45:36.519724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680054+0000","last_change":"2023-05-17T11:45:30.647758+0000","last_active":"2023-05-17T11:45:37.680054+0000","last_peered":"2023-05-17T11:45:37.680054+0000","last_clean":"2023-05-17T11:45:37.680054+0000","last_became_active":"2023-05-17T11:45:30.647423+0000","last_became_peered":"2023-05-17T11:45:30.647423+0000","last_unstale":"2023-05-17T11:45:37.680054+0000","last_undegraded":"2023-05-17T11:45:37.680054+0000","last_fullsized":"2023-05-17T11:45:37.680054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:30:37.070489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678700+0000","last_change":"2023-05-17T11:45:35.536548+0000","last_active":"2023-05-17T11:45:37.678700+0000","last_peered":"2023-05-17T11:45:37.678700+0000","last_clean":"2023-05-17T11:45:37.678700+0000","last_became_active":"2023-05-17T11:45:35.535873+0000","last_became_peered":"2023-05-17T11:45:35.535873+0000","last_unstale":"2023-05-17T11:45:37.678700+0000","last_undegraded":"2023-05-17T11:45:37.678700+0000","last_fullsized":"2023-05-17T11:45:37.678700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:41.116640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521680+0000","last_change":"2023-05-17T11:45:35.144973+0000","last_active":"2023-05-17T11:45:36.521680+0000","last_peered":"2023-05-17T11:45:36.521680+0000","last_clean":"2023-05-17T11:45:36.521680+0000","last_became_active":"2023-05-17T11:45:35.144558+0000","last_became_peered":"2023-05-17T11:45:35.144558+0000","last_unstale":"2023-05-17T11:45:36.521680+0000","last_undegraded":"2023-05-17T11:45:36.521680+0000","last_fullsized":"2023-05-17T11:45:36.521680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520015+0000","last_change":"2023-05-17T11:45:30.087244+0000","last_active":"2023-05-17T11:45:36.520015+0000","last_peered":"2023-05-17T11:45:36.520015+0000","last_clean":"2023-05-17T11:45:36.520015+0000","last_became_active":"2023-05-17T11:45:30.086890+0000","last_became_peered":"2023-05-17T11:45:30.086890+0000","last_unstale":"2023-05-17T11:45:36.520015+0000","last_undegraded":"2023-05-17T11:45:36.520015+0000","last_fullsized":"2023-05-17T11:45:36.520015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:35.074387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521122+0000","last_change":"2023-05-17T11:45:35.534336+0000","last_active":"2023-05-17T11:45:36.521122+0000","last_peered":"2023-05-17T11:45:36.521122+0000","last_clean":"2023-05-17T11:45:36.521122+0000","last_became_active":"2023-05-17T11:45:35.533768+0000","last_became_peered":"2023-05-17T11:45:35.533768+0000","last_unstale":"2023-05-17T11:45:36.521122+0000","last_undegraded":"2023-05-17T11:45:36.521122+0000","last_fullsized":"2023-05-17T11:45:36.521122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678722+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:37.678722+0000","last_peered":"2023-05-17T11:45:37.678722+0000","last_clean":"2023-05-17T11:45:37.678722+0000","last_became_active":"2023-05-17T11:45:35.138278+0000","last_became_peered":"2023-05-17T11:45:35.138278+0000","last_unstale":"2023-05-17T11:45:37.678722+0000","last_undegraded":"2023-05-17T11:45:37.678722+0000","last_fullsized":"2023-05-17T11:45:37.678722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:03.983943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178430+0000","last_change":"2023-05-17T11:45:30.088456+0000","last_active":"2023-05-17T11:45:37.178430+0000","last_peered":"2023-05-17T11:45:37.178430+0000","last_clean":"2023-05-17T11:45:37.178430+0000","last_became_active":"2023-05-17T11:45:30.088082+0000","last_became_peered":"2023-05-17T11:45:30.088082+0000","last_unstale":"2023-05-17T11:45:37.178430+0000","last_undegraded":"2023-05-17T11:45:37.178430+0000","last_fullsized":"2023-05-17T11:45:37.178430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:22.386463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679259+0000","last_change":"2023-05-17T11:45:35.538184+0000","last_active":"2023-05-17T11:45:37.679259+0000","last_peered":"2023-05-17T11:45:37.679259+0000","last_clean":"2023-05-17T11:45:37.679259+0000","last_became_active":"2023-05-17T11:45:35.537967+0000","last_became_peered":"2023-05-17T11:45:35.537967+0000","last_unstale":"2023-05-17T11:45:37.679259+0000","last_undegraded":"2023-05-17T11:45:37.679259+0000","last_fullsized":"2023-05-17T11:45:37.679259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679637+0000","last_change":"2023-05-17T11:45:35.551187+0000","last_active":"2023-05-17T11:45:37.679637+0000","last_peered":"2023-05-17T11:45:37.679637+0000","last_clean":"2023-05-17T11:45:37.679637+0000","last_became_active":"2023-05-17T11:45:35.550919+0000","last_became_peered":"2023-05-17T11:45:35.550919+0000","last_unstale":"2023-05-17T11:45:37.679637+0000","last_undegraded":"2023-05-17T11:45:37.679637+0000","last_fullsized":"2023-05-17T11:45:37.679637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:41.116640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680397+0000","last_change":"2023-05-17T11:45:35.143591+0000","last_active":"2023-05-17T11:45:37.680397+0000","last_peered":"2023-05-17T11:45:37.680397+0000","last_clean":"2023-05-17T11:45:37.680397+0000","last_became_active":"2023-05-17T11:45:35.143258+0000","last_became_peered":"2023-05-17T11:45:35.143258+0000","last_unstale":"2023-05-17T11:45:37.680397+0000","last_undegraded":"2023-05-17T11:45:37.680397+0000","last_fullsized":"2023-05-17T11:45:37.680397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:27.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519735+0000","last_change":"2023-05-17T11:45:35.546190+0000","last_active":"2023-05-17T11:45:36.519735+0000","last_peered":"2023-05-17T11:45:36.519735+0000","last_clean":"2023-05-17T11:45:36.519735+0000","last_became_active":"2023-05-17T11:45:35.545718+0000","last_became_peered":"2023-05-17T11:45:35.545718+0000","last_unstale":"2023-05-17T11:45:36.519735+0000","last_undegraded":"2023-05-17T11:45:36.519735+0000","last_fullsized":"2023-05-17T11:45:36.519735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679769+0000","last_change":"2023-05-17T11:45:35.146268+0000","last_active":"2023-05-17T11:45:37.679769+0000","last_peered":"2023-05-17T11:45:37.679769+0000","last_clean":"2023-05-17T11:45:37.679769+0000","last_became_active":"2023-05-17T11:45:35.145917+0000","last_became_peered":"2023-05-17T11:45:35.145917+0000","last_unstale":"2023-05-17T11:45:37.679769+0000","last_undegraded":"2023-05-17T11:45:37.679769+0000","last_fullsized":"2023-05-17T11:45:37.679769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:33.204162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521793+0000","last_change":"2023-05-17T11:45:35.138653+0000","last_active":"2023-05-17T11:45:36.521793+0000","last_peered":"2023-05-17T11:45:36.521793+0000","last_clean":"2023-05-17T11:45:36.521793+0000","last_became_active":"2023-05-17T11:45:35.138291+0000","last_became_peered":"2023-05-17T11:45:35.138291+0000","last_unstale":"2023-05-17T11:45:36.521793+0000","last_undegraded":"2023-05-17T11:45:36.521793+0000","last_fullsized":"2023-05-17T11:45:36.521793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521323+0000","last_change":"2023-05-17T11:45:35.535628+0000","last_active":"2023-05-17T11:45:36.521323+0000","last_peered":"2023-05-17T11:45:36.521323+0000","last_clean":"2023-05-17T11:45:36.521323+0000","last_became_active":"2023-05-17T11:45:35.535341+0000","last_became_peered":"2023-05-17T11:45:35.535341+0000","last_unstale":"2023-05-17T11:45:36.521323+0000","last_undegraded":"2023-05-17T11:45:36.521323+0000","last_fullsized":"2023-05-17T11:45:36.521323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678724+0000","last_change":"2023-05-17T11:45:35.138119+0000","last_active":"2023-05-17T11:45:37.678724+0000","last_peered":"2023-05-17T11:45:37.678724+0000","last_clean":"2023-05-17T11:45:37.678724+0000","last_became_active":"2023-05-17T11:45:35.137723+0000","last_became_peered":"2023-05-17T11:45:35.137723+0000","last_unstale":"2023-05-17T11:45:37.678724+0000","last_undegraded":"2023-05-17T11:45:37.678724+0000","last_fullsized":"2023-05-17T11:45:37.678724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521068+0000","last_change":"2023-05-17T11:45:35.535751+0000","last_active":"2023-05-17T11:45:36.521068+0000","last_peered":"2023-05-17T11:45:36.521068+0000","last_clean":"2023-05-17T11:45:36.521068+0000","last_became_active":"2023-05-17T11:45:35.535474+0000","last_became_peered":"2023-05-17T11:45:35.535474+0000","last_unstale":"2023-05-17T11:45:36.521068+0000","last_undegraded":"2023-05-17T11:45:36.521068+0000","last_fullsized":"2023-05-17T11:45:36.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:15:20.505190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178382+0000","last_change":"2023-05-17T11:45:35.546921+0000","last_active":"2023-05-17T11:45:37.178382+0000","last_peered":"2023-05-17T11:45:37.178382+0000","last_clean":"2023-05-17T11:45:37.178382+0000","last_became_active":"2023-05-17T11:45:35.546572+0000","last_became_peered":"2023-05-17T11:45:35.546572+0000","last_unstale":"2023-05-17T11:45:37.178382+0000","last_undegraded":"2023-05-17T11:45:37.178382+0000","last_fullsized":"2023-05-17T11:45:37.178382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:20.724175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521192+0000","last_change":"2023-05-17T11:45:35.141081+0000","last_active":"2023-05-17T11:45:36.521192+0000","last_peered":"2023-05-17T11:45:36.521192+0000","last_clean":"2023-05-17T11:45:36.521192+0000","last_became_active":"2023-05-17T11:45:35.140623+0000","last_became_peered":"2023-05-17T11:45:35.140623+0000","last_unstale":"2023-05-17T11:45:36.521192+0000","last_undegraded":"2023-05-17T11:45:36.521192+0000","last_fullsized":"2023-05-17T11:45:36.521192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:49.363470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678524+0000","last_change":"2023-05-17T11:45:35.534028+0000","last_active":"2023-05-17T11:45:37.678524+0000","last_peered":"2023-05-17T11:45:37.678524+0000","last_clean":"2023-05-17T11:45:37.678524+0000","last_became_active":"2023-05-17T11:45:35.533692+0000","last_became_peered":"2023-05-17T11:45:35.533692+0000","last_unstale":"2023-05-17T11:45:37.678524+0000","last_undegraded":"2023-05-17T11:45:37.678524+0000","last_fullsized":"2023-05-17T11:45:37.678524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519734+0000","last_change":"2023-05-17T11:45:35.146893+0000","last_active":"2023-05-17T11:45:36.519734+0000","last_peered":"2023-05-17T11:45:36.519734+0000","last_clean":"2023-05-17T11:45:36.519734+0000","last_became_active":"2023-05-17T11:45:35.146547+0000","last_became_peered":"2023-05-17T11:45:35.146547+0000","last_unstale":"2023-05-17T11:45:36.519734+0000","last_undegraded":"2023-05-17T11:45:36.519734+0000","last_fullsized":"2023-05-17T11:45:36.519734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:29.545146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521823+0000","last_change":"2023-05-17T11:45:35.534371+0000","last_active":"2023-05-17T11:45:36.521823+0000","last_peered":"2023-05-17T11:45:36.521823+0000","last_clean":"2023-05-17T11:45:36.521823+0000","last_became_active":"2023-05-17T11:45:35.534091+0000","last_became_peered":"2023-05-17T11:45:35.534091+0000","last_unstale":"2023-05-17T11:45:36.521823+0000","last_undegraded":"2023-05-17T11:45:36.521823+0000","last_fullsized":"2023-05-17T11:45:36.521823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679490+0000","last_change":"2023-05-17T11:45:35.139454+0000","last_active":"2023-05-17T11:45:37.679490+0000","last_peered":"2023-05-17T11:45:37.679490+0000","last_clean":"2023-05-17T11:45:37.679490+0000","last_became_active":"2023-05-17T11:45:35.138750+0000","last_became_peered":"2023-05-17T11:45:35.138750+0000","last_unstale":"2023-05-17T11:45:37.679490+0000","last_undegraded":"2023-05-17T11:45:37.679490+0000","last_fullsized":"2023-05-17T11:45:37.679490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:03.983943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678086+0000","last_change":"2023-05-17T11:45:35.539372+0000","last_active":"2023-05-17T11:45:37.678086+0000","last_peered":"2023-05-17T11:45:37.678086+0000","last_clean":"2023-05-17T11:45:37.678086+0000","last_became_active":"2023-05-17T11:45:35.539059+0000","last_became_peered":"2023-05-17T11:45:35.539059+0000","last_unstale":"2023-05-17T11:45:37.678086+0000","last_undegraded":"2023-05-17T11:45:37.678086+0000","last_fullsized":"2023-05-17T11:45:37.678086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678839+0000","last_change":"2023-05-17T11:45:35.135013+0000","last_active":"2023-05-17T11:45:37.678839+0000","last_peered":"2023-05-17T11:45:37.678839+0000","last_clean":"2023-05-17T11:45:37.678839+0000","last_became_active":"2023-05-17T11:45:35.134702+0000","last_became_peered":"2023-05-17T11:45:35.134702+0000","last_unstale":"2023-05-17T11:45:37.678839+0000","last_undegraded":"2023-05-17T11:45:37.678839+0000","last_fullsized":"2023-05-17T11:45:37.678839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679431+0000","last_change":"2023-05-17T11:45:35.544396+0000","last_active":"2023-05-17T11:45:37.679431+0000","last_peered":"2023-05-17T11:45:37.679431+0000","last_clean":"2023-05-17T11:45:37.679431+0000","last_became_active":"2023-05-17T11:45:35.544113+0000","last_became_peered":"2023-05-17T11:45:35.544113+0000","last_unstale":"2023-05-17T11:45:37.679431+0000","last_undegraded":"2023-05-17T11:45:37.679431+0000","last_fullsized":"2023-05-17T11:45:37.679431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521540+0000","last_change":"2023-05-17T11:45:35.145692+0000","last_active":"2023-05-17T11:45:36.521540+0000","last_peered":"2023-05-17T11:45:36.521540+0000","last_clean":"2023-05-17T11:45:36.521540+0000","last_became_active":"2023-05-17T11:45:35.145352+0000","last_became_peered":"2023-05-17T11:45:35.145352+0000","last_unstale":"2023-05-17T11:45:36.521540+0000","last_undegraded":"2023-05-17T11:45:36.521540+0000","last_fullsized":"2023-05-17T11:45:36.521540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679328+0000","last_change":"2023-05-17T11:45:35.527750+0000","last_active":"2023-05-17T11:45:37.679328+0000","last_peered":"2023-05-17T11:45:37.679328+0000","last_clean":"2023-05-17T11:45:37.679328+0000","last_became_active":"2023-05-17T11:45:35.527428+0000","last_became_peered":"2023-05-17T11:45:35.527428+0000","last_unstale":"2023-05-17T11:45:37.679328+0000","last_undegraded":"2023-05-17T11:45:37.679328+0000","last_fullsized":"2023-05-17T11:45:37.679328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521918+0000","last_change":"2023-05-17T11:45:35.143811+0000","last_active":"2023-05-17T11:45:36.521918+0000","last_peered":"2023-05-17T11:45:36.521918+0000","last_clean":"2023-05-17T11:45:36.521918+0000","last_became_active":"2023-05-17T11:45:35.142921+0000","last_became_peered":"2023-05-17T11:45:35.142921+0000","last_unstale":"2023-05-17T11:45:36.521918+0000","last_undegraded":"2023-05-17T11:45:36.521918+0000","last_fullsized":"2023-05-17T11:45:36.521918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:24.352254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521461+0000","last_change":"2023-05-17T11:45:35.532708+0000","last_active":"2023-05-17T11:45:36.521461+0000","last_peered":"2023-05-17T11:45:36.521461+0000","last_clean":"2023-05-17T11:45:36.521461+0000","last_became_active":"2023-05-17T11:45:35.532426+0000","last_became_peered":"2023-05-17T11:45:35.532426+0000","last_unstale":"2023-05-17T11:45:36.521461+0000","last_undegraded":"2023-05-17T11:45:36.521461+0000","last_fullsized":"2023-05-17T11:45:36.521461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521732+0000","last_change":"2023-05-17T11:45:35.140853+0000","last_active":"2023-05-17T11:45:36.521732+0000","last_peered":"2023-05-17T11:45:36.521732+0000","last_clean":"2023-05-17T11:45:36.521732+0000","last_became_active":"2023-05-17T11:45:35.140321+0000","last_became_peered":"2023-05-17T11:45:35.140321+0000","last_unstale":"2023-05-17T11:45:36.521732+0000","last_undegraded":"2023-05-17T11:45:36.521732+0000","last_fullsized":"2023-05-17T11:45:36.521732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679144+0000","last_change":"2023-05-17T11:45:35.551649+0000","last_active":"2023-05-17T11:45:37.679144+0000","last_peered":"2023-05-17T11:45:37.679144+0000","last_clean":"2023-05-17T11:45:37.679144+0000","last_became_active":"2023-05-17T11:45:35.551298+0000","last_became_peered":"2023-05-17T11:45:35.551298+0000","last_unstale":"2023-05-17T11:45:37.679144+0000","last_undegraded":"2023-05-17T11:45:37.679144+0000","last_fullsized":"2023-05-17T11:45:37.679144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678588+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:37.678588+0000","last_peered":"2023-05-17T11:45:37.678588+0000","last_clean":"2023-05-17T11:45:37.678588+0000","last_became_active":"2023-05-17T11:45:35.138958+0000","last_became_peered":"2023-05-17T11:45:35.138958+0000","last_unstale":"2023-05-17T11:45:37.678588+0000","last_undegraded":"2023-05-17T11:45:37.678588+0000","last_fullsized":"2023-05-17T11:45:37.678588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:48.964519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13204,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358636,"statfs":{"total":96636764160,"available":96623243264,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7519999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12084,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359756,"statfs":{"total":96636764160,"available":96624390144,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12092,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359748,"statfs":{"total":96636764160,"available":96624381952,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12168,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359672,"statfs":{"total":96636764160,"available":96624304128,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T11:45:44.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T11:45:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 Processor -- start 2023-05-17T11:45:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 -- start start 2023-05-17T11:45:44.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f340b1d30 0x7f2f3406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f340d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3406b3c0 con 0x7f2f340d0870 2023-05-17T11:45:44.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340b2100 con 0x7f2f340b1d30 2023-05-17T11:45:44.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f390c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340d0cb0 con 0x7f2f340cf190 2023-05-17T11:45:44.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f33fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f340b1d30 0x7f2f3406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f388c2640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2f340d0870 0x7f2f340b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46896/0 (socket says 172.21.15.3:46896) 2023-05-17T11:45:44.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f388c2640 1 -- 172.21.15.3:0/1088176337 learned_addr learned my addr 172.21.15.3:0/1088176337 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f337fe640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f340d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f33fff640 1 -- 172.21.15.3:0/1088176337 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 msgr2=0x7f2f340d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f33fff640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f340d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f33fff640 1 -- 172.21.15.3:0/1088176337 >> v1:172.21.15.3:6789/0 conn(0x7f2f340d0870 legacy=0x7f2f340b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f32ffd640 1 -- 172.21.15.3:0/1088176337 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364640234 0 0) 0x7f2f3406b3c0 con 0x7f2f340d0870 2023-05-17T11:45:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f33fff640 1 -- 172.21.15.3:0/1088176337 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3406b5f0 con 0x7f2f340b1d30 2023-05-17T11:45:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.403+0000 7f2f337fe640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f340d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f33fff640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f3406ae80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f240097c0 tx=0x7f2f2401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155aaa6e116be55a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f32ffd640 1 -- 172.21.15.3:0/1088176337 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240a8970 con 0x7f2f340b1d30 2023-05-17T11:45:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f32ffd640 1 -- 172.21.15.3:0/1088176337 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240a8ad0 con 0x7f2f340b1d30 2023-05-17T11:45:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f32ffd640 1 -- 172.21.15.3:0/1088176337 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240a8e60 con 0x7f2f340b1d30 2023-05-17T11:45:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 -- 172.21.15.3:0/1088176337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 msgr2=0x7f2f3406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f3406ae80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f240097c0 tx=0x7f2f2401ec70 comp rx=0 tx=0).stop 2023-05-17T11:45:44.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 -- 172.21.15.3:0/1088176337 shutdown_connections 2023-05-17T11:45:44.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f340d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 --2- 172.21.15.3:0/1088176337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f3406ae80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 -- 172.21.15.3:0/1088176337 >> 172.21.15.3:0/1088176337 conn(0x7f2f34071b00 msgr2=0x7f2f3409bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:44.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 -- 172.21.15.3:0/1088176337 shutdown_connections 2023-05-17T11:45:44.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 -- 172.21.15.3:0/1088176337 wait complete. 2023-05-17T11:45:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.407+0000 7f2f390c3640 1 Processor -- start 2023-05-17T11:45:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- start start 2023-05-17T11:45:44.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f341f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f34158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f340d0870 0x7f2f341590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c90c0 con 0x7f2f340b1d30 2023-05-17T11:45:44.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c8540 con 0x7f2f340d0870 2023-05-17T11:45:44.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c8820 con 0x7f2f340cf190 2023-05-17T11:45:44.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f341f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f341f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51966/0 (socket says 172.21.15.3:51966) 2023-05-17T11:45:44.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 -- 172.21.15.3:0/456738459 learned_addr learned my addr 172.21.15.3:0/456738459 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f337fe640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f34158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f388c2640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f340d0870 0x7f2f341590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 -- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 msgr2=0x7f2f34158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f34158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 -- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f340d0870 msgr2=0x7f2f341590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f340d0870 0x7f2f341590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 -- 172.21.15.3:0/456738459 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24009420 con 0x7f2f340b1d30 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f33fff640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f341f50a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f240b3040 tx=0x7f2f2401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240b9630 con 0x7f2f340b1d30 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240b97b0 con 0x7f2f340b1d30 2023-05-17T11:45:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240b9b60 con 0x7f2f340b1d30 2023-05-17T11:45:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3406bbb0 con 0x7f2f340b1d30 2023-05-17T11:45:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3406b8d0 con 0x7f2f340b1d30 2023-05-17T11:45:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.411+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340cce50 con 0x7f2f340b1d30 2023-05-17T11:45:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.415+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f240b7040 con 0x7f2f340b1d30 2023-05-17T11:45:44.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.415+0000 7f2f30ff9640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f20066280 0x7f2f20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.415+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f24121db0 con 0x7f2f340b1d30 2023-05-17T11:45:44.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.415+0000 7f2f337fe640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f20066280 0x7f2f20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.415+0000 7f2f337fe640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f20066280 0x7f2f20068730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f340cb710 tx=0x7f2f28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.419+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2f24126070 con 0x7f2f340b1d30 2023-05-17T11:45:44.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.571+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 --> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f34067130 con 0x7f2f20066280 2023-05-17T11:45:44.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.579+0000 7f2f30ff9640 1 -- 172.21.15.3:0/456738459 <== mgr.4110 v2:172.21.15.3:6832/2126677587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286571 (secure 0 0 0) 0x7f2f34067130 con 0x7f2f20066280 2023-05-17T11:45:44.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:44.592 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-05-17T11:45:44.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f20066280 msgr2=0x7f2f20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f20066280 0x7f2f20068730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f340cb710 tx=0x7f2f28008040 comp rx=0 tx=0).stop 2023-05-17T11:45:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 msgr2=0x7f2f341f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f341f50a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f240b3040 tx=0x7f2f2401ba10 comp rx=0 tx=0).stop 2023-05-17T11:45:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 shutdown_connections 2023-05-17T11:45:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f20066280 0x7f2f20068730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f340d0870 0x7f2f341590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f340cf190 0x7f2f34158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 --2- 172.21.15.3:0/456738459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f340b1d30 0x7f2f341f50a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 >> 172.21.15.3:0/456738459 conn(0x7f2f34071b00 msgr2=0x7f2f340b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 shutdown_connections 2023-05-17T11:45:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.583+0000 7f2f390c3640 1 -- 172.21.15.3:0/456738459 wait complete. 2023-05-17T11:45:44.611 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-05-17T11:45:44.528769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82600,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":754892120,"statfs":{"total":773094113280,"available":773009530880,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.016262"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678059+0000","last_change":"2023-05-17T11:45:35.531488+0000","last_active":"2023-05-17T11:45:37.678059+0000","last_peered":"2023-05-17T11:45:37.678059+0000","last_clean":"2023-05-17T11:45:37.678059+0000","last_became_active":"2023-05-17T11:45:35.531185+0000","last_became_peered":"2023-05-17T11:45:35.531185+0000","last_unstale":"2023-05-17T11:45:37.678059+0000","last_undegraded":"2023-05-17T11:45:37.678059+0000","last_fullsized":"2023-05-17T11:45:37.678059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:05.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521624+0000","last_change":"2023-05-17T11:45:35.539055+0000","last_active":"2023-05-17T11:45:36.521624+0000","last_peered":"2023-05-17T11:45:36.521624+0000","last_clean":"2023-05-17T11:45:36.521624+0000","last_became_active":"2023-05-17T11:45:35.538706+0000","last_became_peered":"2023-05-17T11:45:35.538706+0000","last_unstale":"2023-05-17T11:45:36.521624+0000","last_undegraded":"2023-05-17T11:45:36.521624+0000","last_fullsized":"2023-05-17T11:45:36.521624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680035+0000","last_change":"2023-05-17T11:45:35.543264+0000","last_active":"2023-05-17T11:45:37.680035+0000","last_peered":"2023-05-17T11:45:37.680035+0000","last_clean":"2023-05-17T11:45:37.680035+0000","last_became_active":"2023-05-17T11:45:35.542323+0000","last_became_peered":"2023-05-17T11:45:35.542323+0000","last_unstale":"2023-05-17T11:45:37.680035+0000","last_undegraded":"2023-05-17T11:45:37.680035+0000","last_fullsized":"2023-05-17T11:45:37.680035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:43.113254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178187+0000","last_change":"2023-05-17T11:45:35.547666+0000","last_active":"2023-05-17T11:45:37.178187+0000","last_peered":"2023-05-17T11:45:37.178187+0000","last_clean":"2023-05-17T11:45:37.178187+0000","last_became_active":"2023-05-17T11:45:35.547228+0000","last_became_peered":"2023-05-17T11:45:35.547228+0000","last_unstale":"2023-05-17T11:45:37.178187+0000","last_undegraded":"2023-05-17T11:45:37.178187+0000","last_fullsized":"2023-05-17T11:45:37.178187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678846+0000","last_change":"2023-05-17T11:45:35.530614+0000","last_active":"2023-05-17T11:45:37.678846+0000","last_peered":"2023-05-17T11:45:37.678846+0000","last_clean":"2023-05-17T11:45:37.678846+0000","last_became_active":"2023-05-17T11:45:35.529983+0000","last_became_peered":"2023-05-17T11:45:35.529983+0000","last_unstale":"2023-05-17T11:45:37.678846+0000","last_undegraded":"2023-05-17T11:45:37.678846+0000","last_fullsized":"2023-05-17T11:45:37.678846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679176+0000","last_change":"2023-05-17T11:45:35.534671+0000","last_active":"2023-05-17T11:45:37.679176+0000","last_peered":"2023-05-17T11:45:37.679176+0000","last_clean":"2023-05-17T11:45:37.679176+0000","last_became_active":"2023-05-17T11:45:35.534089+0000","last_became_peered":"2023-05-17T11:45:35.534089+0000","last_unstale":"2023-05-17T11:45:37.679176+0000","last_undegraded":"2023-05-17T11:45:37.679176+0000","last_fullsized":"2023-05-17T11:45:37.679176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679917+0000","last_change":"2023-05-17T11:45:35.556495+0000","last_active":"2023-05-17T11:45:37.679917+0000","last_peered":"2023-05-17T11:45:37.679917+0000","last_clean":"2023-05-17T11:45:37.679917+0000","last_became_active":"2023-05-17T11:45:35.556172+0000","last_became_peered":"2023-05-17T11:45:35.556172+0000","last_unstale":"2023-05-17T11:45:37.679917+0000","last_undegraded":"2023-05-17T11:45:37.679917+0000","last_fullsized":"2023-05-17T11:45:37.679917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:28.142771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521284+0000","last_change":"2023-05-17T11:45:35.545750+0000","last_active":"2023-05-17T11:45:36.521284+0000","last_peered":"2023-05-17T11:45:36.521284+0000","last_clean":"2023-05-17T11:45:36.521284+0000","last_became_active":"2023-05-17T11:45:35.543809+0000","last_became_peered":"2023-05-17T11:45:35.543809+0000","last_unstale":"2023-05-17T11:45:36.521284+0000","last_undegraded":"2023-05-17T11:45:36.521284+0000","last_fullsized":"2023-05-17T11:45:36.521284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678291+0000","last_change":"2023-05-17T11:45:35.533284+0000","last_active":"2023-05-17T11:45:37.678291+0000","last_peered":"2023-05-17T11:45:37.678291+0000","last_clean":"2023-05-17T11:45:37.678291+0000","last_became_active":"2023-05-17T11:45:35.533036+0000","last_became_peered":"2023-05-17T11:45:35.533036+0000","last_unstale":"2023-05-17T11:45:37.678291+0000","last_undegraded":"2023-05-17T11:45:37.678291+0000","last_fullsized":"2023-05-17T11:45:37.678291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521791+0000","last_change":"2023-05-17T11:45:35.536658+0000","last_active":"2023-05-17T11:45:36.521791+0000","last_peered":"2023-05-17T11:45:36.521791+0000","last_clean":"2023-05-17T11:45:36.521791+0000","last_became_active":"2023-05-17T11:45:35.536150+0000","last_became_peered":"2023-05-17T11:45:35.536150+0000","last_unstale":"2023-05-17T11:45:36.521791+0000","last_undegraded":"2023-05-17T11:45:36.521791+0000","last_fullsized":"2023-05-17T11:45:36.521791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680236+0000","last_change":"2023-05-17T11:45:35.543512+0000","last_active":"2023-05-17T11:45:37.680236+0000","last_peered":"2023-05-17T11:45:37.680236+0000","last_clean":"2023-05-17T11:45:37.680236+0000","last_became_active":"2023-05-17T11:45:35.540333+0000","last_became_peered":"2023-05-17T11:45:35.540333+0000","last_unstale":"2023-05-17T11:45:37.680236+0000","last_undegraded":"2023-05-17T11:45:37.680236+0000","last_fullsized":"2023-05-17T11:45:37.680236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:34.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.677931+0000","last_change":"2023-05-17T11:45:35.542466+0000","last_active":"2023-05-17T11:45:37.677931+0000","last_peered":"2023-05-17T11:45:37.677931+0000","last_clean":"2023-05-17T11:45:37.677931+0000","last_became_active":"2023-05-17T11:45:35.542211+0000","last_became_peered":"2023-05-17T11:45:35.542211+0000","last_unstale":"2023-05-17T11:45:37.677931+0000","last_undegraded":"2023-05-17T11:45:37.677931+0000","last_fullsized":"2023-05-17T11:45:37.677931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:24:13.270647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678158+0000","last_change":"2023-05-17T11:45:35.528858+0000","last_active":"2023-05-17T11:45:37.678158+0000","last_peered":"2023-05-17T11:45:37.678158+0000","last_clean":"2023-05-17T11:45:37.678158+0000","last_became_active":"2023-05-17T11:45:35.527334+0000","last_became_peered":"2023-05-17T11:45:35.527334+0000","last_unstale":"2023-05-17T11:45:37.678158+0000","last_undegraded":"2023-05-17T11:45:37.678158+0000","last_fullsized":"2023-05-17T11:45:37.678158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:54.806823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521378+0000","last_change":"2023-05-17T11:45:35.533168+0000","last_active":"2023-05-17T11:45:36.521378+0000","last_peered":"2023-05-17T11:45:36.521378+0000","last_clean":"2023-05-17T11:45:36.521378+0000","last_became_active":"2023-05-17T11:45:35.532752+0000","last_became_peered":"2023-05-17T11:45:35.532752+0000","last_unstale":"2023-05-17T11:45:36.521378+0000","last_undegraded":"2023-05-17T11:45:36.521378+0000","last_fullsized":"2023-05-17T11:45:36.521378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680090+0000","last_change":"2023-05-17T11:45:35.556519+0000","last_active":"2023-05-17T11:45:37.680090+0000","last_peered":"2023-05-17T11:45:37.680090+0000","last_clean":"2023-05-17T11:45:37.680090+0000","last_became_active":"2023-05-17T11:45:35.556187+0000","last_became_peered":"2023-05-17T11:45:35.556187+0000","last_unstale":"2023-05-17T11:45:37.680090+0000","last_undegraded":"2023-05-17T11:45:37.680090+0000","last_fullsized":"2023-05-17T11:45:37.680090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:46:21.218076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679061+0000","last_change":"2023-05-17T11:45:35.535436+0000","last_active":"2023-05-17T11:45:37.679061+0000","last_peered":"2023-05-17T11:45:37.679061+0000","last_clean":"2023-05-17T11:45:37.679061+0000","last_became_active":"2023-05-17T11:45:35.535014+0000","last_became_peered":"2023-05-17T11:45:35.535014+0000","last_unstale":"2023-05-17T11:45:37.679061+0000","last_undegraded":"2023-05-17T11:45:37.679061+0000","last_fullsized":"2023-05-17T11:45:37.679061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678441+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:37.678441+0000","last_peered":"2023-05-17T11:45:37.678441+0000","last_clean":"2023-05-17T11:45:37.678441+0000","last_became_active":"2023-05-17T11:45:35.530050+0000","last_became_peered":"2023-05-17T11:45:35.530050+0000","last_unstale":"2023-05-17T11:45:37.678441+0000","last_undegraded":"2023-05-17T11:45:37.678441+0000","last_fullsized":"2023-05-17T11:45:37.678441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680310+0000","last_change":"2023-05-17T11:45:35.540996+0000","last_active":"2023-05-17T11:45:37.680310+0000","last_peered":"2023-05-17T11:45:37.680310+0000","last_clean":"2023-05-17T11:45:37.680310+0000","last_became_active":"2023-05-17T11:45:35.539704+0000","last_became_peered":"2023-05-17T11:45:35.539704+0000","last_unstale":"2023-05-17T11:45:37.680310+0000","last_undegraded":"2023-05-17T11:45:37.680310+0000","last_fullsized":"2023-05-17T11:45:37.680310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:52:04.952023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678015+0000","last_change":"2023-05-17T11:45:35.545437+0000","last_active":"2023-05-17T11:45:37.678015+0000","last_peered":"2023-05-17T11:45:37.678015+0000","last_clean":"2023-05-17T11:45:37.678015+0000","last_became_active":"2023-05-17T11:45:35.545111+0000","last_became_peered":"2023-05-17T11:45:35.545111+0000","last_unstale":"2023-05-17T11:45:37.678015+0000","last_undegraded":"2023-05-17T11:45:37.678015+0000","last_fullsized":"2023-05-17T11:45:37.678015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680036+0000","last_change":"2023-05-17T11:45:35.553620+0000","last_active":"2023-05-17T11:45:37.680036+0000","last_peered":"2023-05-17T11:45:37.680036+0000","last_clean":"2023-05-17T11:45:37.680036+0000","last_became_active":"2023-05-17T11:45:35.550862+0000","last_became_peered":"2023-05-17T11:45:35.550862+0000","last_unstale":"2023-05-17T11:45:37.680036+0000","last_undegraded":"2023-05-17T11:45:37.680036+0000","last_fullsized":"2023-05-17T11:45:37.680036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679614+0000","last_change":"2023-05-17T11:45:35.559364+0000","last_active":"2023-05-17T11:45:37.679614+0000","last_peered":"2023-05-17T11:45:37.679614+0000","last_clean":"2023-05-17T11:45:37.679614+0000","last_became_active":"2023-05-17T11:45:35.558911+0000","last_became_peered":"2023-05-17T11:45:35.558911+0000","last_unstale":"2023-05-17T11:45:37.679614+0000","last_undegraded":"2023-05-17T11:45:37.679614+0000","last_fullsized":"2023-05-17T11:45:37.679614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678310+0000","last_change":"2023-05-17T11:45:35.540513+0000","last_active":"2023-05-17T11:45:37.678310+0000","last_peered":"2023-05-17T11:45:37.678310+0000","last_clean":"2023-05-17T11:45:37.678310+0000","last_became_active":"2023-05-17T11:45:35.540257+0000","last_became_peered":"2023-05-17T11:45:35.540257+0000","last_unstale":"2023-05-17T11:45:37.678310+0000","last_undegraded":"2023-05-17T11:45:37.678310+0000","last_fullsized":"2023-05-17T11:45:37.678310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521091+0000","last_change":"2023-05-17T11:45:35.531180+0000","last_active":"2023-05-17T11:45:36.521091+0000","last_peered":"2023-05-17T11:45:36.521091+0000","last_clean":"2023-05-17T11:45:36.521091+0000","last_became_active":"2023-05-17T11:45:35.530904+0000","last_became_peered":"2023-05-17T11:45:35.530904+0000","last_unstale":"2023-05-17T11:45:36.521091+0000","last_undegraded":"2023-05-17T11:45:36.521091+0000","last_fullsized":"2023-05-17T11:45:36.521091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:19.803154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679441+0000","last_change":"2023-05-17T11:45:35.543609+0000","last_active":"2023-05-17T11:45:37.679441+0000","last_peered":"2023-05-17T11:45:37.679441+0000","last_clean":"2023-05-17T11:45:37.679441+0000","last_became_active":"2023-05-17T11:45:35.543225+0000","last_became_peered":"2023-05-17T11:45:35.543225+0000","last_unstale":"2023-05-17T11:45:37.679441+0000","last_undegraded":"2023-05-17T11:45:37.679441+0000","last_fullsized":"2023-05-17T11:45:37.679441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519623+0000","last_change":"2023-05-17T11:45:35.546917+0000","last_active":"2023-05-17T11:45:36.519623+0000","last_peered":"2023-05-17T11:45:36.519623+0000","last_clean":"2023-05-17T11:45:36.519623+0000","last_became_active":"2023-05-17T11:45:35.546616+0000","last_became_peered":"2023-05-17T11:45:35.546616+0000","last_unstale":"2023-05-17T11:45:36.519623+0000","last_undegraded":"2023-05-17T11:45:36.519623+0000","last_fullsized":"2023-05-17T11:45:36.519623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520007+0000","last_change":"2023-05-17T11:45:35.535060+0000","last_active":"2023-05-17T11:45:36.520007+0000","last_peered":"2023-05-17T11:45:36.520007+0000","last_clean":"2023-05-17T11:45:36.520007+0000","last_became_active":"2023-05-17T11:45:35.534805+0000","last_became_peered":"2023-05-17T11:45:35.534805+0000","last_unstale":"2023-05-17T11:45:36.520007+0000","last_undegraded":"2023-05-17T11:45:36.520007+0000","last_fullsized":"2023-05-17T11:45:36.520007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521780+0000","last_change":"2023-05-17T11:45:35.542414+0000","last_active":"2023-05-17T11:45:36.521780+0000","last_peered":"2023-05-17T11:45:36.521780+0000","last_clean":"2023-05-17T11:45:36.521780+0000","last_became_active":"2023-05-17T11:45:35.542083+0000","last_became_peered":"2023-05-17T11:45:35.542083+0000","last_unstale":"2023-05-17T11:45:36.521780+0000","last_undegraded":"2023-05-17T11:45:36.521780+0000","last_fullsized":"2023-05-17T11:45:36.521780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519826+0000","last_change":"2023-05-17T11:45:35.538026+0000","last_active":"2023-05-17T11:45:36.519826+0000","last_peered":"2023-05-17T11:45:36.519826+0000","last_clean":"2023-05-17T11:45:36.519826+0000","last_became_active":"2023-05-17T11:45:35.534906+0000","last_became_peered":"2023-05-17T11:45:35.534906+0000","last_unstale":"2023-05-17T11:45:36.519826+0000","last_undegraded":"2023-05-17T11:45:36.519826+0000","last_fullsized":"2023-05-17T11:45:36.519826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521427+0000","last_change":"2023-05-17T11:45:35.545248+0000","last_active":"2023-05-17T11:45:36.521427+0000","last_peered":"2023-05-17T11:45:36.521427+0000","last_clean":"2023-05-17T11:45:36.521427+0000","last_became_active":"2023-05-17T11:45:35.544970+0000","last_became_peered":"2023-05-17T11:45:35.544970+0000","last_unstale":"2023-05-17T11:45:36.521427+0000","last_undegraded":"2023-05-17T11:45:36.521427+0000","last_fullsized":"2023-05-17T11:45:36.521427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679450+0000","last_change":"2023-05-17T11:45:35.553537+0000","last_active":"2023-05-17T11:45:37.679450+0000","last_peered":"2023-05-17T11:45:37.679450+0000","last_clean":"2023-05-17T11:45:37.679450+0000","last_became_active":"2023-05-17T11:45:35.551558+0000","last_became_peered":"2023-05-17T11:45:35.551558+0000","last_unstale":"2023-05-17T11:45:37.679450+0000","last_undegraded":"2023-05-17T11:45:37.679450+0000","last_fullsized":"2023-05-17T11:45:37.679450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521229+0000","last_change":"2023-05-17T11:45:35.534702+0000","last_active":"2023-05-17T11:45:36.521229+0000","last_peered":"2023-05-17T11:45:36.521229+0000","last_clean":"2023-05-17T11:45:36.521229+0000","last_became_active":"2023-05-17T11:45:35.534447+0000","last_became_peered":"2023-05-17T11:45:35.534447+0000","last_unstale":"2023-05-17T11:45:36.521229+0000","last_undegraded":"2023-05-17T11:45:36.521229+0000","last_fullsized":"2023-05-17T11:45:36.521229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.177990+0000","last_change":"2023-05-17T11:45:35.546069+0000","last_active":"2023-05-17T11:45:37.177990+0000","last_peered":"2023-05-17T11:45:37.177990+0000","last_clean":"2023-05-17T11:45:37.177990+0000","last_became_active":"2023-05-17T11:45:35.545768+0000","last_became_peered":"2023-05-17T11:45:35.545768+0000","last_unstale":"2023-05-17T11:45:37.177990+0000","last_undegraded":"2023-05-17T11:45:37.177990+0000","last_fullsized":"2023-05-17T11:45:37.177990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:28.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521500+0000","last_change":"2023-05-17T11:45:35.541053+0000","last_active":"2023-05-17T11:45:36.521500+0000","last_peered":"2023-05-17T11:45:36.521500+0000","last_clean":"2023-05-17T11:45:36.521500+0000","last_became_active":"2023-05-17T11:45:35.540780+0000","last_became_peered":"2023-05-17T11:45:35.540780+0000","last_unstale":"2023-05-17T11:45:36.521500+0000","last_undegraded":"2023-05-17T11:45:36.521500+0000","last_fullsized":"2023-05-17T11:45:36.521500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679690+0000","last_change":"2023-05-17T11:45:35.148198+0000","last_active":"2023-05-17T11:45:37.679690+0000","last_peered":"2023-05-17T11:45:37.679690+0000","last_clean":"2023-05-17T11:45:37.679690+0000","last_became_active":"2023-05-17T11:45:35.147893+0000","last_became_peered":"2023-05-17T11:45:35.147893+0000","last_unstale":"2023-05-17T11:45:37.679690+0000","last_undegraded":"2023-05-17T11:45:37.679690+0000","last_fullsized":"2023-05-17T11:45:37.679690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:07.960059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521783+0000","last_change":"2023-05-17T11:45:35.546006+0000","last_active":"2023-05-17T11:45:36.521783+0000","last_peered":"2023-05-17T11:45:36.521783+0000","last_clean":"2023-05-17T11:45:36.521783+0000","last_became_active":"2023-05-17T11:45:35.545532+0000","last_became_peered":"2023-05-17T11:45:35.545532+0000","last_unstale":"2023-05-17T11:45:36.521783+0000","last_undegraded":"2023-05-17T11:45:36.521783+0000","last_fullsized":"2023-05-17T11:45:36.521783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678314+0000","last_change":"2023-05-17T11:45:35.138861+0000","last_active":"2023-05-17T11:45:37.678314+0000","last_peered":"2023-05-17T11:45:37.678314+0000","last_clean":"2023-05-17T11:45:37.678314+0000","last_became_active":"2023-05-17T11:45:35.138231+0000","last_became_peered":"2023-05-17T11:45:35.138231+0000","last_unstale":"2023-05-17T11:45:37.678314+0000","last_undegraded":"2023-05-17T11:45:37.678314+0000","last_fullsized":"2023-05-17T11:45:37.678314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678607+0000","last_change":"2023-05-17T11:45:35.532498+0000","last_active":"2023-05-17T11:45:37.678607+0000","last_peered":"2023-05-17T11:45:37.678607+0000","last_clean":"2023-05-17T11:45:37.678607+0000","last_became_active":"2023-05-17T11:45:35.532219+0000","last_became_peered":"2023-05-17T11:45:35.532219+0000","last_unstale":"2023-05-17T11:45:37.678607+0000","last_undegraded":"2023-05-17T11:45:37.678607+0000","last_fullsized":"2023-05-17T11:45:37.678607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680219+0000","last_change":"2023-05-17T11:45:35.143472+0000","last_active":"2023-05-17T11:45:37.680219+0000","last_peered":"2023-05-17T11:45:37.680219+0000","last_clean":"2023-05-17T11:45:37.680219+0000","last_became_active":"2023-05-17T11:45:35.142889+0000","last_became_peered":"2023-05-17T11:45:35.142889+0000","last_unstale":"2023-05-17T11:45:37.680219+0000","last_undegraded":"2023-05-17T11:45:37.680219+0000","last_fullsized":"2023-05-17T11:45:37.680219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:36:28.339027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521564+0000","last_change":"2023-05-17T11:45:35.544687+0000","last_active":"2023-05-17T11:45:36.521564+0000","last_peered":"2023-05-17T11:45:36.521564+0000","last_clean":"2023-05-17T11:45:36.521564+0000","last_became_active":"2023-05-17T11:45:35.544357+0000","last_became_peered":"2023-05-17T11:45:35.544357+0000","last_unstale":"2023-05-17T11:45:36.521564+0000","last_undegraded":"2023-05-17T11:45:36.521564+0000","last_fullsized":"2023-05-17T11:45:36.521564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:04.991189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178143+0000","last_change":"2023-05-17T11:45:35.132466+0000","last_active":"2023-05-17T11:45:37.178143+0000","last_peered":"2023-05-17T11:45:37.178143+0000","last_clean":"2023-05-17T11:45:37.178143+0000","last_became_active":"2023-05-17T11:45:35.132140+0000","last_became_peered":"2023-05-17T11:45:35.132140+0000","last_unstale":"2023-05-17T11:45:37.178143+0000","last_undegraded":"2023-05-17T11:45:37.178143+0000","last_fullsized":"2023-05-17T11:45:37.178143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:41:04.077222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679942+0000","last_change":"2023-05-17T11:45:35.148167+0000","last_active":"2023-05-17T11:45:37.679942+0000","last_peered":"2023-05-17T11:45:37.679942+0000","last_clean":"2023-05-17T11:45:37.679942+0000","last_became_active":"2023-05-17T11:45:35.147381+0000","last_became_peered":"2023-05-17T11:45:35.147381+0000","last_unstale":"2023-05-17T11:45:37.679942+0000","last_undegraded":"2023-05-17T11:45:37.679942+0000","last_fullsized":"2023-05-17T11:45:37.679942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:28:39.219260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521316+0000","last_change":"2023-05-17T11:45:35.530247+0000","last_active":"2023-05-17T11:45:36.521316+0000","last_peered":"2023-05-17T11:45:36.521316+0000","last_clean":"2023-05-17T11:45:36.521316+0000","last_became_active":"2023-05-17T11:45:35.529813+0000","last_became_peered":"2023-05-17T11:45:35.529813+0000","last_unstale":"2023-05-17T11:45:36.521316+0000","last_undegraded":"2023-05-17T11:45:36.521316+0000","last_fullsized":"2023-05-17T11:45:36.521316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680527+0000","last_change":"2023-05-17T11:45:35.148428+0000","last_active":"2023-05-17T11:45:37.680527+0000","last_peered":"2023-05-17T11:45:37.680527+0000","last_clean":"2023-05-17T11:45:37.680527+0000","last_became_active":"2023-05-17T11:45:35.147509+0000","last_became_peered":"2023-05-17T11:45:35.147509+0000","last_unstale":"2023-05-17T11:45:37.680527+0000","last_undegraded":"2023-05-17T11:45:37.680527+0000","last_fullsized":"2023-05-17T11:45:37.680527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:26:12.080076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679160+0000","last_change":"2023-05-17T11:45:35.541926+0000","last_active":"2023-05-17T11:45:37.679160+0000","last_peered":"2023-05-17T11:45:37.679160+0000","last_clean":"2023-05-17T11:45:37.679160+0000","last_became_active":"2023-05-17T11:45:35.540338+0000","last_became_peered":"2023-05-17T11:45:35.540338+0000","last_unstale":"2023-05-17T11:45:37.679160+0000","last_undegraded":"2023-05-17T11:45:37.679160+0000","last_fullsized":"2023-05-17T11:45:37.679160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:19.540197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679882+0000","last_change":"2023-05-17T11:45:35.140919+0000","last_active":"2023-05-17T11:45:37.679882+0000","last_peered":"2023-05-17T11:45:37.679882+0000","last_clean":"2023-05-17T11:45:37.679882+0000","last_became_active":"2023-05-17T11:45:35.140533+0000","last_became_peered":"2023-05-17T11:45:35.140533+0000","last_unstale":"2023-05-17T11:45:37.679882+0000","last_undegraded":"2023-05-17T11:45:37.679882+0000","last_fullsized":"2023-05-17T11:45:37.679882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:50:49.698249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178078+0000","last_change":"2023-05-17T11:45:35.544834+0000","last_active":"2023-05-17T11:45:37.178078+0000","last_peered":"2023-05-17T11:45:37.178078+0000","last_clean":"2023-05-17T11:45:37.178078+0000","last_became_active":"2023-05-17T11:45:35.544565+0000","last_became_peered":"2023-05-17T11:45:35.544565+0000","last_unstale":"2023-05-17T11:45:37.178078+0000","last_undegraded":"2023-05-17T11:45:37.178078+0000","last_fullsized":"2023-05-17T11:45:37.178078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:24.229674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521886+0000","last_change":"2023-05-17T11:45:35.141712+0000","last_active":"2023-05-17T11:45:36.521886+0000","last_peered":"2023-05-17T11:45:36.521886+0000","last_clean":"2023-05-17T11:45:36.521886+0000","last_became_active":"2023-05-17T11:45:35.141301+0000","last_became_peered":"2023-05-17T11:45:35.141301+0000","last_unstale":"2023-05-17T11:45:36.521886+0000","last_undegraded":"2023-05-17T11:45:36.521886+0000","last_fullsized":"2023-05-17T11:45:36.521886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678561+0000","last_change":"2023-05-17T11:45:35.541253+0000","last_active":"2023-05-17T11:45:37.678561+0000","last_peered":"2023-05-17T11:45:37.678561+0000","last_clean":"2023-05-17T11:45:37.678561+0000","last_became_active":"2023-05-17T11:45:35.540949+0000","last_became_peered":"2023-05-17T11:45:35.540949+0000","last_unstale":"2023-05-17T11:45:37.678561+0000","last_undegraded":"2023-05-17T11:45:37.678561+0000","last_fullsized":"2023-05-17T11:45:37.678561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521633+0000","last_change":"2023-05-17T11:45:35.144268+0000","last_active":"2023-05-17T11:45:36.521633+0000","last_peered":"2023-05-17T11:45:36.521633+0000","last_clean":"2023-05-17T11:45:36.521633+0000","last_became_active":"2023-05-17T11:45:35.143991+0000","last_became_peered":"2023-05-17T11:45:35.143991+0000","last_unstale":"2023-05-17T11:45:36.521633+0000","last_undegraded":"2023-05-17T11:45:36.521633+0000","last_fullsized":"2023-05-17T11:45:36.521633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680219+0000","last_change":"2023-05-17T11:45:35.542321+0000","last_active":"2023-05-17T11:45:37.680219+0000","last_peered":"2023-05-17T11:45:37.680219+0000","last_clean":"2023-05-17T11:45:37.680219+0000","last_became_active":"2023-05-17T11:45:35.539632+0000","last_became_peered":"2023-05-17T11:45:35.539632+0000","last_unstale":"2023-05-17T11:45:37.680219+0000","last_undegraded":"2023-05-17T11:45:37.680219+0000","last_fullsized":"2023-05-17T11:45:37.680219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:08.967305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178234+0000","last_change":"2023-05-17T11:45:35.142904+0000","last_active":"2023-05-17T11:45:37.178234+0000","last_peered":"2023-05-17T11:45:37.178234+0000","last_clean":"2023-05-17T11:45:37.178234+0000","last_became_active":"2023-05-17T11:45:35.142584+0000","last_became_peered":"2023-05-17T11:45:35.142584+0000","last_unstale":"2023-05-17T11:45:37.178234+0000","last_undegraded":"2023-05-17T11:45:37.178234+0000","last_fullsized":"2023-05-17T11:45:37.178234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:49:53.799577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680254+0000","last_change":"2023-05-17T11:45:35.536915+0000","last_active":"2023-05-17T11:45:37.680254+0000","last_peered":"2023-05-17T11:45:37.680254+0000","last_clean":"2023-05-17T11:45:37.680254+0000","last_became_active":"2023-05-17T11:45:35.536543+0000","last_became_peered":"2023-05-17T11:45:35.536543+0000","last_unstale":"2023-05-17T11:45:37.680254+0000","last_undegraded":"2023-05-17T11:45:37.680254+0000","last_fullsized":"2023-05-17T11:45:37.680254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:50:50.705495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679411+0000","last_change":"2023-05-17T11:45:35.137585+0000","last_active":"2023-05-17T11:45:37.679411+0000","last_peered":"2023-05-17T11:45:37.679411+0000","last_clean":"2023-05-17T11:45:37.679411+0000","last_became_active":"2023-05-17T11:45:35.137054+0000","last_became_peered":"2023-05-17T11:45:35.137054+0000","last_unstale":"2023-05-17T11:45:37.679411+0000","last_undegraded":"2023-05-17T11:45:37.679411+0000","last_fullsized":"2023-05-17T11:45:37.679411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680484+0000","last_change":"2023-05-17T11:45:35.550175+0000","last_active":"2023-05-17T11:45:37.680484+0000","last_peered":"2023-05-17T11:45:37.680484+0000","last_clean":"2023-05-17T11:45:37.680484+0000","last_became_active":"2023-05-17T11:45:35.549881+0000","last_became_peered":"2023-05-17T11:45:35.549881+0000","last_unstale":"2023-05-17T11:45:37.680484+0000","last_undegraded":"2023-05-17T11:45:37.680484+0000","last_fullsized":"2023-05-17T11:45:37.680484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:28:40.226506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521247+0000","last_change":"2023-05-17T11:45:35.144989+0000","last_active":"2023-05-17T11:45:36.521247+0000","last_peered":"2023-05-17T11:45:36.521247+0000","last_clean":"2023-05-17T11:45:36.521247+0000","last_became_active":"2023-05-17T11:45:35.144819+0000","last_became_peered":"2023-05-17T11:45:35.144819+0000","last_unstale":"2023-05-17T11:45:36.521247+0000","last_undegraded":"2023-05-17T11:45:36.521247+0000","last_fullsized":"2023-05-17T11:45:36.521247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:03.684194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519767+0000","last_change":"2023-05-17T11:45:35.537836+0000","last_active":"2023-05-17T11:45:36.519767+0000","last_peered":"2023-05-17T11:45:36.519767+0000","last_clean":"2023-05-17T11:45:36.519767+0000","last_became_active":"2023-05-17T11:45:35.536405+0000","last_became_peered":"2023-05-17T11:45:35.536405+0000","last_unstale":"2023-05-17T11:45:36.519767+0000","last_undegraded":"2023-05-17T11:45:36.519767+0000","last_fullsized":"2023-05-17T11:45:36.519767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679876+0000","last_change":"2023-05-17T11:45:23.894807+0000","last_active":"2023-05-17T11:45:37.679876+0000","last_peered":"2023-05-17T11:45:37.679876+0000","last_clean":"2023-05-17T11:45:37.679876+0000","last_became_active":"2023-05-17T11:45:23.894516+0000","last_became_peered":"2023-05-17T11:45:23.894516+0000","last_unstale":"2023-05-17T11:45:37.679876+0000","last_undegraded":"2023-05-17T11:45:37.679876+0000","last_fullsized":"2023-05-17T11:45:37.679876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_clean_scrub_stamp":"2023-05-17T11:45:22.596969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:51:52.439084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521380+0000","last_change":"2023-05-17T11:45:30.089866+0000","last_active":"2023-05-17T11:45:36.521380+0000","last_peered":"2023-05-17T11:45:36.521380+0000","last_clean":"2023-05-17T11:45:36.521380+0000","last_became_active":"2023-05-17T11:45:30.089207+0000","last_became_peered":"2023-05-17T11:45:30.089207+0000","last_unstale":"2023-05-17T11:45:36.521380+0000","last_undegraded":"2023-05-17T11:45:36.521380+0000","last_fullsized":"2023-05-17T11:45:36.521380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:27.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521342+0000","last_change":"2023-05-17T11:45:35.140973+0000","last_active":"2023-05-17T11:45:36.521342+0000","last_peered":"2023-05-17T11:45:36.521342+0000","last_clean":"2023-05-17T11:45:36.521342+0000","last_became_active":"2023-05-17T11:45:35.140590+0000","last_became_peered":"2023-05-17T11:45:35.140590+0000","last_unstale":"2023-05-17T11:45:36.521342+0000","last_undegraded":"2023-05-17T11:45:36.521342+0000","last_fullsized":"2023-05-17T11:45:36.521342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:32.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178394+0000","last_change":"2023-05-17T11:45:35.552628+0000","last_active":"2023-05-17T11:45:37.178394+0000","last_peered":"2023-05-17T11:45:37.178394+0000","last_clean":"2023-05-17T11:45:37.178394+0000","last_became_active":"2023-05-17T11:45:35.552298+0000","last_became_peered":"2023-05-17T11:45:35.552298+0000","last_unstale":"2023-05-17T11:45:37.178394+0000","last_undegraded":"2023-05-17T11:45:37.178394+0000","last_fullsized":"2023-05-17T11:45:37.178394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:23:37.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679588+0000","last_change":"2023-05-17T11:45:30.093107+0000","last_active":"2023-05-17T11:45:37.679588+0000","last_peered":"2023-05-17T11:45:37.679588+0000","last_clean":"2023-05-17T11:45:37.679588+0000","last_became_active":"2023-05-17T11:45:30.092684+0000","last_became_peered":"2023-05-17T11:45:30.092684+0000","last_unstale":"2023-05-17T11:45:37.679588+0000","last_undegraded":"2023-05-17T11:45:37.679588+0000","last_fullsized":"2023-05-17T11:45:37.679588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:37.071002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678112+0000","last_change":"2023-05-17T11:45:35.135037+0000","last_active":"2023-05-17T11:45:37.678112+0000","last_peered":"2023-05-17T11:45:37.678112+0000","last_clean":"2023-05-17T11:45:37.678112+0000","last_became_active":"2023-05-17T11:45:35.134656+0000","last_became_peered":"2023-05-17T11:45:35.134656+0000","last_unstale":"2023-05-17T11:45:37.678112+0000","last_undegraded":"2023-05-17T11:45:37.678112+0000","last_fullsized":"2023-05-17T11:45:37.678112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:18.795908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678574+0000","last_change":"2023-05-17T11:45:35.541264+0000","last_active":"2023-05-17T11:45:37.678574+0000","last_peered":"2023-05-17T11:45:37.678574+0000","last_clean":"2023-05-17T11:45:37.678574+0000","last_became_active":"2023-05-17T11:45:35.541014+0000","last_became_peered":"2023-05-17T11:45:35.541014+0000","last_unstale":"2023-05-17T11:45:37.678574+0000","last_undegraded":"2023-05-17T11:45:37.678574+0000","last_fullsized":"2023-05-17T11:45:37.678574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:24.331366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678001+0000","last_change":"2023-05-17T11:45:30.096072+0000","last_active":"2023-05-17T11:45:37.678001+0000","last_peered":"2023-05-17T11:45:37.678001+0000","last_clean":"2023-05-17T11:45:37.678001+0000","last_became_active":"2023-05-17T11:45:30.095647+0000","last_became_peered":"2023-05-17T11:45:30.095647+0000","last_unstale":"2023-05-17T11:45:37.678001+0000","last_undegraded":"2023-05-17T11:45:37.678001+0000","last_fullsized":"2023-05-17T11:45:37.678001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:28:22.142981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519445+0000","last_change":"2023-05-17T11:45:35.129591+0000","last_active":"2023-05-17T11:45:36.519445+0000","last_peered":"2023-05-17T11:45:36.519445+0000","last_clean":"2023-05-17T11:45:36.519445+0000","last_became_active":"2023-05-17T11:45:35.129301+0000","last_became_peered":"2023-05-17T11:45:35.129301+0000","last_unstale":"2023-05-17T11:45:36.519445+0000","last_undegraded":"2023-05-17T11:45:36.519445+0000","last_fullsized":"2023-05-17T11:45:36.519445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:23:18.795908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520150+0000","last_change":"2023-05-17T11:45:35.534133+0000","last_active":"2023-05-17T11:45:36.520150+0000","last_peered":"2023-05-17T11:45:36.520150+0000","last_clean":"2023-05-17T11:45:36.520150+0000","last_became_active":"2023-05-17T11:45:35.533661+0000","last_became_peered":"2023-05-17T11:45:35.533661+0000","last_unstale":"2023-05-17T11:45:36.520150+0000","last_undegraded":"2023-05-17T11:45:36.520150+0000","last_fullsized":"2023-05-17T11:45:36.520150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:11.429784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521322+0000","last_change":"2023-05-17T11:45:30.084716+0000","last_active":"2023-05-17T11:45:36.521322+0000","last_peered":"2023-05-17T11:45:36.521322+0000","last_clean":"2023-05-17T11:45:36.521322+0000","last_became_active":"2023-05-17T11:45:30.084340+0000","last_became_peered":"2023-05-17T11:45:30.084340+0000","last_unstale":"2023-05-17T11:45:36.521322+0000","last_undegraded":"2023-05-17T11:45:36.521322+0000","last_fullsized":"2023-05-17T11:45:36.521322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:35:58.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679774+0000","last_change":"2023-05-17T11:45:35.142948+0000","last_active":"2023-05-17T11:45:37.679774+0000","last_peered":"2023-05-17T11:45:37.679774+0000","last_clean":"2023-05-17T11:45:37.679774+0000","last_became_active":"2023-05-17T11:45:35.142653+0000","last_became_peered":"2023-05-17T11:45:35.142653+0000","last_unstale":"2023-05-17T11:45:37.679774+0000","last_undegraded":"2023-05-17T11:45:37.679774+0000","last_fullsized":"2023-05-17T11:45:37.679774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519660+0000","last_change":"2023-05-17T11:45:35.534568+0000","last_active":"2023-05-17T11:45:36.519660+0000","last_peered":"2023-05-17T11:45:36.519660+0000","last_clean":"2023-05-17T11:45:36.519660+0000","last_became_active":"2023-05-17T11:45:35.534170+0000","last_became_peered":"2023-05-17T11:45:35.534170+0000","last_unstale":"2023-05-17T11:45:36.519660+0000","last_undegraded":"2023-05-17T11:45:36.519660+0000","last_fullsized":"2023-05-17T11:45:36.519660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521950+0000","last_change":"2023-05-17T11:45:35.146757+0000","last_active":"2023-05-17T11:45:36.521950+0000","last_peered":"2023-05-17T11:45:36.521950+0000","last_clean":"2023-05-17T11:45:36.521950+0000","last_became_active":"2023-05-17T11:45:35.146469+0000","last_became_peered":"2023-05-17T11:45:35.146469+0000","last_unstale":"2023-05-17T11:45:36.521950+0000","last_undegraded":"2023-05-17T11:45:36.521950+0000","last_fullsized":"2023-05-17T11:45:36.521950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:42:07.960059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519815+0000","last_change":"2023-05-17T11:45:30.647020+0000","last_active":"2023-05-17T11:45:36.519815+0000","last_peered":"2023-05-17T11:45:36.519815+0000","last_clean":"2023-05-17T11:45:36.519815+0000","last_became_active":"2023-05-17T11:45:30.646621+0000","last_became_peered":"2023-05-17T11:45:30.646621+0000","last_unstale":"2023-05-17T11:45:36.519815+0000","last_undegraded":"2023-05-17T11:45:36.519815+0000","last_fullsized":"2023-05-17T11:45:36.519815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:43.929512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519875+0000","last_change":"2023-05-17T11:45:35.534583+0000","last_active":"2023-05-17T11:45:36.519875+0000","last_peered":"2023-05-17T11:45:36.519875+0000","last_clean":"2023-05-17T11:45:36.519875+0000","last_became_active":"2023-05-17T11:45:35.533116+0000","last_became_peered":"2023-05-17T11:45:35.533116+0000","last_unstale":"2023-05-17T11:45:36.519875+0000","last_undegraded":"2023-05-17T11:45:36.519875+0000","last_fullsized":"2023-05-17T11:45:36.519875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:23:32.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519724+0000","last_change":"2023-05-17T11:45:35.129695+0000","last_active":"2023-05-17T11:45:36.519724+0000","last_peered":"2023-05-17T11:45:36.519724+0000","last_clean":"2023-05-17T11:45:36.519724+0000","last_became_active":"2023-05-17T11:45:35.129376+0000","last_became_peered":"2023-05-17T11:45:35.129376+0000","last_unstale":"2023-05-17T11:45:36.519724+0000","last_undegraded":"2023-05-17T11:45:36.519724+0000","last_fullsized":"2023-05-17T11:45:36.519724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:48:18.532951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680054+0000","last_change":"2023-05-17T11:45:30.647758+0000","last_active":"2023-05-17T11:45:37.680054+0000","last_peered":"2023-05-17T11:45:37.680054+0000","last_clean":"2023-05-17T11:45:37.680054+0000","last_became_active":"2023-05-17T11:45:30.647423+0000","last_became_peered":"2023-05-17T11:45:30.647423+0000","last_unstale":"2023-05-17T11:45:37.680054+0000","last_undegraded":"2023-05-17T11:45:37.680054+0000","last_fullsized":"2023-05-17T11:45:37.680054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:30:37.070489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678700+0000","last_change":"2023-05-17T11:45:35.536548+0000","last_active":"2023-05-17T11:45:37.678700+0000","last_peered":"2023-05-17T11:45:37.678700+0000","last_clean":"2023-05-17T11:45:37.678700+0000","last_became_active":"2023-05-17T11:45:35.535873+0000","last_became_peered":"2023-05-17T11:45:35.535873+0000","last_unstale":"2023-05-17T11:45:37.678700+0000","last_undegraded":"2023-05-17T11:45:37.678700+0000","last_fullsized":"2023-05-17T11:45:37.678700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:41.116640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521680+0000","last_change":"2023-05-17T11:45:35.144973+0000","last_active":"2023-05-17T11:45:36.521680+0000","last_peered":"2023-05-17T11:45:36.521680+0000","last_clean":"2023-05-17T11:45:36.521680+0000","last_became_active":"2023-05-17T11:45:35.144558+0000","last_became_peered":"2023-05-17T11:45:35.144558+0000","last_unstale":"2023-05-17T11:45:36.521680+0000","last_undegraded":"2023-05-17T11:45:36.521680+0000","last_fullsized":"2023-05-17T11:45:36.521680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.520015+0000","last_change":"2023-05-17T11:45:30.087244+0000","last_active":"2023-05-17T11:45:36.520015+0000","last_peered":"2023-05-17T11:45:36.520015+0000","last_clean":"2023-05-17T11:45:36.520015+0000","last_became_active":"2023-05-17T11:45:30.086890+0000","last_became_peered":"2023-05-17T11:45:30.086890+0000","last_unstale":"2023-05-17T11:45:36.520015+0000","last_undegraded":"2023-05-17T11:45:36.520015+0000","last_fullsized":"2023-05-17T11:45:36.520015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:35.074387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521122+0000","last_change":"2023-05-17T11:45:35.534336+0000","last_active":"2023-05-17T11:45:36.521122+0000","last_peered":"2023-05-17T11:45:36.521122+0000","last_clean":"2023-05-17T11:45:36.521122+0000","last_became_active":"2023-05-17T11:45:35.533768+0000","last_became_peered":"2023-05-17T11:45:35.533768+0000","last_unstale":"2023-05-17T11:45:36.521122+0000","last_undegraded":"2023-05-17T11:45:36.521122+0000","last_fullsized":"2023-05-17T11:45:36.521122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:03:55.215222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678722+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:37.678722+0000","last_peered":"2023-05-17T11:45:37.678722+0000","last_clean":"2023-05-17T11:45:37.678722+0000","last_became_active":"2023-05-17T11:45:35.138278+0000","last_became_peered":"2023-05-17T11:45:35.138278+0000","last_unstale":"2023-05-17T11:45:37.678722+0000","last_undegraded":"2023-05-17T11:45:37.678722+0000","last_fullsized":"2023-05-17T11:45:37.678722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:03.983943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178430+0000","last_change":"2023-05-17T11:45:30.088456+0000","last_active":"2023-05-17T11:45:37.178430+0000","last_peered":"2023-05-17T11:45:37.178430+0000","last_clean":"2023-05-17T11:45:37.178430+0000","last_became_active":"2023-05-17T11:45:30.088082+0000","last_became_peered":"2023-05-17T11:45:30.088082+0000","last_unstale":"2023-05-17T11:45:37.178430+0000","last_undegraded":"2023-05-17T11:45:37.178430+0000","last_fullsized":"2023-05-17T11:45:37.178430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:47:22.386463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679259+0000","last_change":"2023-05-17T11:45:35.538184+0000","last_active":"2023-05-17T11:45:37.679259+0000","last_peered":"2023-05-17T11:45:37.679259+0000","last_clean":"2023-05-17T11:45:37.679259+0000","last_became_active":"2023-05-17T11:45:35.537967+0000","last_became_peered":"2023-05-17T11:45:35.537967+0000","last_unstale":"2023-05-17T11:45:37.679259+0000","last_undegraded":"2023-05-17T11:45:37.679259+0000","last_fullsized":"2023-05-17T11:45:37.679259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679637+0000","last_change":"2023-05-17T11:45:35.551187+0000","last_active":"2023-05-17T11:45:37.679637+0000","last_peered":"2023-05-17T11:45:37.679637+0000","last_clean":"2023-05-17T11:45:37.679637+0000","last_became_active":"2023-05-17T11:45:35.550919+0000","last_became_peered":"2023-05-17T11:45:35.550919+0000","last_unstale":"2023-05-17T11:45:37.679637+0000","last_undegraded":"2023-05-17T11:45:37.679637+0000","last_fullsized":"2023-05-17T11:45:37.679637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:41.116640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.680397+0000","last_change":"2023-05-17T11:45:35.143591+0000","last_active":"2023-05-17T11:45:37.680397+0000","last_peered":"2023-05-17T11:45:37.680397+0000","last_clean":"2023-05-17T11:45:37.680397+0000","last_became_active":"2023-05-17T11:45:35.143258+0000","last_became_peered":"2023-05-17T11:45:35.143258+0000","last_unstale":"2023-05-17T11:45:37.680397+0000","last_undegraded":"2023-05-17T11:45:37.680397+0000","last_fullsized":"2023-05-17T11:45:37.680397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:27.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519735+0000","last_change":"2023-05-17T11:45:35.546190+0000","last_active":"2023-05-17T11:45:36.519735+0000","last_peered":"2023-05-17T11:45:36.519735+0000","last_clean":"2023-05-17T11:45:36.519735+0000","last_became_active":"2023-05-17T11:45:35.545718+0000","last_became_peered":"2023-05-17T11:45:35.545718+0000","last_unstale":"2023-05-17T11:45:36.519735+0000","last_undegraded":"2023-05-17T11:45:36.519735+0000","last_fullsized":"2023-05-17T11:45:36.519735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:36:04.691440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679769+0000","last_change":"2023-05-17T11:45:35.146268+0000","last_active":"2023-05-17T11:45:37.679769+0000","last_peered":"2023-05-17T11:45:37.679769+0000","last_clean":"2023-05-17T11:45:37.679769+0000","last_became_active":"2023-05-17T11:45:35.145917+0000","last_became_peered":"2023-05-17T11:45:35.145917+0000","last_unstale":"2023-05-17T11:45:37.679769+0000","last_undegraded":"2023-05-17T11:45:37.679769+0000","last_fullsized":"2023-05-17T11:45:37.679769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:38:33.204162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521793+0000","last_change":"2023-05-17T11:45:35.138653+0000","last_active":"2023-05-17T11:45:36.521793+0000","last_peered":"2023-05-17T11:45:36.521793+0000","last_clean":"2023-05-17T11:45:36.521793+0000","last_became_active":"2023-05-17T11:45:35.138291+0000","last_became_peered":"2023-05-17T11:45:35.138291+0000","last_unstale":"2023-05-17T11:45:36.521793+0000","last_undegraded":"2023-05-17T11:45:36.521793+0000","last_fullsized":"2023-05-17T11:45:36.521793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:06:40.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521323+0000","last_change":"2023-05-17T11:45:35.535628+0000","last_active":"2023-05-17T11:45:36.521323+0000","last_peered":"2023-05-17T11:45:36.521323+0000","last_clean":"2023-05-17T11:45:36.521323+0000","last_became_active":"2023-05-17T11:45:35.535341+0000","last_became_peered":"2023-05-17T11:45:35.535341+0000","last_unstale":"2023-05-17T11:45:36.521323+0000","last_undegraded":"2023-05-17T11:45:36.521323+0000","last_fullsized":"2023-05-17T11:45:36.521323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678724+0000","last_change":"2023-05-17T11:45:35.138119+0000","last_active":"2023-05-17T11:45:37.678724+0000","last_peered":"2023-05-17T11:45:37.678724+0000","last_clean":"2023-05-17T11:45:37.678724+0000","last_became_active":"2023-05-17T11:45:35.137723+0000","last_became_peered":"2023-05-17T11:45:35.137723+0000","last_unstale":"2023-05-17T11:45:37.678724+0000","last_undegraded":"2023-05-17T11:45:37.678724+0000","last_fullsized":"2023-05-17T11:45:37.678724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:02:10.422538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521068+0000","last_change":"2023-05-17T11:45:35.535751+0000","last_active":"2023-05-17T11:45:36.521068+0000","last_peered":"2023-05-17T11:45:36.521068+0000","last_clean":"2023-05-17T11:45:36.521068+0000","last_became_active":"2023-05-17T11:45:35.535474+0000","last_became_peered":"2023-05-17T11:45:35.535474+0000","last_unstale":"2023-05-17T11:45:36.521068+0000","last_undegraded":"2023-05-17T11:45:36.521068+0000","last_fullsized":"2023-05-17T11:45:36.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:15:20.505190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.178382+0000","last_change":"2023-05-17T11:45:35.546921+0000","last_active":"2023-05-17T11:45:37.178382+0000","last_peered":"2023-05-17T11:45:37.178382+0000","last_clean":"2023-05-17T11:45:37.178382+0000","last_became_active":"2023-05-17T11:45:35.546572+0000","last_became_peered":"2023-05-17T11:45:35.546572+0000","last_unstale":"2023-05-17T11:45:37.178382+0000","last_undegraded":"2023-05-17T11:45:37.178382+0000","last_fullsized":"2023-05-17T11:45:37.178382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:54:20.724175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521192+0000","last_change":"2023-05-17T11:45:35.141081+0000","last_active":"2023-05-17T11:45:36.521192+0000","last_peered":"2023-05-17T11:45:36.521192+0000","last_clean":"2023-05-17T11:45:36.521192+0000","last_became_active":"2023-05-17T11:45:35.140623+0000","last_became_peered":"2023-05-17T11:45:35.140623+0000","last_unstale":"2023-05-17T11:45:36.521192+0000","last_undegraded":"2023-05-17T11:45:36.521192+0000","last_fullsized":"2023-05-17T11:45:36.521192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:49.363470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678524+0000","last_change":"2023-05-17T11:45:35.534028+0000","last_active":"2023-05-17T11:45:37.678524+0000","last_peered":"2023-05-17T11:45:37.678524+0000","last_clean":"2023-05-17T11:45:37.678524+0000","last_became_active":"2023-05-17T11:45:35.533692+0000","last_became_peered":"2023-05-17T11:45:35.533692+0000","last_unstale":"2023-05-17T11:45:37.678524+0000","last_undegraded":"2023-05-17T11:45:37.678524+0000","last_fullsized":"2023-05-17T11:45:37.678524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:30.552392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.519734+0000","last_change":"2023-05-17T11:45:35.146893+0000","last_active":"2023-05-17T11:45:36.519734+0000","last_peered":"2023-05-17T11:45:36.519734+0000","last_clean":"2023-05-17T11:45:36.519734+0000","last_became_active":"2023-05-17T11:45:35.146547+0000","last_became_peered":"2023-05-17T11:45:35.146547+0000","last_unstale":"2023-05-17T11:45:36.519734+0000","last_undegraded":"2023-05-17T11:45:36.519734+0000","last_fullsized":"2023-05-17T11:45:36.519734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:34:29.545146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521823+0000","last_change":"2023-05-17T11:45:35.534371+0000","last_active":"2023-05-17T11:45:36.521823+0000","last_peered":"2023-05-17T11:45:36.521823+0000","last_clean":"2023-05-17T11:45:36.521823+0000","last_became_active":"2023-05-17T11:45:35.534091+0000","last_became_peered":"2023-05-17T11:45:35.534091+0000","last_unstale":"2023-05-17T11:45:36.521823+0000","last_undegraded":"2023-05-17T11:45:36.521823+0000","last_fullsized":"2023-05-17T11:45:36.521823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:25.359500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679490+0000","last_change":"2023-05-17T11:45:35.139454+0000","last_active":"2023-05-17T11:45:37.679490+0000","last_peered":"2023-05-17T11:45:37.679490+0000","last_clean":"2023-05-17T11:45:37.679490+0000","last_became_active":"2023-05-17T11:45:35.138750+0000","last_became_peered":"2023-05-17T11:45:35.138750+0000","last_unstale":"2023-05-17T11:45:37.679490+0000","last_undegraded":"2023-05-17T11:45:37.679490+0000","last_fullsized":"2023-05-17T11:45:37.679490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:03.983943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678086+0000","last_change":"2023-05-17T11:45:35.539372+0000","last_active":"2023-05-17T11:45:37.678086+0000","last_peered":"2023-05-17T11:45:37.678086+0000","last_clean":"2023-05-17T11:45:37.678086+0000","last_became_active":"2023-05-17T11:45:35.539059+0000","last_became_peered":"2023-05-17T11:45:35.539059+0000","last_unstale":"2023-05-17T11:45:37.678086+0000","last_undegraded":"2023-05-17T11:45:37.678086+0000","last_fullsized":"2023-05-17T11:45:37.678086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:31:18.518614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678839+0000","last_change":"2023-05-17T11:45:35.135013+0000","last_active":"2023-05-17T11:45:37.678839+0000","last_peered":"2023-05-17T11:45:37.678839+0000","last_clean":"2023-05-17T11:45:37.678839+0000","last_became_active":"2023-05-17T11:45:35.134702+0000","last_became_peered":"2023-05-17T11:45:35.134702+0000","last_unstale":"2023-05-17T11:45:37.678839+0000","last_undegraded":"2023-05-17T11:45:37.678839+0000","last_fullsized":"2023-05-17T11:45:37.678839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679431+0000","last_change":"2023-05-17T11:45:35.544396+0000","last_active":"2023-05-17T11:45:37.679431+0000","last_peered":"2023-05-17T11:45:37.679431+0000","last_clean":"2023-05-17T11:45:37.679431+0000","last_became_active":"2023-05-17T11:45:35.544113+0000","last_became_peered":"2023-05-17T11:45:35.544113+0000","last_unstale":"2023-05-17T11:45:37.679431+0000","last_undegraded":"2023-05-17T11:45:37.679431+0000","last_fullsized":"2023-05-17T11:45:37.679431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521540+0000","last_change":"2023-05-17T11:45:35.145692+0000","last_active":"2023-05-17T11:45:36.521540+0000","last_peered":"2023-05-17T11:45:36.521540+0000","last_clean":"2023-05-17T11:45:36.521540+0000","last_became_active":"2023-05-17T11:45:35.145352+0000","last_became_peered":"2023-05-17T11:45:35.145352+0000","last_unstale":"2023-05-17T11:45:36.521540+0000","last_undegraded":"2023-05-17T11:45:36.521540+0000","last_fullsized":"2023-05-17T11:45:36.521540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:48:23.324120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679328+0000","last_change":"2023-05-17T11:45:35.527750+0000","last_active":"2023-05-17T11:45:37.679328+0000","last_peered":"2023-05-17T11:45:37.679328+0000","last_clean":"2023-05-17T11:45:37.679328+0000","last_became_active":"2023-05-17T11:45:35.527428+0000","last_became_peered":"2023-05-17T11:45:35.527428+0000","last_unstale":"2023-05-17T11:45:37.679328+0000","last_undegraded":"2023-05-17T11:45:37.679328+0000","last_fullsized":"2023-05-17T11:45:37.679328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:37:33.399976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521918+0000","last_change":"2023-05-17T11:45:35.143811+0000","last_active":"2023-05-17T11:45:36.521918+0000","last_peered":"2023-05-17T11:45:36.521918+0000","last_clean":"2023-05-17T11:45:36.521918+0000","last_became_active":"2023-05-17T11:45:35.142921+0000","last_became_peered":"2023-05-17T11:45:35.142921+0000","last_unstale":"2023-05-17T11:45:36.521918+0000","last_undegraded":"2023-05-17T11:45:36.521918+0000","last_fullsized":"2023-05-17T11:45:36.521918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:59:24.352254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521461+0000","last_change":"2023-05-17T11:45:35.532708+0000","last_active":"2023-05-17T11:45:36.521461+0000","last_peered":"2023-05-17T11:45:36.521461+0000","last_clean":"2023-05-17T11:45:36.521461+0000","last_became_active":"2023-05-17T11:45:35.532426+0000","last_became_peered":"2023-05-17T11:45:35.532426+0000","last_unstale":"2023-05-17T11:45:36.521461+0000","last_undegraded":"2023-05-17T11:45:36.521461+0000","last_fullsized":"2023-05-17T11:45:36.521461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.971765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:36.521732+0000","last_change":"2023-05-17T11:45:35.140853+0000","last_active":"2023-05-17T11:45:36.521732+0000","last_peered":"2023-05-17T11:45:36.521732+0000","last_clean":"2023-05-17T11:45:36.521732+0000","last_became_active":"2023-05-17T11:45:35.140321+0000","last_became_peered":"2023-05-17T11:45:35.140321+0000","last_unstale":"2023-05-17T11:45:36.521732+0000","last_undegraded":"2023-05-17T11:45:36.521732+0000","last_fullsized":"2023-05-17T11:45:36.521732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:42.106008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.679144+0000","last_change":"2023-05-17T11:45:35.551649+0000","last_active":"2023-05-17T11:45:37.679144+0000","last_peered":"2023-05-17T11:45:37.679144+0000","last_clean":"2023-05-17T11:45:37.679144+0000","last_became_active":"2023-05-17T11:45:35.551298+0000","last_became_peered":"2023-05-17T11:45:35.551298+0000","last_unstale":"2023-05-17T11:45:37.679144+0000","last_undegraded":"2023-05-17T11:45:37.679144+0000","last_fullsized":"2023-05-17T11:45:37.679144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:35.109908+0000","last_clean_scrub_stamp":"2023-05-17T11:45:35.109908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:28:50.370716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-17T11:45:37.678588+0000","last_change":"2023-05-17T11:45:35.139188+0000","last_active":"2023-05-17T11:45:37.678588+0000","last_peered":"2023-05-17T11:45:37.678588+0000","last_clean":"2023-05-17T11:45:37.678588+0000","last_became_active":"2023-05-17T11:45:35.138958+0000","last_became_peered":"2023-05-17T11:45:35.138958+0000","last_unstale":"2023-05-17T11:45:37.678588+0000","last_undegraded":"2023-05-17T11:45:37.678588+0000","last_fullsized":"2023-05-17T11:45:37.678588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:34.102662+0000","last_clean_scrub_stamp":"2023-05-17T11:45:34.102662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:48.964519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13204,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358636,"statfs":{"total":96636764160,"available":96623243264,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7519999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12084,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359756,"statfs":{"total":96636764160,"available":96624390144,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12092,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359748,"statfs":{"total":96636764160,"available":96624381952,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12168,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359672,"statfs":{"total":96636764160,"available":96624304128,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T11:45:44.617 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-17T11:45:44.617 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-17T11:45:44.618 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-17T11:45:44.618 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-17T11:45:44.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.779+0000 7f21b1aa8640 1 Processor -- start 2023-05-17T11:45:44.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.779+0000 7f21b1aa8640 1 -- start start 2023-05-17T11:45:44.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b1aa8640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b1aa8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21ac0cf190 0x7f21ac0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b1aa8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac06b3c0 con 0x7f21ac0b1d30 2023-05-17T11:45:44.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b1aa8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0b2100 con 0x7f21ac0cf190 2023-05-17T11:45:44.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b1aa8640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac06b5f0 con 0x7f21ac0d0a40 2023-05-17T11:45:44.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21ac0cf190 0x7f21ac0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21abfff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21ac0cf190 0x7f21ac0cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:56702/0 (socket says 172.21.15.3:56702) 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 -- 172.21.15.3:0/2021919482 learned_addr learned my addr 172.21.15.3:0/2021919482 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 -- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 msgr2=0x7f21ac06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 --2- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac06ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 -- 172.21.15.3:0/2021919482 >> v1:172.21.15.60:6789/0 conn(0x7f21ac0b1d30 legacy=0x7f21ac0d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21b12a7640 1 -- 172.21.15.3:0/2021919482 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac06b8d0 con 0x7f21ac0cf190 2023-05-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.783+0000 7f21abfff640 1 --2- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b12a7640 1 --2- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0cf190 0x7f21ac0cd350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009e50 tx=0x7f21a401f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f54b349a63b75a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21ab7fe640 1 -- 172.21.15.3:0/2021919482 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40af400 con 0x7f21ac0cf190 2023-05-17T11:45:44.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21ab7fe640 1 -- 172.21.15.3:0/2021919482 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a40ab050 con 0x7f21ac0cf190 2023-05-17T11:45:44.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21ab7fe640 1 -- 172.21.15.3:0/2021919482 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40af780 con 0x7f21ac0cf190 2023-05-17T11:45:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0cf190 msgr2=0x7f21ac0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0cf190 0x7f21ac0cd350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009e50 tx=0x7f21a401f1f0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2021919482 shutdown_connections 2023-05-17T11:45:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0cf190 0x7f21ac0cd350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2021919482 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2021919482 >> 172.21.15.3:0/2021919482 conn(0x7f21ac071b00 msgr2=0x7f21ac09bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2021919482 shutdown_connections 2023-05-17T11:45:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2021919482 wait complete. 2023-05-17T11:45:44.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 Processor -- start 2023-05-17T11:45:44.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 -- start start 2023-05-17T11:45:44.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.787+0000 7f21b1aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0b1d30 0x7f21ac157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 0x7f21ac15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac15a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac157a00 con 0x7f21ac0cf190 2023-05-17T11:45:44.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1569c0 con 0x7f21ac0b1d30 2023-05-17T11:45:44.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1f2320 con 0x7f21ac0d0a40 2023-05-17T11:45:44.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 0x7f21ac15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 0x7f21ac15a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51982/0 (socket says 172.21.15.3:51982) 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 -- 172.21.15.3:0/2871971921 learned_addr learned my addr 172.21.15.3:0/2871971921 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b12a7640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac15a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b0aa6640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0b1d30 0x7f21ac157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 -- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 msgr2=0x7f21ac15a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac15a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 -- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0b1d30 msgr2=0x7f21ac157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0b1d30 0x7f21ac157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 -- 172.21.15.3:0/2871971921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009420 con 0x7f21ac0cf190 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21abfff640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 0x7f21ac15a200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f219800e9b0 tx=0x7f219800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800ca00 con 0x7f21ac0cf190 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219800cb60 con 0x7f21ac0cf190 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198013470 con 0x7f21ac0cf190 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a4009b30 con 0x7f21ac0cf190 2023-05-17T11:45:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac0cce50 con 0x7f21ac0cf190 2023-05-17T11:45:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac06bbb0 con 0x7f21ac0cf190 2023-05-17T11:45:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.791+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21980135d0 con 0x7f21ac0cf190 2023-05-17T11:45:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.795+0000 7f21a97fa640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2190066280 0x7f2190068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.795+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2198083eb0 con 0x7f21ac0cf190 2023-05-17T11:45:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.795+0000 7f21b0aa6640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2190066280 0x7f2190068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.795+0000 7f21b0aa6640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2190066280 0x7f2190068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.799+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f21980513e0 con 0x7f21ac0cf190 2023-05-17T11:45:44.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.983+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21ac06be90 con 0x7f21ac0cf190 2023-05-17T11:45:44.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.983+0000 7f21a97fa640 1 -- 172.21.15.3:0/2871971921 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2198054a00 con 0x7f21ac0cf190 2023-05-17T11:45:44.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:44.994 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-17T11:45:44.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2190066280 msgr2=0x7f2190068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2190066280 0x7f2190068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0009040 comp rx=0 tx=0).stop 2023-05-17T11:45:44.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 msgr2=0x7f21ac15a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:44.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 0x7f21ac15a200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f219800e9b0 tx=0x7f219800ee70 comp rx=0 tx=0).stop 2023-05-17T11:45:44.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 shutdown_connections 2023-05-17T11:45:44.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2190066280 0x7f2190068730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f21ac0d0a40 0x7f21ac15a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21ac0cf190 0x7f21ac15a200 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 --2- 172.21.15.3:0/2871971921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21ac0b1d30 0x7f21ac157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:44.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 >> 172.21.15.3:0/2871971921 conn(0x7f21ac071b00 msgr2=0x7f21ac0b7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:44.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 shutdown_connections 2023-05-17T11:45:44.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:44.987+0000 7f21b1aa8640 1 -- 172.21.15.3:0/2871971921 wait complete. 2023-05-17T11:45:45.013 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-17T11:45:45.014 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:45.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 Processor -- start 2023-05-17T11:45:45.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 -- start start 2023-05-17T11:45:45.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe39815be40 0x7fe3980d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980cf010 0x7fe3980cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980d20b0 con 0x7fe3980ccf00 2023-05-17T11:45:45.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980d0710 con 0x7fe39815be40 2023-05-17T11:45:45.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe39ca03640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980cf9d0 con 0x7fe3980cf010 2023-05-17T11:45:45.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe39815be40 0x7fe3980d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe39815be40 0x7fe3980d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51996/0 (socket says 172.21.15.3:51996) 2023-05-17T11:45:45.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 -- 172.21.15.3:0/435575732 learned_addr learned my addr 172.21.15.3:0/435575732 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:45.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 -- 172.21.15.3:0/435575732 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980cf010 msgr2=0x7fe3980cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:45.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 --2- 172.21.15.3:0/435575732 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980cf010 0x7fe3980cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 -- 172.21.15.3:0/435575732 >> v1:172.21.15.60:6789/0 conn(0x7fe3980ccf00 legacy=0x7fe3980d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:45.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.143+0000 7fe396d9d640 1 -- 172.21.15.3:0/435575732 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980d0900 con 0x7fe39815be40 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe396d9d640 1 --2- 172.21.15.3:0/435575732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe39815be40 0x7fe3980d01d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe388009870 tx=0x7fe38801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3267d40fb6923d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39659c640 1 -- 172.21.15.3:0/435575732 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3880a89b0 con 0x7fe39815be40 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39659c640 1 -- 172.21.15.3:0/435575732 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880a8b10 con 0x7fe39815be40 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39659c640 1 -- 172.21.15.3:0/435575732 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3880a8ea0 con 0x7fe39815be40 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 -- 172.21.15.3:0/435575732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe39815be40 msgr2=0x7fe3980d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 --2- 172.21.15.3:0/435575732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe39815be40 0x7fe3980d01d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe388009870 tx=0x7fe38801ecf0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 -- 172.21.15.3:0/435575732 shutdown_connections 2023-05-17T11:45:45.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 --2- 172.21.15.3:0/435575732 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980cf010 0x7fe3980cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 --2- 172.21.15.3:0/435575732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe39815be40 0x7fe3980d01d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 -- 172.21.15.3:0/435575732 >> 172.21.15.3:0/435575732 conn(0x7fe398065a90 msgr2=0x7fe3980711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:45.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 -- 172.21.15.3:0/435575732 shutdown_connections 2023-05-17T11:45:45.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 -- 172.21.15.3:0/435575732 wait complete. 2023-05-17T11:45:45.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.147+0000 7fe39ca03640 1 Processor -- start 2023-05-17T11:45:45.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- start start 2023-05-17T11:45:45.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980ccf00 0x7fe3980b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 0x7fe398156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39815be40 0x7fe398157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39815dac0 con 0x7fe3980cf010 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39815aa40 con 0x7fe39815be40 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c9870 con 0x7fe3980ccf00 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 0x7fe398156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 0x7fe398156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52002/0 (socket says 172.21.15.3:52002) 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 -- 172.21.15.3:0/1636692265 learned_addr learned my addr 172.21.15.3:0/1636692265 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe396d9d640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980ccf00 0x7fe3980b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39759e640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39815be40 0x7fe398157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 -- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980ccf00 msgr2=0x7fe3980b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980ccf00 0x7fe3980b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 -- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39815be40 msgr2=0x7fe398157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39815be40 0x7fe398157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 -- 172.21.15.3:0/1636692265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880094d0 con 0x7fe3980cf010 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38ffff640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 0x7fe398156ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c4c0 tx=0x7fe380001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380005480 con 0x7fe3980cf010 2023-05-17T11:45:45.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380003600 con 0x7fe3980cf010 2023-05-17T11:45:45.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380003990 con 0x7fe3980cf010 2023-05-17T11:45:45.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3980d0ec0 con 0x7fe3980cf010 2023-05-17T11:45:45.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3980d0be0 con 0x7fe3980cf010 2023-05-17T11:45:45.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.151+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3980d11a0 con 0x7fe3980cf010 2023-05-17T11:45:45.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.155+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe380003af0 con 0x7fe3980cf010 2023-05-17T11:45:45.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.155+0000 7fe38f7fe640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe378066280 0x7fe378068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.155+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe380082f40 con 0x7fe3980cf010 2023-05-17T11:45:45.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.155+0000 7fe396d9d640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe378066280 0x7fe378068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.155+0000 7fe396d9d640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe378066280 0x7fe378068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe3880b2000 tx=0x7fe388008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.159+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe380050320 con 0x7fe3980cf010 2023-05-17T11:45:45.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.311+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe39815dc00 con 0x7fe3980cf010 2023-05-17T11:45:45.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe38f7fe640 1 -- 172.21.15.3:0/1636692265 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7fe39815dc00 con 0x7fe3980cf010 2023-05-17T11:45:45.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:45.324 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:45.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe378066280 msgr2=0x7fe378068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe378066280 0x7fe378068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe3880b2000 tx=0x7fe388008040 comp rx=0 tx=0).stop 2023-05-17T11:45:45.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 msgr2=0x7fe398156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 0x7fe398156ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c4c0 tx=0x7fe380001e80 comp rx=0 tx=0).stop 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 shutdown_connections 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe378066280 0x7fe378068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39815be40 0x7fe398157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3980cf010 0x7fe398156ac0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 --2- 172.21.15.3:0/1636692265 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3980ccf00 0x7fe3980b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 >> 172.21.15.3:0/1636692265 conn(0x7fe398065a90 msgr2=0x7fe3980b7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 shutdown_connections 2023-05-17T11:45:45.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.315+0000 7fe39ca03640 1 -- 172.21.15.3:0/1636692265 wait complete. 2023-05-17T11:45:45.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:45:45.345 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:45:45.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.475+0000 7f1a0b59e640 1 Processor -- start 2023-05-17T11:45:45.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.475+0000 7f1a0b59e640 1 -- start start 2023-05-17T11:45:45.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0b59e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a0c0cda00 0x7f1a0c0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0b59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c06f970 0x7f1a0c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0b59e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c15a1b0 con 0x7f1a0c0714f0 2023-05-17T11:45:45.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0b59e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0cf010 con 0x7f1a0c0cda00 2023-05-17T11:45:45.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0b59e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0cdf70 con 0x7f1a0c06f970 2023-05-17T11:45:45.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0a59c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1a0c0714f0 0x7f1a0c0718c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46906/0 (socket says 172.21.15.3:46906) 2023-05-17T11:45:45.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0a59c640 1 -- 172.21.15.3:0/1268525772 learned_addr learned my addr 172.21.15.3:0/1268525772 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:45.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0ad9d640 1 --2- 172.21.15.3:0/1268525772 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c06f970 0x7f1a0c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a09d9b640 1 --2- 172.21.15.3:0/1268525772 >> v2:172.21.15.60:3300/0 conn(0x7f1a0c0cda00 0x7f1a0c0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0959a640 1 -- 172.21.15.3:0/1268525772 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786370556 0 0) 0x7f1a0c15a1b0 con 0x7f1a0c0714f0 2023-05-17T11:45:45.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0959a640 1 -- 172.21.15.3:0/1268525772 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f4003530 con 0x7f1a0c0714f0 2023-05-17T11:45:45.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0ad9d640 1 -- 172.21.15.3:0/1268525772 >> v2:172.21.15.60:3300/0 conn(0x7f1a0c0cda00 msgr2=0x7f1a0c0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:45.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0ad9d640 1 --2- 172.21.15.3:0/1268525772 >> v2:172.21.15.60:3300/0 conn(0x7f1a0c0cda00 0x7f1a0c0cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0ad9d640 1 -- 172.21.15.3:0/1268525772 >> v1:172.21.15.3:6789/0 conn(0x7f1a0c0714f0 legacy=0x7f1a0c0718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0959a640 1 -- 172.21.15.3:0/1268525772 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060484855 0 0) 0x7f19f4003530 con 0x7f1a0c0714f0 2023-05-17T11:45:45.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.479+0000 7f1a0ad9d640 1 -- 172.21.15.3:0/1268525772 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0ce250 con 0x7f1a0c06f970 2023-05-17T11:45:45.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0ad9d640 1 --2- 172.21.15.3:0/1268525772 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c06f970 0x7f1a0c0cc5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009d90 tx=0x7f1a0401c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f58e77ace28a56d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0959a640 1 -- 172.21.15.3:0/1268525772 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc001680 con 0x7f1a0c06f970 2023-05-17T11:45:45.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0959a640 1 -- 172.21.15.3:0/1268525772 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040a5580 con 0x7f1a0c06f970 2023-05-17T11:45:45.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0959a640 1 -- 172.21.15.3:0/1268525772 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040a5910 con 0x7f1a0c06f970 2023-05-17T11:45:45.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1268525772 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c06f970 msgr2=0x7f1a0c0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1268525772 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c06f970 0x7f1a0c0cc5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009d90 tx=0x7f1a0401c780 comp rx=0 tx=0).stop 2023-05-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1268525772 shutdown_connections 2023-05-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1268525772 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c06f970 0x7f1a0c0cc5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1268525772 >> v2:172.21.15.60:3300/0 conn(0x7f1a0c0cda00 0x7f1a0c0cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1268525772 >> 172.21.15.3:0/1268525772 conn(0x7f1a0c069ab0 msgr2=0x7f1a0c069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1268525772 shutdown_connections 2023-05-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1268525772 wait complete. 2023-05-17T11:45:45.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 Processor -- start 2023-05-17T11:45:45.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.483+0000 7f1a0b59e640 1 -- start start 2023-05-17T11:45:45.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 0x7f1a0c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0c0714f0 0x7f1a0c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c0cda00 0x7f1a0c0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c1623e0 con 0x7f1a0c06f970 2023-05-17T11:45:45.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0ca810 con 0x7f1a0c0714f0 2023-05-17T11:45:45.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c97a0 con 0x7f1a0c0cda00 2023-05-17T11:45:45.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 0x7f1a0c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 0x7f1a0c15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52014/0 (socket says 172.21.15.3:52014) 2023-05-17T11:45:45.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 -- 172.21.15.3:0/1952401812 learned_addr learned my addr 172.21.15.3:0/1952401812 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:45.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a09d9b640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0c0714f0 0x7f1a0c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0ad9d640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c0cda00 0x7f1a0c0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 -- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c0cda00 msgr2=0x7f1a0c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c0cda00 0x7f1a0c0c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 -- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0c0714f0 msgr2=0x7f1a0c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0c0714f0 0x7f1a0c154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 -- 172.21.15.3:0/1952401812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009a70 con 0x7f1a0c06f970 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0ad9d640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c0cda00 0x7f1a0c0c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0a59c640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 0x7f1a0c15c410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c760 tx=0x7f19fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc005ae0 con 0x7f1a0c06f970 2023-05-17T11:45:45.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc005c40 con 0x7f1a0c06f970 2023-05-17T11:45:45.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc007070 con 0x7f1a0c06f970 2023-05-17T11:45:45.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c0b0760 con 0x7f1a0c06f970 2023-05-17T11:45:45.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c0ceaf0 con 0x7f1a0c06f970 2023-05-17T11:45:45.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c0caf00 con 0x7f1a0c06f970 2023-05-17T11:45:45.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.487+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19fc0071d0 con 0x7f1a0c06f970 2023-05-17T11:45:45.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.491+0000 7f19faffd640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19ec066280 0x7f19ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.491+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19fc083c10 con 0x7f1a0c06f970 2023-05-17T11:45:45.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.491+0000 7f1a09d9b640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19ec066280 0x7f19ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.491+0000 7f1a09d9b640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19ec066280 0x7f19ec068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c159110 tx=0x7f1a00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.495+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f19fc054a80 con 0x7f1a0c06f970 2023-05-17T11:45:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a0c161e80 con 0x7f1a0c06f970 2023-05-17T11:45:45.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f19faffd640 1 -- 172.21.15.3:0/1952401812 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19fc054610 con 0x7f1a0c06f970 2023-05-17T11:45:45.661 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:45:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19ec066280 msgr2=0x7f19ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19ec066280 0x7f19ec068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c159110 tx=0x7f1a00008040 comp rx=0 tx=0).stop 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 msgr2=0x7f1a0c15c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 0x7f1a0c15c410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c760 tx=0x7f19fc00cc20 comp rx=0 tx=0).stop 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 shutdown_connections 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19ec066280 0x7f19ec068730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1a0c0cda00 0x7f1a0c0c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0c0714f0 0x7f1a0c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 --2- 172.21.15.3:0/1952401812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1a0c06f970 0x7f1a0c15c410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 >> 172.21.15.3:0/1952401812 conn(0x7f1a0c069ab0 msgr2=0x7f1a0c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:45.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 shutdown_connections 2023-05-17T11:45:45.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.651+0000 7f1a0b59e640 1 -- 172.21.15.3:0/1952401812 wait complete. 2023-05-17T11:45:45.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:45:45.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 Processor -- start 2023-05-17T11:45:45.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 -- start start 2023-05-17T11:45:45.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc80009bd90 0x7fc8000ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 0x7fc80006b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80006d020 con 0x7fc8000b2950 2023-05-17T11:45:45.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8000b2d20 con 0x7fc80009bd90 2023-05-17T11:45:45.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc8051f7640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8001591b0 con 0x7fc80006b4d0 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7ff59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 0x7fc80006b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7f7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc80009bd90 0x7fc8000ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7ff59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 0x7fc80006b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:54108/0 (socket says 172.21.15.3:54108) 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7ff59e640 1 -- 172.21.15.3:0/2757151608 learned_addr learned my addr 172.21.15.3:0/2757151608 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7f7fff640 1 -- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 msgr2=0x7fc80006b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7f7fff640 1 --2- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 0x7fc80006b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7f7fff640 1 -- 172.21.15.3:0/2757151608 >> v1:172.21.15.60:6789/0 conn(0x7fc8000b2950 legacy=0x7fc8000cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7f7fff640 1 -- 172.21.15.3:0/2757151608 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8000cc0a0 con 0x7fc80009bd90 2023-05-17T11:45:45.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.811+0000 7fc7ff59e640 1 --2- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 0x7fc80006b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:45.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc7f7fff640 1 --2- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80009bd90 0x7fc8000ad760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097c0 tx=0x7fc7e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20989ae98362e8bb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc7fe59c640 1 -- 172.21.15.3:0/2757151608 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80ab670 con 0x7fc80009bd90 2023-05-17T11:45:45.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc7fe59c640 1 -- 172.21.15.3:0/2757151608 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80ab7d0 con 0x7fc80009bd90 2023-05-17T11:45:45.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc7fe59c640 1 -- 172.21.15.3:0/2757151608 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80abb60 con 0x7fc80009bd90 2023-05-17T11:45:45.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 -- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80009bd90 msgr2=0x7fc8000ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 --2- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80009bd90 0x7fc8000ad760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097c0 tx=0x7fc7e801c450 comp rx=0 tx=0).stop 2023-05-17T11:45:45.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 -- 172.21.15.3:0/2757151608 shutdown_connections 2023-05-17T11:45:45.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 --2- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80006b4d0 0x7fc80006b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 --2- 172.21.15.3:0/2757151608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80009bd90 0x7fc8000ad760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 -- 172.21.15.3:0/2757151608 >> 172.21.15.3:0/2757151608 conn(0x7fc80006a740 msgr2=0x7fc8000cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:45.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 -- 172.21.15.3:0/2757151608 shutdown_connections 2023-05-17T11:45:45.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.815+0000 7fc8051f7640 1 -- 172.21.15.3:0/2757151608 wait complete. 2023-05-17T11:45:45.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 Processor -- start 2023-05-17T11:45:45.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 -- start start 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 0x7fc800145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80009bd90 0x7fc800152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8000b2950 0x7fc800144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80014b3b0 con 0x7fc80006b4d0 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80014b060 con 0x7fc8000b2950 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8001508a0 con 0x7fc80009bd90 2023-05-17T11:45:45.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 0x7fc800145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 0x7fc800145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52020/0 (socket says 172.21.15.3:52020) 2023-05-17T11:45:45.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 -- 172.21.15.3:0/1796537557 learned_addr learned my addr 172.21.15.3:0/1796537557 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:45.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7ff59e640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8000b2950 0x7fc800144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7f7fff640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80009bd90 0x7fc800152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 -- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80009bd90 msgr2=0x7fc800152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80009bd90 0x7fc800152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 -- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8000b2950 msgr2=0x7fc800144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8000b2950 0x7fc800144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 -- 172.21.15.3:0/1796537557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009b30 con 0x7fc80006b4d0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7fed9d640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 0x7fc800145540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c370 tx=0x7fc7f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00052d0 con 0x7fc80006b4d0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f0005430 con 0x7fc80006b4d0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0007260 con 0x7fc80006b4d0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e8009420 con 0x7fc80006b4d0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.819+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8000cb8d0 con 0x7fc80006b4d0 2023-05-17T11:45:45.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.823+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80006d490 con 0x7fc80006b4d0 2023-05-17T11:45:45.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.823+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7f00073c0 con 0x7fc80006b4d0 2023-05-17T11:45:45.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.823+0000 7fc7f77fe640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc7e00662b0 0x7fc7e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:45.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.823+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7f0083080 con 0x7fc80006b4d0 2023-05-17T11:45:45.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.823+0000 7fc7f7fff640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc7e00662b0 0x7fc7e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:45.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.823+0000 7fc7f7fff640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc7e00662b0 0x7fc7e0068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80af000 tx=0x7fc7e80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:45.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.827+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7f00b36f0 con 0x7fc80006b4d0 2023-05-17T11:45:45.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.979+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8000cdfc0 con 0x7fc80006b4d0 2023-05-17T11:45:45.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.979+0000 7fc7f77fe640 1 -- 172.21.15.3:0/1796537557 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7f0050510 con 0x7fc80006b4d0 2023-05-17T11:45:45.990 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:45:45.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc7e00662b0 msgr2=0x7fc7e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc7e00662b0 0x7fc7e0068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80af000 tx=0x7fc7e80a7000 comp rx=0 tx=0).stop 2023-05-17T11:45:45.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 msgr2=0x7fc800145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:45.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 0x7fc800145540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c370 tx=0x7fc7f000c830 comp rx=0 tx=0).stop 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 shutdown_connections 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc7e00662b0 0x7fc7e0068760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8000b2950 0x7fc800144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc80009bd90 0x7fc800152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 --2- 172.21.15.3:0/1796537557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc80006b4d0 0x7fc800145540 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 >> 172.21.15.3:0/1796537557 conn(0x7fc80006a740 msgr2=0x7fc8000cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:45.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 shutdown_connections 2023-05-17T11:45:45.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:45.983+0000 7fc8051f7640 1 -- 172.21.15.3:0/1796537557 wait complete. 2023-05-17T11:45:46.010 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:45:46.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.139+0000 7fe3878c3640 1 Processor -- start 2023-05-17T11:45:46.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.139+0000 7fe3878c3640 1 -- start start 2023-05-17T11:45:46.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe3878c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe38015c220 0x7fe3800afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe3878c3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe3800cd9d0 0x7fe3800b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe3878c3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38006ca60 con 0x7fe3800ad1a0 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe3878c3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38006beb0 con 0x7fe3800cd9d0 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe3878c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38006c130 con 0x7fe38015c220 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe385e60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe3800cd9d0 0x7fe3800b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe384e5e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe3800ad1a0 0x7fe3800cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46914/0 (socket says 172.21.15.3:46914) 2023-05-17T11:45:46.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe384e5e640 1 -- 172.21.15.3:0/2295974149 learned_addr learned my addr 172.21.15.3:0/2295974149 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:46.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe38565f640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe38015c220 0x7fe3800afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe385e60640 1 -- 172.21.15.3:0/2295974149 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe38015c220 msgr2=0x7fe3800afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:46.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe385e60640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe38015c220 0x7fe3800afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe385e60640 1 -- 172.21.15.3:0/2295974149 >> v1:172.21.15.3:6789/0 conn(0x7fe3800ad1a0 legacy=0x7fe3800cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe377fff640 1 -- 172.21.15.3:0/2295974149 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517013413 0 0) 0x7fe38006ca60 con 0x7fe3800ad1a0 2023-05-17T11:45:46.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe385e60640 1 -- 172.21.15.3:0/2295974149 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38006c410 con 0x7fe3800cd9d0 2023-05-17T11:45:46.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.143+0000 7fe38565f640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe38015c220 0x7fe3800afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:46.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe385e60640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3800cd9d0 0x7fe3800b02f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe378009d90 tx=0x7fe37801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6424313cf7aa2199 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe377fff640 1 -- 172.21.15.3:0/2295974149 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780a58f0 con 0x7fe3800cd9d0 2023-05-17T11:45:46.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe377fff640 1 -- 172.21.15.3:0/2295974149 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3780a5a50 con 0x7fe3800cd9d0 2023-05-17T11:45:46.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe377fff640 1 -- 172.21.15.3:0/2295974149 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780a5de0 con 0x7fe3800cd9d0 2023-05-17T11:45:46.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 -- 172.21.15.3:0/2295974149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3800cd9d0 msgr2=0x7fe3800b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3800cd9d0 0x7fe3800b02f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe378009d90 tx=0x7fe37801c890 comp rx=0 tx=0).stop 2023-05-17T11:45:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 -- 172.21.15.3:0/2295974149 shutdown_connections 2023-05-17T11:45:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3800cd9d0 0x7fe3800b02f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 --2- 172.21.15.3:0/2295974149 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe38015c220 0x7fe3800afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 -- 172.21.15.3:0/2295974149 >> 172.21.15.3:0/2295974149 conn(0x7fe38006a740 msgr2=0x7fe3800cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 -- 172.21.15.3:0/2295974149 shutdown_connections 2023-05-17T11:45:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 -- 172.21.15.3:0/2295974149 wait complete. 2023-05-17T11:45:46.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 Processor -- start 2023-05-17T11:45:46.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.147+0000 7fe3878c3640 1 -- start start 2023-05-17T11:45:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800ad1a0 0x7fe380071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3800cd9d0 0x7fe38006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 0x7fe3801558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800709b0 con 0x7fe38015c220 2023-05-17T11:45:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38006feb0 con 0x7fe3800ad1a0 2023-05-17T11:45:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380098a70 con 0x7fe3800cd9d0 2023-05-17T11:45:46.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 0x7fe3801558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 0x7fe3801558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52040/0 (socket says 172.21.15.3:52040) 2023-05-17T11:45:46.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 -- 172.21.15.3:0/439834330 learned_addr learned my addr 172.21.15.3:0/439834330 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:46.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe38565f640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800ad1a0 0x7fe380071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe384e5e640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3800cd9d0 0x7fe38006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 -- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3800cd9d0 msgr2=0x7fe38006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3800cd9d0 0x7fe38006f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 -- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800ad1a0 msgr2=0x7fe380071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800ad1a0 0x7fe380071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 -- 172.21.15.3:0/439834330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009a70 con 0x7fe38015c220 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe384e5e640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3800cd9d0 0x7fe38006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe385e60640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 0x7fe3801558c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe37801a4c0 tx=0x7fe378019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780a58f0 con 0x7fe38015c220 2023-05-17T11:45:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378003ba0 con 0x7fe38015c220 2023-05-17T11:45:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780ad650 con 0x7fe38015c220 2023-05-17T11:45:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe380168dd0 con 0x7fe38015c220 2023-05-17T11:45:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3800cd770 con 0x7fe38015c220 2023-05-17T11:45:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380168f60 con 0x7fe38015c220 2023-05-17T11:45:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.151+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3780b4070 con 0x7fe38015c220 2023-05-17T11:45:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.155+0000 7fe375ffb640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe364066280 0x7fe364068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.155+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe37811eb20 con 0x7fe38015c220 2023-05-17T11:45:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.155+0000 7fe38565f640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe364066280 0x7fe364068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.155+0000 7fe38565f640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe364066280 0x7fe364068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe380158a20 tx=0x7fe37c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.159+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe3780ebf10 con 0x7fe38015c220 2023-05-17T11:45:46.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.311+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe38006d0e0 con 0x7fe38015c220 2023-05-17T11:45:46.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.311+0000 7fe375ffb640 1 -- 172.21.15.3:0/439834330 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3780ef530 con 0x7fe38015c220 2023-05-17T11:45:46.321 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:45:46.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.311+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe364066280 msgr2=0x7fe364068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.311+0000 7fe3878c3640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe364066280 0x7fe364068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe380158a20 tx=0x7fe37c008040 comp rx=0 tx=0).stop 2023-05-17T11:45:46.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 msgr2=0x7fe3801558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 0x7fe3801558c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe37801a4c0 tx=0x7fe378019630 comp rx=0 tx=0).stop 2023-05-17T11:45:46.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 shutdown_connections 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe364066280 0x7fe364068730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38015c220 0x7fe3801558c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3800cd9d0 0x7fe38006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 --2- 172.21.15.3:0/439834330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800ad1a0 0x7fe380071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 >> 172.21.15.3:0/439834330 conn(0x7fe38006a740 msgr2=0x7fe3800c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 shutdown_connections 2023-05-17T11:45:46.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.315+0000 7fe3878c3640 1 -- 172.21.15.3:0/439834330 wait complete. 2023-05-17T11:45:46.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:45:46.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.471+0000 7f43c4139640 1 Processor -- start 2023-05-17T11:45:46.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.471+0000 7f43c4139640 1 -- start start 2023-05-17T11:45:46.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.471+0000 7f43c4139640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43bc0b2950 0x7f43bc09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c4139640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc0adbc0 con 0x7f43bc0ad760 2023-05-17T11:45:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c4139640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc06d020 con 0x7f43bc06b4d0 2023-05-17T11:45:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c4139640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0b2d20 con 0x7f43bc0b2950 2023-05-17T11:45:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c16d4640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f43bc0ad760 0x7f43bc0cd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51338/0 (socket says 172.21.15.3:51338) 2023-05-17T11:45:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c16d4640 1 -- 172.21.15.3:0/1547012817 learned_addr learned my addr 172.21.15.3:0/1547012817 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c1ed5640 1 --2- 172.21.15.3:0/1547012817 >> v2:172.21.15.60:3300/0 conn(0x7f43bc0b2950 0x7f43bc09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c0ed3640 1 -- 172.21.15.3:0/1547012817 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666221498 0 0) 0x7f43ac001120 con 0x7f43bc0ad760 2023-05-17T11:45:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c0ed3640 1 -- 172.21.15.3:0/1547012817 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a8003530 con 0x7f43bc0ad760 2023-05-17T11:45:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c0ed3640 1 -- 172.21.15.3:0/1547012817 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163941306 0 0) 0x7f43a8003530 con 0x7f43bc0ad760 2023-05-17T11:45:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c1ed5640 1 -- 172.21.15.3:0/1547012817 >> v1:172.21.15.60:6789/0 conn(0x7f43bc06b4d0 legacy=0x7f43bc06b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c1ed5640 1 -- 172.21.15.3:0/1547012817 >> v1:172.21.15.3:6789/0 conn(0x7f43bc0ad760 legacy=0x7f43bc0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c1ed5640 1 -- 172.21.15.3:0/1547012817 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc1591b0 con 0x7f43bc0b2950 2023-05-17T11:45:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.475+0000 7f43c1ed5640 1 --2- 172.21.15.3:0/1547012817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc0b2950 0x7f43bc09bd90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f43b80097c0 tx=0x7f43b801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62494f1c6caddf27 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c0ed3640 1 -- 172.21.15.3:0/1547012817 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac001810 con 0x7f43bc0b2950 2023-05-17T11:45:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c0ed3640 1 -- 172.21.15.3:0/1547012817 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b80a7050 con 0x7f43bc0b2950 2023-05-17T11:45:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c0ed3640 1 -- 172.21.15.3:0/1547012817 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80ab620 con 0x7f43bc0b2950 2023-05-17T11:45:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- 172.21.15.3:0/1547012817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc0b2950 msgr2=0x7f43bc09bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 --2- 172.21.15.3:0/1547012817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc0b2950 0x7f43bc09bd90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f43b80097c0 tx=0x7f43b801c370 comp rx=0 tx=0).stop 2023-05-17T11:45:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- 172.21.15.3:0/1547012817 shutdown_connections 2023-05-17T11:45:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 --2- 172.21.15.3:0/1547012817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc0b2950 0x7f43bc09bd90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- 172.21.15.3:0/1547012817 >> 172.21.15.3:0/1547012817 conn(0x7f43bc06a740 msgr2=0x7f43bc0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:46.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- 172.21.15.3:0/1547012817 shutdown_connections 2023-05-17T11:45:46.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- 172.21.15.3:0/1547012817 wait complete. 2023-05-17T11:45:46.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 Processor -- start 2023-05-17T11:45:46.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- start start 2023-05-17T11:45:46.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc06b4d0 0x7f43bc150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43bc0ad760 0x7f43bc0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 0x7f43bc0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c2340 con 0x7f43bc0b2950 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c2620 con 0x7f43bc06b4d0 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c4139640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c2900 con 0x7f43bc0ad760 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c26d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 0x7f43bc0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c26d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 0x7f43bc0afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33920/0 (socket says 172.21.15.3:33920) 2023-05-17T11:45:46.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.479+0000 7f43c26d6640 1 -- 172.21.15.3:0/3688243969 learned_addr learned my addr 172.21.15.3:0/3688243969 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:46.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c16d4640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43bc0ad760 0x7f43bc0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c1ed5640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc06b4d0 0x7f43bc150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c26d6640 1 -- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43bc0ad760 msgr2=0x7f43bc0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c26d6640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43bc0ad760 0x7f43bc0cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c26d6640 1 -- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc06b4d0 msgr2=0x7f43bc150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c26d6640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc06b4d0 0x7f43bc150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c26d6640 1 -- 172.21.15.3:0/3688243969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009420 con 0x7f43bc0b2950 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c26d6640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 0x7f43bc0afb40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c770 tx=0x7f43b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4003b80 con 0x7f43bc0b2950 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4003ce0 con 0x7f43bc0b2950 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc0cc380 con 0x7f43bc0b2950 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400aa90 con 0x7f43bc0b2950 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc06d4b0 con 0x7f43bc0b2950 2023-05-17T11:45:46.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0cb8d0 con 0x7f43bc0b2950 2023-05-17T11:45:46.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43b400abf0 con 0x7f43bc0b2950 2023-05-17T11:45:46.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43b27fc640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43a0066280 0x7f43a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43b4083ae0 con 0x7f43bc0b2950 2023-05-17T11:45:46.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.483+0000 7f43c1ed5640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43a0066280 0x7f43a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.487+0000 7f43c1ed5640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43a0066280 0x7f43a0068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43b80ad000 tx=0x7f43b80a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.487+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f43b4050f80 con 0x7f43bc0b2950 2023-05-17T11:45:46.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.643+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43bc04de80 con 0x7f43bc0b2950 2023-05-17T11:45:46.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.643+0000 7f43b27fc640 1 -- 172.21.15.3:0/3688243969 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43b40545a0 con 0x7f43bc0b2950 2023-05-17T11:45:46.654 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:45:46.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43a0066280 msgr2=0x7f43a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43a0066280 0x7f43a0068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43b80ad000 tx=0x7f43b80a6000 comp rx=0 tx=0).stop 2023-05-17T11:45:46.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 msgr2=0x7f43bc0afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 0x7f43bc0afb40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c770 tx=0x7f43b400cc30 comp rx=0 tx=0).stop 2023-05-17T11:45:46.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 shutdown_connections 2023-05-17T11:45:46.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43a0066280 0x7f43a0068730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43bc0b2950 0x7f43bc0afb40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43bc0ad760 0x7f43bc0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 --2- 172.21.15.3:0/3688243969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43bc06b4d0 0x7f43bc150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 >> 172.21.15.3:0/3688243969 conn(0x7f43bc06a740 msgr2=0x7f43bc06b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:46.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 shutdown_connections 2023-05-17T11:45:46.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.647+0000 7f43c4139640 1 -- 172.21.15.3:0/3688243969 wait complete. 2023-05-17T11:45:46.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:45:46.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.799+0000 7f7232b52640 1 Processor -- start 2023-05-17T11:45:46.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.799+0000 7f7232b52640 1 -- start start 2023-05-17T11:45:46.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f7232b52640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f722c158f10 0x7f722c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f7232b52640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 0x7f722c06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f7232b52640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722c0c92f0 con 0x7f722c071c10 2023-05-17T11:45:46.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f7232b52640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722c06c5f0 con 0x7f722c158f10 2023-05-17T11:45:46.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f7232b52640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722c071480 con 0x7f722c06bc30 2023-05-17T11:45:46.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72310ef640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 0x7f722c06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72308ee640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f722c158f10 0x7f722c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72310ef640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 0x7f722c06c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:42904/0 (socket says 172.21.15.3:42904) 2023-05-17T11:45:46.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72310ef640 1 -- 172.21.15.3:0/2954020028 learned_addr learned my addr 172.21.15.3:0/2954020028 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:46.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72308ee640 1 -- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 msgr2=0x7f722c06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:46.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72308ee640 1 --2- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 0x7f722c06c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72308ee640 1 -- 172.21.15.3:0/2954020028 >> v1:172.21.15.60:6789/0 conn(0x7f722c071c10 legacy=0x7f722c0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72308ee640 1 -- 172.21.15.3:0/2954020028 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c0c8a00 con 0x7f722c158f10 2023-05-17T11:45:46.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.803+0000 7f72310ef640 1 --2- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 0x7f722c06c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:46.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f72308ee640 1 --2- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c158f10 0x7f722c070f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72200097c0 tx=0x7f722001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b3ac225305715fd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f722b7fe640 1 -- 172.21.15.3:0/2954020028 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200ab600 con 0x7f722c158f10 2023-05-17T11:45:46.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f722b7fe640 1 -- 172.21.15.3:0/2954020028 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72200a7050 con 0x7f722c158f10 2023-05-17T11:45:46.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f722b7fe640 1 -- 172.21.15.3:0/2954020028 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200ab980 con 0x7f722c158f10 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 -- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c158f10 msgr2=0x7f722c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 --2- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c158f10 0x7f722c070f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72200097c0 tx=0x7f722001c480 comp rx=0 tx=0).stop 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 -- 172.21.15.3:0/2954020028 shutdown_connections 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 --2- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c06bc30 0x7f722c06c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 --2- 172.21.15.3:0/2954020028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c158f10 0x7f722c070f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 -- 172.21.15.3:0/2954020028 >> 172.21.15.3:0/2954020028 conn(0x7f722c0b0b30 msgr2=0x7f722c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 -- 172.21.15.3:0/2954020028 shutdown_connections 2023-05-17T11:45:46.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 -- 172.21.15.3:0/2954020028 wait complete. 2023-05-17T11:45:46.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 Processor -- start 2023-05-17T11:45:46.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.807+0000 7f7232b52640 1 -- start start 2023-05-17T11:45:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 0x7f722c0c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c071c10 0x7f722c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c158f10 0x7f722c0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c0c5920 con 0x7f722c06bc30 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c0c4e40 con 0x7f722c071c10 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722c0b2210 con 0x7f722c158f10 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 0x7f722c0c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 0x7f722c0c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33932/0 (socket says 172.21.15.3:33932) 2023-05-17T11:45:46.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 -- 172.21.15.3:0/3781085431 learned_addr learned my addr 172.21.15.3:0/3781085431 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f722bfff640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c071c10 0x7f722c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72310ef640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c158f10 0x7f722c0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 -- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c158f10 msgr2=0x7f722c0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c158f10 0x7f722c0b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 -- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c071c10 msgr2=0x7f722c0b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c071c10 0x7f722c0b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 -- 172.21.15.3:0/3781085431 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224009b30 con 0x7f722c06bc30 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f722bfff640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c071c10 0x7f722c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72310ef640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c158f10 0x7f722c0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72308ee640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 0x7f722c0c1ee0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7220019090 tx=0x7f7220019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200abc30 con 0x7f722c06bc30 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72200abdb0 con 0x7f722c06bc30 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200b4640 con 0x7f722c06bc30 2023-05-17T11:45:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220009420 con 0x7f722c06bc30 2023-05-17T11:45:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722c0cc690 con 0x7f722c06bc30 2023-05-17T11:45:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.811+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722c0c8f80 con 0x7f722c06bc30 2023-05-17T11:45:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.815+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72200b2040 con 0x7f722c06bc30 2023-05-17T11:45:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.815+0000 7f72297fa640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7210066280 0x7f7210068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.815+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f722011d6c0 con 0x7f722c06bc30 2023-05-17T11:45:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.815+0000 7f722bfff640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7210066280 0x7f7210068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.815+0000 7f722bfff640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7210066280 0x7f7210068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f722c0c7520 tx=0x7f7218009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:46.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:46.819+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f72200eaaa0 con 0x7f722c06bc30 2023-05-17T11:45:47.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.003+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f722c069ab0 con 0x7f722c06bc30 2023-05-17T11:45:47.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.003+0000 7f72297fa640 1 -- 172.21.15.3:0/3781085431 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f72200ee0c0 con 0x7f722c06bc30 2023-05-17T11:45:47.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:47.013 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:45:47.014 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:45:47.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7210066280 msgr2=0x7f7210068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7210066280 0x7f7210068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f722c0c7520 tx=0x7f7218009040 comp rx=0 tx=0).stop 2023-05-17T11:45:47.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 msgr2=0x7f722c0c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 0x7f722c0c1ee0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7220019090 tx=0x7f7220019220 comp rx=0 tx=0).stop 2023-05-17T11:45:47.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 shutdown_connections 2023-05-17T11:45:47.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7210066280 0x7f7210068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f722c158f10 0x7f722c0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f722c071c10 0x7f722c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 --2- 172.21.15.3:0/3781085431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f722c06bc30 0x7f722c0c1ee0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 >> 172.21.15.3:0/3781085431 conn(0x7f722c0b0b30 msgr2=0x7f722c152cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:47.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 shutdown_connections 2023-05-17T11:45:47.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.007+0000 7f7232b52640 1 -- 172.21.15.3:0/3781085431 wait complete. 2023-05-17T11:45:47.034 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 Processor -- start 2023-05-17T11:45:47.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 -- start start 2023-05-17T11:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940b1d30 0x7ff69406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6940cf190 0x7ff6940d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69406b3c0 con 0x7ff6940d0870 2023-05-17T11:45:47.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940b2100 con 0x7ff6940cf190 2023-05-17T11:45:47.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff698c12640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940d0c90 con 0x7ff6940b1d30 2023-05-17T11:45:47.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff6937fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940b1d30 0x7ff69406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6940cf190 0x7ff6940d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6940cf190 0x7ff6940d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:45042/0 (socket says 172.21.15.3:45042) 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff6937fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940b1d30 0x7ff69406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:42922/0 (socket says 172.21.15.3:42922) 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 -- 172.21.15.3:0/2956923452 learned_addr learned my addr 172.21.15.3:0/2956923452 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 -- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940b1d30 msgr2=0x7ff69406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 --2- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940b1d30 0x7ff69406ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 -- 172.21.15.3:0/2956923452 >> v1:172.21.15.60:6789/0 conn(0x7ff6940d0870 legacy=0x7ff6940b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.163+0000 7ff692ffd640 1 -- 172.21.15.3:0/2956923452 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69406b5f0 con 0x7ff6940cf190 2023-05-17T11:45:47.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff692ffd640 1 --2- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6940d0330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff688009870 tx=0x7ff68801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da97a4b84923778b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff6927fc640 1 -- 172.21.15.3:0/2956923452 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6880a8a30 con 0x7ff6940cf190 2023-05-17T11:45:47.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff6927fc640 1 -- 172.21.15.3:0/2956923452 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6880a8b90 con 0x7ff6940cf190 2023-05-17T11:45:47.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff6927fc640 1 -- 172.21.15.3:0/2956923452 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6880b0440 con 0x7ff6940cf190 2023-05-17T11:45:47.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 -- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 msgr2=0x7ff6940d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 --2- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6940d0330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff688009870 tx=0x7ff68801ed30 comp rx=0 tx=0).stop 2023-05-17T11:45:47.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 -- 172.21.15.3:0/2956923452 shutdown_connections 2023-05-17T11:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 --2- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6940d0330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 --2- 172.21.15.3:0/2956923452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940b1d30 0x7ff69406ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 -- 172.21.15.3:0/2956923452 >> 172.21.15.3:0/2956923452 conn(0x7ff694071b00 msgr2=0x7ff69409bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 -- 172.21.15.3:0/2956923452 shutdown_connections 2023-05-17T11:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 -- 172.21.15.3:0/2956923452 wait complete. 2023-05-17T11:45:47.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.167+0000 7ff698c12640 1 Processor -- start 2023-05-17T11:45:47.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- start start 2023-05-17T11:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 0x7ff6941f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6941f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940d0870 0x7ff6941f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6941f6430 con 0x7ff6940b1d30 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6941f6710 con 0x7ff6940cf190 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6941f69f0 con 0x7ff6940d0870 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 0x7ff6941f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 0x7ff6941f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33934/0 (socket says 172.21.15.3:33934) 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 -- 172.21.15.3:0/736267616 learned_addr learned my addr 172.21.15.3:0/736267616 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff692ffd640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6941f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff693fff640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940d0870 0x7ff6941f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 -- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940d0870 msgr2=0x7ff6941f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940d0870 0x7ff6941f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 -- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 msgr2=0x7ff6941f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6941f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 -- 172.21.15.3:0/736267616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6880094d0 con 0x7ff6940b1d30 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff692ffd640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6941f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff6937fe640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 0x7ff6941f6c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff68400e930 tx=0x7ff68400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684009690 con 0x7ff6940b1d30 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68400ca00 con 0x7ff6940b1d30 2023-05-17T11:45:47.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400cd70 con 0x7ff6940b1d30 2023-05-17T11:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69406bbb0 con 0x7ff6940b1d30 2023-05-17T11:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69406b8d0 con 0x7ff6940b1d30 2023-05-17T11:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.171+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940cce50 con 0x7ff6940b1d30 2023-05-17T11:45:47.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.175+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff684013470 con 0x7ff6940b1d30 2023-05-17T11:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.175+0000 7ff67bfff640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff680066280 0x7ff680068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.175+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff684083ee0 con 0x7ff6940b1d30 2023-05-17T11:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.175+0000 7ff692ffd640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff680066280 0x7ff680068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.175+0000 7ff692ffd640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff680066280 0x7ff680068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6880b2000 tx=0x7ff688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.179+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff6840514c0 con 0x7ff6940b1d30 2023-05-17T11:45:47.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.331+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff69415e170 con 0x7ff6940b1d30 2023-05-17T11:45:47.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff67bfff640 1 -- 172.21.15.3:0/736267616 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7ff69415e170 con 0x7ff6940b1d30 2023-05-17T11:45:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:47.344 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:47.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff680066280 msgr2=0x7ff680068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff680066280 0x7ff680068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6880b2000 tx=0x7ff688009040 comp rx=0 tx=0).stop 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 msgr2=0x7ff6941f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 0x7ff6941f6c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff68400e930 tx=0x7ff68400edf0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 shutdown_connections 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff680066280 0x7ff680068730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff6940d0870 0x7ff6941f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6940cf190 0x7ff6941f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 --2- 172.21.15.3:0/736267616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6940b1d30 0x7ff6941f6c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 >> 172.21.15.3:0/736267616 conn(0x7ff694071b00 msgr2=0x7ff6940cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 shutdown_connections 2023-05-17T11:45:47.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.335+0000 7ff698c12640 1 -- 172.21.15.3:0/736267616 wait complete. 2023-05-17T11:45:47.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:45:47.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:45:47.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f9942125640 1 Processor -- start 2023-05-17T11:45:47.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f9942125640 1 -- start start 2023-05-17T11:45:47.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f9942125640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f993c0b2950 0x7f993c09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f9942125640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c0adbc0 con 0x7f993c0ad760 2023-05-17T11:45:47.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f9942125640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c06d020 con 0x7f993c06b4d0 2023-05-17T11:45:47.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f9942125640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c0b2d20 con 0x7f993c0b2950 2023-05-17T11:45:47.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f993affd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f993c0ad760 0x7f993c0cd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51352/0 (socket says 172.21.15.3:51352) 2023-05-17T11:45:47.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f993affd640 1 -- 172.21.15.3:0/2497053741 learned_addr learned my addr 172.21.15.3:0/2497053741 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:47.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.495+0000 7f993b7fe640 1 --2- 172.21.15.3:0/2497053741 >> v2:172.21.15.3:3300/0 conn(0x7f993c0b2950 0x7f993c09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993a7fc640 1 -- 172.21.15.3:0/2497053741 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039098653 0 0) 0x7f9930001120 con 0x7f993c0ad760 2023-05-17T11:45:47.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993a7fc640 1 -- 172.21.15.3:0/2497053741 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9924005740 con 0x7f993c0ad760 2023-05-17T11:45:47.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993b7fe640 1 -- 172.21.15.3:0/2497053741 >> v1:172.21.15.60:6789/0 conn(0x7f993c06b4d0 legacy=0x7f993c06b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993b7fe640 1 -- 172.21.15.3:0/2497053741 >> v1:172.21.15.3:6789/0 conn(0x7f993c0ad760 legacy=0x7f993c0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993b7fe640 1 -- 172.21.15.3:0/2497053741 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c1591b0 con 0x7f993c0b2950 2023-05-17T11:45:47.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993b7fe640 1 --2- 172.21.15.3:0/2497053741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c09bd90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097c0 tx=0x7f992c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c9eb209db04608 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993a7fc640 1 -- 172.21.15.3:0/2497053741 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0ac630 con 0x7f993c0b2950 2023-05-17T11:45:47.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993a7fc640 1 -- 172.21.15.3:0/2497053741 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c0ac790 con 0x7f993c0b2950 2023-05-17T11:45:47.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f993a7fc640 1 -- 172.21.15.3:0/2497053741 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0acb20 con 0x7f993c0b2950 2023-05-17T11:45:47.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f9942125640 1 -- 172.21.15.3:0/2497053741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 msgr2=0x7f993c09bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f9942125640 1 --2- 172.21.15.3:0/2497053741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c09bd90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097c0 tx=0x7f992c01c450 comp rx=0 tx=0).stop 2023-05-17T11:45:47.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f9942125640 1 -- 172.21.15.3:0/2497053741 shutdown_connections 2023-05-17T11:45:47.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f9942125640 1 --2- 172.21.15.3:0/2497053741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c09bd90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.499+0000 7f9942125640 1 -- 172.21.15.3:0/2497053741 >> 172.21.15.3:0/2497053741 conn(0x7f993c06a740 msgr2=0x7f993c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:47.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- 172.21.15.3:0/2497053741 shutdown_connections 2023-05-17T11:45:47.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- 172.21.15.3:0/2497053741 wait complete. 2023-05-17T11:45:47.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 Processor -- start 2023-05-17T11:45:47.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- start start 2023-05-17T11:45:47.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f993c06b4d0 0x7f993c14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ad760 0x7f993c0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0b0db0 con 0x7f993c0b2950 2023-05-17T11:45:47.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c15c2b0 con 0x7f993c0ad760 2023-05-17T11:45:47.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c14a6b0 con 0x7f993c06b4d0 2023-05-17T11:45:47.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c0ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33960/0 (socket says 172.21.15.3:33960) 2023-05-17T11:45:47.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 -- 172.21.15.3:0/3096340016 learned_addr learned my addr 172.21.15.3:0/3096340016 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:47.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993b7fe640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f993c06b4d0 0x7f993c14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993affd640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ad760 0x7f993c0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 -- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f993c06b4d0 msgr2=0x7f993c14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f993c06b4d0 0x7f993c14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 -- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ad760 msgr2=0x7f993c0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ad760 0x7f993c0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 -- 172.21.15.3:0/3096340016 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009420 con 0x7f993c0b2950 2023-05-17T11:45:47.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993affd640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ad760 0x7f993c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:47.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f993bfff640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c0ae1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f993400c770 tx=0x7f993400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934003b80 con 0x7f993c0b2950 2023-05-17T11:45:47.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934003ce0 con 0x7f993c0b2950 2023-05-17T11:45:47.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c0cc380 con 0x7f993c0b2950 2023-05-17T11:45:47.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.503+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400aa90 con 0x7f993c0b2950 2023-05-17T11:45:47.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c06d4b0 con 0x7f993c0b2950 2023-05-17T11:45:47.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c0cb8d0 con 0x7f993c0b2950 2023-05-17T11:45:47.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f993400abf0 con 0x7f993c0b2950 2023-05-17T11:45:47.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f9923fff640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9928066280 0x7f9928068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9934083ba0 con 0x7f993c0b2950 2023-05-17T11:45:47.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f993b7fe640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9928066280 0x7f9928068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.507+0000 7f993b7fe640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9928066280 0x7f9928068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f992c0ae000 tx=0x7f992c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.511+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9934050f80 con 0x7f993c0b2950 2023-05-17T11:45:47.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f993c04de80 con 0x7f993c0b2950 2023-05-17T11:45:47.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9923fff640 1 -- 172.21.15.3:0/3096340016 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9934058e60 con 0x7f993c0b2950 2023-05-17T11:45:47.677 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:45:47.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9928066280 msgr2=0x7f9928068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9928066280 0x7f9928068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f992c0ae000 tx=0x7f992c008040 comp rx=0 tx=0).stop 2023-05-17T11:45:47.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 msgr2=0x7f993c0ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c0ae1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f993400c770 tx=0x7f993400cc30 comp rx=0 tx=0).stop 2023-05-17T11:45:47.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 shutdown_connections 2023-05-17T11:45:47.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9928066280 0x7f9928068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f993c0b2950 0x7f993c0ae1f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ad760 0x7f993c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 --2- 172.21.15.3:0/3096340016 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f993c06b4d0 0x7f993c14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 >> 172.21.15.3:0/3096340016 conn(0x7f993c06a740 msgr2=0x7f993c14fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.667+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 shutdown_connections 2023-05-17T11:45:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.671+0000 7f9942125640 1 -- 172.21.15.3:0/3096340016 wait complete. 2023-05-17T11:45:47.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:45:47.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.827+0000 7efefe59b640 1 Processor -- start 2023-05-17T11:45:47.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.827+0000 7efefe59b640 1 -- start start 2023-05-17T11:45:47.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefe59b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efef81602e0 0x7efef80ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefe59b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefe59b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef80cbba0 con 0x7efef80b01a0 2023-05-17T11:45:47.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefe59b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef80c8e30 con 0x7efef81602e0 2023-05-17T11:45:47.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefe59b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef80b0620 con 0x7efef8164910 2023-05-17T11:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efef81602e0 0x7efef80ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efef81602e0 0x7efef80ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33972/0 (socket says 172.21.15.3:33972) 2023-05-17T11:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 -- 172.21.15.3:0/2217210610 learned_addr learned my addr 172.21.15.3:0/2217210610 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefcd98640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 -- 172.21.15.3:0/2217210610 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 msgr2=0x7efef80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 -- 172.21.15.3:0/2217210610 >> v1:172.21.15.60:6789/0 conn(0x7efef80b01a0 legacy=0x7efef8070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefd599640 1 -- 172.21.15.3:0/2217210610 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef80c8870 con 0x7efef81602e0 2023-05-17T11:45:47.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.831+0000 7efefcd98640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:47.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefd599640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef81602e0 0x7efef80ca2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efef4009870 tx=0x7efef401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94a66efe237a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efeeffff640 1 -- 172.21.15.3:0/2217210610 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40aa430 con 0x7efef81602e0 2023-05-17T11:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efeeffff640 1 -- 172.21.15.3:0/2217210610 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef40aa590 con 0x7efef81602e0 2023-05-17T11:45:47.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efeeffff640 1 -- 172.21.15.3:0/2217210610 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40aa920 con 0x7efef81602e0 2023-05-17T11:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 -- 172.21.15.3:0/2217210610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef81602e0 msgr2=0x7efef80ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef81602e0 0x7efef80ca2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efef4009870 tx=0x7efef401c4d0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 -- 172.21.15.3:0/2217210610 shutdown_connections 2023-05-17T11:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 --2- 172.21.15.3:0/2217210610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef81602e0 0x7efef80ca2c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 -- 172.21.15.3:0/2217210610 >> 172.21.15.3:0/2217210610 conn(0x7efef8069ab0 msgr2=0x7efef8069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:47.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 -- 172.21.15.3:0/2217210610 shutdown_connections 2023-05-17T11:45:47.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 -- 172.21.15.3:0/2217210610 wait complete. 2023-05-17T11:45:47.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 Processor -- start 2023-05-17T11:45:47.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.835+0000 7efefe59b640 1 -- start start 2023-05-17T11:45:47.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 0x7efef8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef81602e0 0x7efef81609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef8160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef8159810 con 0x7efef80b01a0 2023-05-17T11:45:47.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef815fb10 con 0x7efef81602e0 2023-05-17T11:45:47.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef81591c0 con 0x7efef8164910 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 0x7efef8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 0x7efef8153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33984/0 (socket says 172.21.15.3:33984) 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 -- 172.21.15.3:0/1642441992 learned_addr learned my addr 172.21.15.3:0/1642441992 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefcd98640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef81602e0 0x7efef81609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefdd9a640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef8160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 -- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 msgr2=0x7efef8160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef8160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 -- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef81602e0 msgr2=0x7efef81609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:47.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef81602e0 0x7efef81609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:47.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 -- 172.21.15.3:0/1642441992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40094d0 con 0x7efef80b01a0 2023-05-17T11:45:47.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefdd9a640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef8160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:47.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefd599640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 0x7efef8153d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efef40ac040 tx=0x7efef401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40aa430 con 0x7efef80b01a0 2023-05-17T11:45:47.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef40b3800 con 0x7efef80b01a0 2023-05-17T11:45:47.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40b3bb0 con 0x7efef80b01a0 2023-05-17T11:45:47.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef8164ce0 con 0x7efef80b01a0 2023-05-17T11:45:47.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef80cd720 con 0x7efef80b01a0 2023-05-17T11:45:47.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef81606b0 con 0x7efef80b01a0 2023-05-17T11:45:47.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.839+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efef40b3d10 con 0x7efef80b01a0 2023-05-17T11:45:47.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.843+0000 7efeedffb640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efedc066280 0x7efedc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:47.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.843+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efef411e720 con 0x7efef80b01a0 2023-05-17T11:45:47.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.843+0000 7efefcd98640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efedc066280 0x7efedc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:47.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.843+0000 7efefcd98640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efedc066280 0x7efedc068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efef81586e0 tx=0x7efee8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:47.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.847+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efef40ebb90 con 0x7efef80b01a0 2023-05-17T11:45:48.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.999+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efef8159950 con 0x7efef80b01a0 2023-05-17T11:45:48.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:47.999+0000 7efeedffb640 1 -- 172.21.15.3:0/1642441992 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7efef40ef1b0 con 0x7efef80b01a0 2023-05-17T11:45:48.010 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:45:48.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efedc066280 msgr2=0x7efedc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efedc066280 0x7efedc068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efef81586e0 tx=0x7efee8008040 comp rx=0 tx=0).stop 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 msgr2=0x7efef8153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 0x7efef8153d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efef40ac040 tx=0x7efef401ad10 comp rx=0 tx=0).stop 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 shutdown_connections 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efedc066280 0x7efedc068730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efef8164910 0x7efef8160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef81602e0 0x7efef81609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 --2- 172.21.15.3:0/1642441992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efef80b01a0 0x7efef8153d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 >> 172.21.15.3:0/1642441992 conn(0x7efef8069ab0 msgr2=0x7efef80b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:48.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 shutdown_connections 2023-05-17T11:45:48.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.003+0000 7efefe59b640 1 -- 172.21.15.3:0/1642441992 wait complete. 2023-05-17T11:45:48.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:45:48.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.159+0000 7faf4b6c3640 1 Processor -- start 2023-05-17T11:45:48.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 -- start start 2023-05-17T11:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf4415d3d0 0x7faf440ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faf440ad440 0x7faf440b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440cdf90 con 0x7faf440ad440 2023-05-17T11:45:48.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4409bcb0 con 0x7faf4415d3d0 2023-05-17T11:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4b6c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4409bf00 con 0x7faf440cd2c0 2023-05-17T11:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faf440ad440 0x7faf440b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faf440ad440 0x7faf440b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33990/0 (socket says 172.21.15.3:33990) 2023-05-17T11:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 -- 172.21.15.3:0/1091946470 learned_addr learned my addr 172.21.15.3:0/1091946470 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 -- 172.21.15.3:0/1091946470 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 msgr2=0x7faf440afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 --2- 172.21.15.3:0/1091946470 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 -- 172.21.15.3:0/1091946470 >> v2:172.21.15.60:3300/0 conn(0x7faf4415d3d0 msgr2=0x7faf440ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4945f640 1 --2- 172.21.15.3:0/1091946470 >> v2:172.21.15.60:3300/0 conn(0x7faf4415d3d0 0x7faf440ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 --2- 172.21.15.3:0/1091946470 >> v2:172.21.15.60:3300/0 conn(0x7faf4415d3d0 0x7faf440ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf49c60640 1 -- 172.21.15.3:0/1091946470 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf440ca3d0 con 0x7faf440ad440 2023-05-17T11:45:48.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.163+0000 7faf4945f640 1 --2- 172.21.15.3:0/1091946470 >> v2:172.21.15.60:3300/0 conn(0x7faf4415d3d0 0x7faf440ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:48.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf49c60640 1 --2- 172.21.15.3:0/1091946470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf440ad440 0x7faf440b02f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf44078e50 tx=0x7faf3c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17489adce274e0c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf3bfff640 1 -- 172.21.15.3:0/1091946470 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0a5630 con 0x7faf440ad440 2023-05-17T11:45:48.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf3bfff640 1 -- 172.21.15.3:0/1091946470 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0a5790 con 0x7faf440ad440 2023-05-17T11:45:48.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf3bfff640 1 -- 172.21.15.3:0/1091946470 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0a5b20 con 0x7faf440ad440 2023-05-17T11:45:48.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 -- 172.21.15.3:0/1091946470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf440ad440 msgr2=0x7faf440b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/1091946470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf440ad440 0x7faf440b02f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf44078e50 tx=0x7faf3c01c960 comp rx=0 tx=0).stop 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 -- 172.21.15.3:0/1091946470 shutdown_connections 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/1091946470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf440ad440 0x7faf440b02f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/1091946470 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/1091946470 >> v2:172.21.15.60:3300/0 conn(0x7faf4415d3d0 0x7faf440ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 -- 172.21.15.3:0/1091946470 >> 172.21.15.3:0/1091946470 conn(0x7faf4406a740 msgr2=0x7faf440cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 -- 172.21.15.3:0/1091946470 shutdown_connections 2023-05-17T11:45:48.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 -- 172.21.15.3:0/1091946470 wait complete. 2023-05-17T11:45:48.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 Processor -- start 2023-05-17T11:45:48.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.167+0000 7faf4b6c3640 1 -- start start 2023-05-17T11:45:48.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440ad440 0x7faf44151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 0x7faf441f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440addd0 con 0x7faf4415d3d0 2023-05-17T11:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44153580 con 0x7faf440ad440 2023-05-17T11:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf440ada30 con 0x7faf440cd2c0 2023-05-17T11:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 0x7faf441f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 0x7faf441f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33998/0 (socket says 172.21.15.3:33998) 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 -- 172.21.15.3:0/3710907510 learned_addr learned my addr 172.21.15.3:0/3710907510 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4945f640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440ad440 0x7faf44151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf48c5e640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 -- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 msgr2=0x7faf440c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 -- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440ad440 msgr2=0x7faf44151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440ad440 0x7faf44151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 -- 172.21.15.3:0/3710907510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c009b30 con 0x7faf4415d3d0 2023-05-17T11:45:48.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf49c60640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 0x7faf441f60a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf3c01b010 tx=0x7faf3c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0b8670 con 0x7faf4415d3d0 2023-05-17T11:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0b87f0 con 0x7faf4415d3d0 2023-05-17T11:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0b8ba0 con 0x7faf4415d3d0 2023-05-17T11:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf440c92b0 con 0x7faf4415d3d0 2023-05-17T11:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf440c9120 con 0x7faf4415d3d0 2023-05-17T11:45:48.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf440c9440 con 0x7faf4415d3d0 2023-05-17T11:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.171+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf3c0b8d00 con 0x7faf4415d3d0 2023-05-17T11:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.175+0000 7faf39ffb640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7faf28066280 0x7faf28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.175+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf3c11f1d0 con 0x7faf4415d3d0 2023-05-17T11:45:48.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.175+0000 7faf4945f640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7faf28066280 0x7faf28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.175+0000 7faf4945f640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7faf28066280 0x7faf28068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faf40006fd0 tx=0x7faf40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.179+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faf3c0ec810 con 0x7faf4415d3d0 2023-05-17T11:45:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.330+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf4404de80 con 0x7faf4415d3d0 2023-05-17T11:45:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.330+0000 7faf39ffb640 1 -- 172.21.15.3:0/3710907510 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf3c0efe30 con 0x7faf4415d3d0 2023-05-17T11:45:48.342 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:45:48.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7faf28066280 msgr2=0x7faf28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7faf28066280 0x7faf28068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faf40006fd0 tx=0x7faf40008040 comp rx=0 tx=0).stop 2023-05-17T11:45:48.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 msgr2=0x7faf441f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 0x7faf441f60a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf3c01b010 tx=0x7faf3c019700 comp rx=0 tx=0).stop 2023-05-17T11:45:48.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 shutdown_connections 2023-05-17T11:45:48.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7faf28066280 0x7faf28068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf4415d3d0 0x7faf441f60a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7faf440cd2c0 0x7faf440c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 --2- 172.21.15.3:0/3710907510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440ad440 0x7faf44151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 >> 172.21.15.3:0/3710907510 conn(0x7faf4406a740 msgr2=0x7faf44153970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:48.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 shutdown_connections 2023-05-17T11:45:48.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.334+0000 7faf4b6c3640 1 -- 172.21.15.3:0/3710907510 wait complete. 2023-05-17T11:45:48.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:45:48.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.490+0000 7f9b424c3640 1 Processor -- start 2023-05-17T11:45:48.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.490+0000 7f9b424c3640 1 -- start start 2023-05-17T11:45:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b424c3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b3c15c0b0 0x7f9b3c070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b424c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b424c3640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c15fd30 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b424c3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c15d540 con 0x7f9b3c15c0b0 2023-05-17T11:45:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b424c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c15cca0 con 0x7f9b3c15c480 2023-05-17T11:45:48.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b3c15c0b0 0x7f9b3c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b3c15c0b0 0x7f9b3c070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34000/0 (socket says 172.21.15.3:34000) 2023-05-17T11:45:48.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 -- 172.21.15.3:0/2341371469 learned_addr learned my addr 172.21.15.3:0/2341371469 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:48.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3b7fe640 1 --2- 172.21.15.3:0/2341371469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 -- 172.21.15.3:0/2341371469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 msgr2=0x7f9b3c0cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:48.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 --2- 172.21.15.3:0/2341371469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c0cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 -- 172.21.15.3:0/2341371469 >> v1:172.21.15.60:6789/0 conn(0x7f9b3c0cb0b0 legacy=0x7f9b3c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.494+0000 7f9b3bfff640 1 -- 172.21.15.3:0/2341371469 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c15cf80 con 0x7f9b3c15c0b0 2023-05-17T11:45:48.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b3bfff640 1 --2- 172.21.15.3:0/2341371469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c070310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc44ff91bae465b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b3affd640 1 -- 172.21.15.3:0/2341371469 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0ab620 con 0x7f9b3c15c0b0 2023-05-17T11:45:48.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b3affd640 1 -- 172.21.15.3:0/2341371469 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0ab780 con 0x7f9b3c15c0b0 2023-05-17T11:45:48.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b3affd640 1 -- 172.21.15.3:0/2341371469 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0abb10 con 0x7f9b3c15c0b0 2023-05-17T11:45:48.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 -- 172.21.15.3:0/2341371469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c15c0b0 msgr2=0x7f9b3c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 --2- 172.21.15.3:0/2341371469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c070310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c01c510 comp rx=0 tx=0).stop 2023-05-17T11:45:48.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 -- 172.21.15.3:0/2341371469 shutdown_connections 2023-05-17T11:45:48.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 --2- 172.21.15.3:0/2341371469 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c0cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 --2- 172.21.15.3:0/2341371469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c070310 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 -- 172.21.15.3:0/2341371469 >> 172.21.15.3:0/2341371469 conn(0x7f9b3c0d05b0 msgr2=0x7f9b3c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:48.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 -- 172.21.15.3:0/2341371469 shutdown_connections 2023-05-17T11:45:48.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 -- 172.21.15.3:0/2341371469 wait complete. 2023-05-17T11:45:48.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 Processor -- start 2023-05-17T11:45:48.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.498+0000 7f9b424c3640 1 -- start start 2023-05-17T11:45:48.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 0x7f9b3c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c06be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c3cf0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c3fd0 con 0x7f9b3c15c0b0 2023-05-17T11:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c42b0 con 0x7f9b3c15c480 2023-05-17T11:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 0x7f9b3c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 0x7f9b3c0c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34010/0 (socket says 172.21.15.3:34010) 2023-05-17T11:45:48.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 -- 172.21.15.3:0/4224379587 learned_addr learned my addr 172.21.15.3:0/4224379587 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3b7fe640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 -- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 msgr2=0x7f9b3c06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 -- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b3c15c0b0 msgr2=0x7f9b3c142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 -- 172.21.15.3:0/4224379587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0094d0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b3bfff640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 0x7f9b3c0c8000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ad040 tx=0x7f9b2c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0be3f0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0be570 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0be920 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c15c9e0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c15c850 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c168ea0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.502+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b2c0b43f0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.506+0000 7f9b38ff9640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b28066280 0x7f9b28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.506+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b2c11dfe0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.506+0000 7f9b3b7fe640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b28066280 0x7f9b28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.506+0000 7f9b3b7fe640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b28066280 0x7f9b28068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0c8c70 tx=0x7f9b30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.510+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9b2c0eb510 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.666+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b3c0c43f0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.666+0000 7f9b38ff9640 1 -- 172.21.15.3:0/4224379587 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b3c0c43f0 con 0x7f9b3c0cb0b0 2023-05-17T11:45:48.678 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:45:48.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b28066280 msgr2=0x7f9b28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b28066280 0x7f9b28068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0c8c70 tx=0x7f9b30008040 comp rx=0 tx=0).stop 2023-05-17T11:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 msgr2=0x7f9b3c0c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 0x7f9b3c0c8000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ad040 tx=0x7f9b2c01ad50 comp rx=0 tx=0).stop 2023-05-17T11:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 shutdown_connections 2023-05-17T11:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b28066280 0x7f9b28068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b3c15c480 0x7f9b3c06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b3c15c0b0 0x7f9b3c142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 --2- 172.21.15.3:0/4224379587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b3c0cb0b0 0x7f9b3c0c8000 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 >> 172.21.15.3:0/4224379587 conn(0x7f9b3c0d05b0 msgr2=0x7f9b3c0cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 shutdown_connections 2023-05-17T11:45:48.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.670+0000 7f9b424c3640 1 -- 172.21.15.3:0/4224379587 wait complete. 2023-05-17T11:45:48.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:45:48.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 Processor -- start 2023-05-17T11:45:48.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 -- start start 2023-05-17T11:45:48.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c0d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f5c0d33f0 0x7f1f5c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c0af450 con 0x7f1f5c15c180 2023-05-17T11:45:48.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c0af730 con 0x7f1f5c0d33f0 2023-05-17T11:45:48.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f6090a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0afa10 con 0x7f1f5c0d0b20 2023-05-17T11:45:48.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5a59c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1f5c15c180 0x7f1f5c0d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51362/0 (socket says 172.21.15.3:51362) 2023-05-17T11:45:48.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5a59c640 1 -- 172.21.15.3:0/645718853 learned_addr learned my addr 172.21.15.3:0/645718853 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:48.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5ad9d640 1 --2- 172.21.15.3:0/645718853 >> v2:172.21.15.60:3300/0 conn(0x7f1f5c0d33f0 0x7f1f5c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f53fff640 1 --2- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c0d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f59d9b640 1 -- 172.21.15.3:0/645718853 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332790432 0 0) 0x7f1f5c0af450 con 0x7f1f5c15c180 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f59d9b640 1 -- 172.21.15.3:0/645718853 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f48003530 con 0x7f1f5c15c180 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 msgr2=0x7f1f5c0d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5ad9d640 1 --2- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c0d2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/645718853 >> v1:172.21.15.3:6789/0 conn(0x7f1f5c15c180 legacy=0x7f1f5c0d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.826+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/645718853 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0afcf0 con 0x7f1f5c0d33f0 2023-05-17T11:45:48.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f5ad9d640 1 --2- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c0b04f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009d90 tx=0x7f1f5401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c77e595d525e747 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f59d9b640 1 -- 172.21.15.3:0/645718853 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540a58f0 con 0x7f1f5c0d33f0 2023-05-17T11:45:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f59d9b640 1 -- 172.21.15.3:0/645718853 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f540a5a50 con 0x7f1f5c0d33f0 2023-05-17T11:45:48.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f59d9b640 1 -- 172.21.15.3:0/645718853 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540a5de0 con 0x7f1f5c0d33f0 2023-05-17T11:45:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 -- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 msgr2=0x7f1f5c0b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 --2- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c0b04f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009d90 tx=0x7f1f5401c920 comp rx=0 tx=0).stop 2023-05-17T11:45:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 -- 172.21.15.3:0/645718853 shutdown_connections 2023-05-17T11:45:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 --2- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c0d2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 --2- 172.21.15.3:0/645718853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c0b04f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 -- 172.21.15.3:0/645718853 >> 172.21.15.3:0/645718853 conn(0x7f1f5c071b00 msgr2=0x7f1f5c09bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 -- 172.21.15.3:0/645718853 shutdown_connections 2023-05-17T11:45:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.830+0000 7f1f6090a640 1 -- 172.21.15.3:0/645718853 wait complete. 2023-05-17T11:45:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 Processor -- start 2023-05-17T11:45:48.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 -- start start 2023-05-17T11:45:48.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 0x7f1f5c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c145340 con 0x7f1f5c15c180 2023-05-17T11:45:48.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c153cc0 con 0x7f1f5c0d33f0 2023-05-17T11:45:48.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1530b0 con 0x7f1f5c0d0b20 2023-05-17T11:45:48.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 0x7f1f5c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 0x7f1f5c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34018/0 (socket says 172.21.15.3:34018) 2023-05-17T11:45:48.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/3606129797 learned_addr learned my addr 172.21.15.3:0/3606129797 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f53fff640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5a59c640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 msgr2=0x7f1f5c144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 msgr2=0x7f1f5c1556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c1556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 -- 172.21.15.3:0/3606129797 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f54009a70 con 0x7f1f5c15c180 2023-05-17T11:45:48.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f5ad9d640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 0x7f1f5c155c00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f540b0040 tx=0x7f1f540196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540b9860 con 0x7f1f5c15c180 2023-05-17T11:45:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f540b99c0 con 0x7f1f5c15c180 2023-05-17T11:45:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540b9d70 con 0x7f1f5c15c180 2023-05-17T11:45:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c15c6e0 con 0x7f1f5c15c180 2023-05-17T11:45:48.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.834+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c15c550 con 0x7f1f5c15c180 2023-05-17T11:45:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.838+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c0b1240 con 0x7f1f5c15c180 2023-05-17T11:45:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.838+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f540c4460 con 0x7f1f5c15c180 2023-05-17T11:45:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.838+0000 7f1f52ffd640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1f3c066280 0x7f1f3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:48.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.838+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f5411efe0 con 0x7f1f5c15c180 2023-05-17T11:45:48.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.838+0000 7f1f5a59c640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1f3c066280 0x7f1f3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:48.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.838+0000 7f1f5a59c640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1f3c066280 0x7f1f3c068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0011f0 tx=0x7f1f4c007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:48.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:48.842+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1f540ec490 con 0x7f1f5c15c180 2023-05-17T11:45:49.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.026+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f5c04de80 con 0x7f1f5c15c180 2023-05-17T11:45:49.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f52ffd640 1 -- 172.21.15.3:0/3606129797 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f1f540b2090 con 0x7f1f5c15c180 2023-05-17T11:45:49.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:49.039 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:45:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:45:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1f3c066280 msgr2=0x7f1f3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1f3c066280 0x7f1f3c068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0011f0 tx=0x7f1f4c007d40 comp rx=0 tx=0).stop 2023-05-17T11:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 msgr2=0x7f1f5c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 0x7f1f5c155c00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f540b0040 tx=0x7f1f540196c0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 shutdown_connections 2023-05-17T11:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1f3c066280 0x7f1f3c068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f5c15c180 0x7f1f5c155c00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5c0d33f0 0x7f1f5c1556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 --2- 172.21.15.3:0/3606129797 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1f5c0d0b20 0x7f1f5c144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 >> 172.21.15.3:0/3606129797 conn(0x7f1f5c071b00 msgr2=0x7f1f5c0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 shutdown_connections 2023-05-17T11:45:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.030+0000 7f1f6090a640 1 -- 172.21.15.3:0/3606129797 wait complete. 2023-05-17T11:45:49.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa9831f3640 1 Processor -- start 2023-05-17T11:45:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa9831f3640 1 -- start start 2023-05-17T11:45:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa9831f3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa97c0ce9e0 0x7fa97c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa9831f3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c160c20 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa9831f3640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c160f00 con 0x7fa97c0d0430 2023-05-17T11:45:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa9831f3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97c15ce10 con 0x7fa97c0ce9e0 2023-05-17T11:45:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa981790640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa97c0ce9e0 0x7fa97c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa97bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa97c0d0fd0 0x7fa97c0d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51370/0 (socket says 172.21.15.3:51370) 2023-05-17T11:45:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa97bfff640 1 -- 172.21.15.3:0/2702738210 learned_addr learned my addr 172.21.15.3:0/2702738210 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa981790640 1 -- 172.21.15.3:0/2702738210 >> v1:172.21.15.60:6789/0 conn(0x7fa97c0d0430 legacy=0x7fa97c15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa981790640 1 -- 172.21.15.3:0/2702738210 >> v1:172.21.15.3:6789/0 conn(0x7fa97c0d0fd0 legacy=0x7fa97c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.186+0000 7fa981790640 1 -- 172.21.15.3:0/2702738210 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c15d0f0 con 0x7fa97c0ce9e0 2023-05-17T11:45:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa981790640 1 --2- 172.21.15.3:0/2702738210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0ce9e0 0x7fa97c0ce410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa974009d90 tx=0x7fa97401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f2308ca6dc430d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa97b7fe640 1 -- 172.21.15.3:0/2702738210 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740a5a30 con 0x7fa97c0ce9e0 2023-05-17T11:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa97b7fe640 1 -- 172.21.15.3:0/2702738210 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9740a5b90 con 0x7fa97c0ce9e0 2023-05-17T11:45:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa97b7fe640 1 -- 172.21.15.3:0/2702738210 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740ad440 con 0x7fa97c0ce9e0 2023-05-17T11:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 -- 172.21.15.3:0/2702738210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0ce9e0 msgr2=0x7fa97c0ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 --2- 172.21.15.3:0/2702738210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0ce9e0 0x7fa97c0ce410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa974009d90 tx=0x7fa97401c950 comp rx=0 tx=0).stop 2023-05-17T11:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 -- 172.21.15.3:0/2702738210 shutdown_connections 2023-05-17T11:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 --2- 172.21.15.3:0/2702738210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0ce9e0 0x7fa97c0ce410 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 -- 172.21.15.3:0/2702738210 >> 172.21.15.3:0/2702738210 conn(0x7fa97c09bb70 msgr2=0x7fa97c0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 -- 172.21.15.3:0/2702738210 shutdown_connections 2023-05-17T11:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.190+0000 7fa9831f3640 1 -- 172.21.15.3:0/2702738210 wait complete. 2023-05-17T11:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 Processor -- start 2023-05-17T11:45:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 -- start start 2023-05-17T11:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa97c0ce9e0 0x7fa97c148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa97c0d0430 0x7fa97c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 0x7fa97c153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c155540 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c154d30 con 0x7fa97c0d0430 2023-05-17T11:45:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c149470 con 0x7fa97c0ce9e0 2023-05-17T11:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 0x7fa97c153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 0x7fa97c153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34036/0 (socket says 172.21.15.3:34036) 2023-05-17T11:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 -- 172.21.15.3:0/1378249737 learned_addr learned my addr 172.21.15.3:0/1378249737 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa97bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa97c0d0430 0x7fa97c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa980f8f640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa97c0ce9e0 0x7fa97c148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 -- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa97c0ce9e0 msgr2=0x7fa97c148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa97c0ce9e0 0x7fa97c148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 -- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa97c0d0430 msgr2=0x7fa97c153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa97c0d0430 0x7fa97c153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 -- 172.21.15.3:0/1378249737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974009a70 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa981790640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 0x7fa97c153970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9740b0040 tx=0x7fa9740196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740ade40 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa974009450 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740b9690 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c0cd850 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.194+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c0cd6c0 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.198+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97c0cd9e0 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.198+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9740b97f0 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.198+0000 7fa9797fa640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa960066280 0x7fa960068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.198+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa97411f560 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.198+0000 7fa980f8f640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa960066280 0x7fa960068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.198+0000 7fa980f8f640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa960066280 0x7fa960068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa97c14fbf0 tx=0x7fa970009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.202+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa9740ecb10 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa97c1492d0 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9797fa640 1 -- 172.21.15.3:0/1378249737 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7fa97c1492d0 con 0x7fa97c0d0fd0 2023-05-17T11:45:49.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:49.372 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:45:49.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa960066280 msgr2=0x7fa960068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa960066280 0x7fa960068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa97c14fbf0 tx=0x7fa970009040 comp rx=0 tx=0).stop 2023-05-17T11:45:49.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 msgr2=0x7fa97c153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 0x7fa97c153970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9740b0040 tx=0x7fa9740196f0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 shutdown_connections 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa960066280 0x7fa960068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa97c0d0fd0 0x7fa97c153970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa97c0d0430 0x7fa97c153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 --2- 172.21.15.3:0/1378249737 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa97c0ce9e0 0x7fa97c148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 >> 172.21.15.3:0/1378249737 conn(0x7fa97c09bb70 msgr2=0x7fa97c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 shutdown_connections 2023-05-17T11:45:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.362+0000 7fa9831f3640 1 -- 172.21.15.3:0/1378249737 wait complete. 2023-05-17T11:45:49.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:45:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.518+0000 7f9e36820640 1 Processor -- start 2023-05-17T11:45:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.518+0000 7f9e36820640 1 -- start start 2023-05-17T11:45:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e36820640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9e300716d0 0x7f9e3006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e36820640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e3015a2e0 0x7f9e30071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e36820640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e300ca490 con 0x7f9e300c9fd0 2023-05-17T11:45:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e36820640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e300cacf0 con 0x7f9e300716d0 2023-05-17T11:45:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e36820640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30070140 con 0x7f9e3015a2e0 2023-05-17T11:45:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9e300716d0 0x7f9e3006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9e300716d0 0x7f9e3006fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34052/0 (socket says 172.21.15.3:34052) 2023-05-17T11:45:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 -- 172.21.15.3:0/592160636 learned_addr learned my addr 172.21.15.3:0/592160636 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2f7fe640 1 --2- 172.21.15.3:0/592160636 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e3015a2e0 0x7f9e30071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 -- 172.21.15.3:0/592160636 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e3015a2e0 msgr2=0x7f9e30071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 --2- 172.21.15.3:0/592160636 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e3015a2e0 0x7f9e30071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 -- 172.21.15.3:0/592160636 >> v1:172.21.15.60:6789/0 conn(0x7f9e300c9fd0 legacy=0x7f9e300b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 -- 172.21.15.3:0/592160636 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30071fe0 con 0x7f9e300716d0 2023-05-17T11:45:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2ffff640 1 --2- 172.21.15.3:0/592160636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300716d0 0x7f9e3006fc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009870 tx=0x7f9e2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97fd3e46863e89b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2effd640 1 -- 172.21.15.3:0/592160636 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200aa5f0 con 0x7f9e300716d0 2023-05-17T11:45:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2effd640 1 -- 172.21.15.3:0/592160636 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e200aa750 con 0x7f9e300716d0 2023-05-17T11:45:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.522+0000 7f9e2effd640 1 -- 172.21.15.3:0/592160636 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200aaae0 con 0x7f9e300716d0 2023-05-17T11:45:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- 172.21.15.3:0/592160636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300716d0 msgr2=0x7f9e3006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 --2- 172.21.15.3:0/592160636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300716d0 0x7f9e3006fc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009870 tx=0x7f9e2001c4d0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- 172.21.15.3:0/592160636 shutdown_connections 2023-05-17T11:45:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 --2- 172.21.15.3:0/592160636 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e3015a2e0 0x7f9e30071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 --2- 172.21.15.3:0/592160636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300716d0 0x7f9e3006fc00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- 172.21.15.3:0/592160636 >> 172.21.15.3:0/592160636 conn(0x7f9e300b0b30 msgr2=0x7f9e300cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- 172.21.15.3:0/592160636 shutdown_connections 2023-05-17T11:45:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- 172.21.15.3:0/592160636 wait complete. 2023-05-17T11:45:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 Processor -- start 2023-05-17T11:45:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- start start 2023-05-17T11:45:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e300716d0 0x7f9e30154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 0x7f9e300ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3015a2e0 0x7f9e3015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30155270 con 0x7f9e300c9fd0 2023-05-17T11:45:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30155550 con 0x7f9e3015a2e0 2023-05-17T11:45:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e36820640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30155830 con 0x7f9e300716d0 2023-05-17T11:45:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e2f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 0x7f9e300ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e2f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 0x7f9e300ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34062/0 (socket says 172.21.15.3:34062) 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e2f7fe640 1 -- 172.21.15.3:0/2862867583 learned_addr learned my addr 172.21.15.3:0/2862867583 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e2ffff640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e300716d0 0x7f9e30154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.526+0000 7f9e34dbd640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3015a2e0 0x7f9e3015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2f7fe640 1 -- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e300716d0 msgr2=0x7f9e30154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2f7fe640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e300716d0 0x7f9e30154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2f7fe640 1 -- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3015a2e0 msgr2=0x7f9e3015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2f7fe640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3015a2e0 0x7f9e3015a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2f7fe640 1 -- 172.21.15.3:0/2862867583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200094d0 con 0x7f9e300c9fd0 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2f7fe640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 0x7f9e300ace40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400d7d0 tx=0x7f9e2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400b6c0 con 0x7f9e300c9fd0 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2400b820 con 0x7f9e300c9fd0 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400bbd0 con 0x7f9e300c9fd0 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e300c8e80 con 0x7f9e300c9fd0 2023-05-17T11:45:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e300c8ba0 con 0x7f9e300c9fd0 2023-05-17T11:45:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e300b1910 con 0x7f9e300c9fd0 2023-05-17T11:45:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e2400bd30 con 0x7f9e300c9fd0 2023-05-17T11:45:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2cff9640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9e1c0662b0 0x7f9e1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e240841d0 con 0x7f9e300c9fd0 2023-05-17T11:45:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.530+0000 7f9e2ffff640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9e1c0662b0 0x7f9e1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.534+0000 7f9e2ffff640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9e1c0662b0 0x7f9e1c068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e200ae000 tx=0x7f9e200b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:49.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.534+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9e24051660 con 0x7f9e300c9fd0 2023-05-17T11:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e30159a20 con 0x7f9e300c9fd0 2023-05-17T11:45:49.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e2cff9640 1 -- 172.21.15.3:0/2862867583 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f9e24054c80 con 0x7f9e300c9fd0 2023-05-17T11:45:49.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:45:49.733 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:45:49.733 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9e1c0662b0 msgr2=0x7f9e1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9e1c0662b0 0x7f9e1c068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e200ae000 tx=0x7f9e200b5040 comp rx=0 tx=0).stop 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 msgr2=0x7f9e300ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 0x7f9e300ace40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400d7d0 tx=0x7f9e2400dc90 comp rx=0 tx=0).stop 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 shutdown_connections 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9e1c0662b0 0x7f9e1c068760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3015a2e0 0x7f9e3015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e300c9fd0 0x7f9e300ace40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 --2- 172.21.15.3:0/2862867583 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9e300716d0 0x7f9e30154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 >> 172.21.15.3:0/2862867583 conn(0x7f9e300b0b30 msgr2=0x7f9e300b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 shutdown_connections 2023-05-17T11:45:49.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:49.722+0000 7f9e36820640 1 -- 172.21.15.3:0/2862867583 wait complete. 2023-05-17T11:45:50.155 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T11:45:35.508081+0000', 'modified': '2023-05-17T11:45:38.523243+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6835/3866363606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6833', 'nonce': 3866363606}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 3866363606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-17T11:45:50.155 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T11:45:50.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-17T11:45:50.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.286+0000 7f8c33f39640 1 Processor -- start 2023-05-17T11:45:50.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.286+0000 7f8c33f39640 1 -- start start 2023-05-17T11:45:50.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c33f39640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c163b50 0x7f8c2c0ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c33f39640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8c2c0ad860 0x7f8c2c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c33f39640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8c2c0b1770 0x7f8c2c0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c33f39640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c90d0 con 0x7f8c2c0b1770 2023-05-17T11:45:50.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c33f39640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cb990 con 0x7f8c2c0ad860 2023-05-17T11:45:50.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c33f39640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cbc30 con 0x7f8c2c163b50 2023-05-17T11:45:50.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8c2c0b1770 0x7f8c2c0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8c2c0b1770 0x7f8c2c0c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34074/0 (socket says 172.21.15.3:34074) 2023-05-17T11:45:50.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 -- 172.21.15.3:0/869625942 learned_addr learned my addr 172.21.15.3:0/869625942 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c314d4640 1 --2- 172.21.15.3:0/869625942 >> v2:172.21.15.60:3300/0 conn(0x7f8c2c0ad860 0x7f8c2c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c163b50 0x7f8c2c0ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 -- 172.21.15.3:0/869625942 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c163b50 msgr2=0x7f8c2c0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c163b50 0x7f8c2c0ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 -- 172.21.15.3:0/869625942 >> v2:172.21.15.60:3300/0 conn(0x7f8c2c0ad860 msgr2=0x7f8c2c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 --2- 172.21.15.3:0/869625942 >> v2:172.21.15.60:3300/0 conn(0x7f8c2c0ad860 0x7f8c2c0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 -- 172.21.15.3:0/869625942 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0c8d60 con 0x7f8c2c0b1770 2023-05-17T11:45:50.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c314d4640 1 --2- 172.21.15.3:0/869625942 >> v2:172.21.15.60:3300/0 conn(0x7f8c2c0ad860 0x7f8c2c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:50.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c163b50 0x7f8c2c0ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:50.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.290+0000 7f8c324d6640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0c9560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0680c0 tx=0x7f8c2401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da013877a4432acc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c30cd3640 1 -- 172.21.15.3:0/869625942 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240a56e0 con 0x7f8c2c0b1770 2023-05-17T11:45:50.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c30cd3640 1 -- 172.21.15.3:0/869625942 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240a5840 con 0x7f8c2c0b1770 2023-05-17T11:45:50.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c30cd3640 1 -- 172.21.15.3:0/869625942 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240a5bd0 con 0x7f8c2c0b1770 2023-05-17T11:45:50.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- 172.21.15.3:0/869625942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c0b1770 msgr2=0x7f8c2c0c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0c9560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0680c0 tx=0x7f8c2401c9d0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- 172.21.15.3:0/869625942 shutdown_connections 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0c9560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- 172.21.15.3:0/869625942 >> v2:172.21.15.60:3300/0 conn(0x7f8c2c0ad860 0x7f8c2c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- 172.21.15.3:0/869625942 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c163b50 0x7f8c2c0ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- 172.21.15.3:0/869625942 >> 172.21.15.3:0/869625942 conn(0x7f8c2c0b0b20 msgr2=0x7f8c2c0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- 172.21.15.3:0/869625942 shutdown_connections 2023-05-17T11:45:50.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- 172.21.15.3:0/869625942 wait complete. 2023-05-17T11:45:50.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 Processor -- start 2023-05-17T11:45:50.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- start start 2023-05-17T11:45:50.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c0ad860 0x7f8c2c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 0x7f8c2c0c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c15b3c0 con 0x7f8c2c163b50 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ab820 con 0x7f8c2c0b1770 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.294+0000 7f8c33f39640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0abb00 con 0x7f8c2c0ad860 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 0x7f8c2c0c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 0x7f8c2c0c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34086/0 (socket says 172.21.15.3:34086) 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 -- 172.21.15.3:0/1728363621 learned_addr learned my addr 172.21.15.3:0/1728363621 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 -- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c0ad860 msgr2=0x7f8c2c15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c314d4640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c0ad860 0x7f8c2c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 -- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c2c0b1770 msgr2=0x7f8c2c0aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 -- 172.21.15.3:0/1728363621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24009b30 con 0x7f8c2c163b50 2023-05-17T11:45:50.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c314d4640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:45:50.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 0x7f8c2c0c3720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c240af040 tx=0x7f8c24019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c227fc640 1 -- 172.21.15.3:0/1728363621 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240b8670 con 0x7f8c2c163b50 2023-05-17T11:45:50.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c227fc640 1 -- 172.21.15.3:0/1728363621 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240b87d0 con 0x7f8c2c163b50 2023-05-17T11:45:50.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c069ab0 con 0x7f8c2c163b50 2023-05-17T11:45:50.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c227fc640 1 -- 172.21.15.3:0/1728363621 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240b8b80 con 0x7f8c2c163b50 2023-05-17T11:45:50.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0cccf0 con 0x7f8c2c163b50 2023-05-17T11:45:50.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.298+0000 7f8c227fc640 1 -- 172.21.15.3:0/1728363621 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c240b8ce0 con 0x7f8c2c163b50 2023-05-17T11:45:50.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c227fc640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c10066280 0x7f8c10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c227fc640 1 -- 172.21.15.3:0/1728363621 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c2411f430 con 0x7f8c2c163b50 2023-05-17T11:45:50.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c10066280 0x7f8c10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 Processor -- start 2023-05-17T11:45:50.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- start start 2023-05-17T11:45:50.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c10066280 0x7f8c10068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800a810 tx=0x7f8c28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd89d760 0x55e3cd89db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd850ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 0x55e3cd8513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd71b310 con 0x55e3cd851020 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd655980 con 0x55e3cd89d760 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd6a9040 con 0x55e3cd89e070 2023-05-17T11:45:50.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 0x55e3cd8513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c314d4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd850ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c31cd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd89d760 0x55e3cd89db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c314d4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd850ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:43058/0 (socket says 172.21.15.3:43058) 2023-05-17T11:45:50.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c31cd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd89d760 0x55e3cd89db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:45138/0 (socket says 172.21.15.3:45138) 2023-05-17T11:45:50.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c314d4640 1 -- 172.21.15.3:0/1829648345 learned_addr learned my addr 172.21.15.3:0/1829648345 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 0x55e3cd8513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34098/0 (socket says 172.21.15.3:34098) 2023-05-17T11:45:50.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 -- 172.21.15.3:0/1829648345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 msgr2=0x55e3cd850ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd850ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 -- 172.21.15.3:0/1829648345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd89d760 msgr2=0x55e3cd89db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd89d760 0x55e3cd89db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 -- 172.21.15.3:0/1829648345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3cd6670b0 con 0x55e3cd851020 2023-05-17T11:45:50.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 0x55e3cd8513f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c2411d760 tx=0x7f8c240f4610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86ebc747a75e824 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c0f7fe640 1 -- 172.21.15.3:0/1829648345 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240ecca0 con 0x55e3cd851020 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c0f7fe640 1 -- 172.21.15.3:0/1829648345 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240ece00 con 0x55e3cd851020 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c0f7fe640 1 -- 172.21.15.3:0/1829648345 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240f40d0 con 0x55e3cd851020 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- 172.21.15.3:0/1829648345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 msgr2=0x55e3cd8513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 0x55e3cd8513f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c2411d760 tx=0x7f8c240f4610 comp rx=0 tx=0).stop 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- 172.21.15.3:0/1829648345 shutdown_connections 2023-05-17T11:45:50.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd851020 0x55e3cd8513f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd850ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1829648345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd89d760 0x55e3cd89db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- 172.21.15.3:0/1829648345 >> 172.21.15.3:0/1829648345 conn(0x55e3cd87e710 msgr2=0x55e3cd880af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- 172.21.15.3:0/1829648345 shutdown_connections 2023-05-17T11:45:50.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.302+0000 7f8c372b0000 1 -- 172.21.15.3:0/1829648345 wait complete. 2023-05-17T11:45:50.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- start start 2023-05-17T11:45:50.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 Processor -- start 2023-05-17T11:45:50.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd87dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd855fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd856500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd6a20e0 con 0x55e3cd89d760 2023-05-17T11:45:50.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd65ebd0 con 0x55e3cd851020 2023-05-17T11:45:50.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd65e870 con 0x55e3cd89e070 2023-05-17T11:45:50.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 10 client.0 _ll_register_callbacks cb 0x55e3cd83ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T11:45:50.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd855fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c31cd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd87dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd855fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34110/0 (socket says 172.21.15.3:34110) 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 -- 172.21.15.3:0/1594841993 learned_addr learned my addr 172.21.15.3:0/1594841993 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c324d6640 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd856500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 -- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 msgr2=0x55e3cd856500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd856500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 -- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 msgr2=0x55e3cd87dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd87dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 -- 172.21.15.3:0/1594841993 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0cccf0 con 0x55e3cd89d760 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c314d4640 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd855fc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0106d0 tx=0x7f8c1c010b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf41e3e6a0ae3936 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c0cff9640 1 -- 172.21.15.3:0/1594841993 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00ea10 con 0x55e3cd89d760 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3cd69d8b0 con 0x55e3cd89d760 2023-05-17T11:45:50.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c0cff9640 1 -- 172.21.15.3:0/1594841993 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c1c00eb70 con 0x55e3cd89d760 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c0cff9640 1 -- 172.21.15.3:0/1594841993 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c1c00ed30 con 0x55e3cd89d760 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 10 client.4692 fetch_fsmap learned FSMap version 8 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e3cd39e890 con 0x55e3cd89d760 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c0cff9640 1 -- 172.21.15.3:0/1594841993 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3cd69d8b0 con 0x55e3cd89d760 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c0cff9640 1 -- 172.21.15.3:0/1594841993 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8c1c01a020 con 0x55e3cd89d760 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 10 client.4692 fetch_fsmap finished waiting for FSMap version 8 2023-05-17T11:45:50.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 10 client.4692 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 20 client.4692 populate_metadata read hostname 'smithi003' 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd856f10 0x55e3cd8572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 4 client.4692 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 --> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3cd6d0f70 con 0x55e3cd856f10 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.306+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd856f10 0x55e3cd8572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd856f10 0x55e3cd8572e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e21469abcf94a0 server_cookie=7106c50222c6b4c2 in_seq=0 out_seq=0 2023-05-17T11:45:50.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c0cff9640 10 client.4692 ms_handle_connect on v2:172.21.15.60:6833/3866363606 2023-05-17T11:45:50.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c0cff9640 1 -- 172.21.15.3:0/1594841993 <== mds.0 v2:172.21.15.60:6833/3866363606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e3cd6d0f70 con 0x55e3cd856f10 2023-05-17T11:45:50.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c0cff9640 10 client.4692 handle_command_reply: tid=0 2023-05-17T11:45:50.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 client.4692 shutdown 2023-05-17T11:45:50.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 msgr2=0x55e3cd855fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd855fc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0106d0 tx=0x7f8c1c010b90 comp rx=0 tx=0).stop 2023-05-17T11:45:50.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 shutdown_connections 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd856f10 0x55e3cd8572e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89e070 0x55e3cd856500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd855fc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c0cff9640 0 client.4692 ms_handle_reset on v2:172.21.15.60:6833/3866363606 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 --2- 172.21.15.3:0/1594841993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd87dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 >> 172.21.15.3:0/1594841993 conn(0x55e3cd87e710 msgr2=0x55e3cd880af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 shutdown_connections 2023-05-17T11:45:50.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 1 -- 172.21.15.3:0/1594841993 wait complete. 2023-05-17T11:45:50.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.310+0000 7f8c372b0000 20 client.4692 trim_cache size 0 max 16384 2023-05-17T11:45:50.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 Processor -- start 2023-05-17T11:45:50.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 -- start start 2023-05-17T11:45:50.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 0x55e3cd89ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd89bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89d760 0x55e3cd89c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd35f940 con 0x55e3cd87e710 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd39f1b0 con 0x55e3cd851020 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd853630 con 0x55e3cd89d760 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 0x55e3cd89ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 0x55e3cd89ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34118/0 (socket says 172.21.15.3:34118) 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 -- 172.21.15.3:0/414265316 learned_addr learned my addr 172.21.15.3:0/414265316 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c314d4640 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd89bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c324d6640 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89d760 0x55e3cd89c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 -- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89d760 msgr2=0x55e3cd89c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89d760 0x55e3cd89c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 -- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 msgr2=0x55e3cd89bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd89bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 -- 172.21.15.3:0/414265316 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3cd667360 con 0x55e3cd87e710 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c314d4640 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd89bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 0x55e3cd89ba20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800afd0 tx=0x7f8c28012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cf257fda15d7d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c0ffff640 1 -- 172.21.15.3:0/414265316 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28027070 con 0x55e3cd87e710 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c0ffff640 1 -- 172.21.15.3:0/414265316 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28027290 con 0x55e3cd87e710 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.326+0000 7f8c0ffff640 1 -- 172.21.15.3:0/414265316 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28027600 con 0x55e3cd87e710 2023-05-17T11:45:50.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/414265316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 msgr2=0x55e3cd89ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 0x55e3cd89ba20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800afd0 tx=0x7f8c28012000 comp rx=0 tx=0).stop 2023-05-17T11:45:50.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/414265316 shutdown_connections 2023-05-17T11:45:50.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd89d760 0x55e3cd89c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd851020 0x55e3cd89bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- 172.21.15.3:0/414265316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd87e710 0x55e3cd89ba20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/414265316 >> 172.21.15.3:0/414265316 conn(0x55e3cd8599d0 msgr2=0x55e3cd87d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/414265316 shutdown_connections 2023-05-17T11:45:50.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/414265316 wait complete. 2023-05-17T11:45:50.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- start start 2023-05-17T11:45:50.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 Processor -- start 2023-05-17T11:45:50.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd851020 0x55e3cd8fc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd87e710 0x55e3cd8fce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd8b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd69c3e0 con 0x55e3cd89d760 2023-05-17T11:45:50.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd6e5150 con 0x55e3cd87e710 2023-05-17T11:45:50.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3cd850ee0 con 0x55e3cd851020 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 10 client.0 _ll_register_callbacks cb 0x55e3cd66d3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd8b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c31cd5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd851020 0x55e3cd8fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd8b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34128/0 (socket says 172.21.15.3:34128) 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 -- 172.21.15.3:0/2178308697 learned_addr learned my addr 172.21.15.3:0/2178308697 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c314d4640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd87e710 0x55e3cd8fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 -- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd851020 msgr2=0x55e3cd8fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd851020 0x55e3cd8fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 -- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd87e710 msgr2=0x55e3cd8fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd87e710 0x55e3cd8fce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 -- 172.21.15.3:0/2178308697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3cd39e890 con 0x55e3cd89d760 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c314d4640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd87e710 0x55e3cd8fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c324d6640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd8b0190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c240f0520 tx=0x7f8c240f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f113660a1cd6664f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c0cff9640 1 -- 172.21.15.3:0/2178308697 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24107ea0 con 0x55e3cd89d760 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c0cff9640 1 -- 172.21.15.3:0/2178308697 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c2411c040 con 0x55e3cd89d760 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3cd8595e0 con 0x55e3cd89d760 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c0cff9640 1 -- 172.21.15.3:0/2178308697 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c2411d4b0 con 0x55e3cd89d760 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 10 client.4698 fetch_fsmap learned FSMap version 8 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e3cd64cbe0 con 0x55e3cd89d760 2023-05-17T11:45:50.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c0cff9640 1 -- 172.21.15.3:0/2178308697 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3cd8595e0 con 0x55e3cd89d760 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c0cff9640 1 -- 172.21.15.3:0/2178308697 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8c24005d20 con 0x55e3cd89d760 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 10 client.4698 fetch_fsmap finished waiting for FSMap version 8 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 10 client.4698 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 20 client.4698 populate_metadata read hostname 'smithi003' 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd89e070 0x55e3cd8b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 4 client.4698 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-05-17T11:45:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.330+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 --> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e3cd854210 con 0x55e3cd89e070 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd89e070 0x55e3cd8b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c31cd5640 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd89e070 0x55e3cd8b06d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a36d5ca73408f219 server_cookie=a05a43108a6b85f1 in_seq=0 out_seq=0 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c0cff9640 10 client.4698 ms_handle_connect on v2:172.21.15.60:6833/3866363606 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c0cff9640 1 -- 172.21.15.3:0/2178308697 <== mds.0 v2:172.21.15.60:6833/3866363606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e3cd854210 con 0x55e3cd89e070 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c0cff9640 10 client.4698 handle_command_reply: tid=0 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 client.4698 shutdown 2023-05-17T11:45:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 msgr2=0x55e3cd8b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd8b0190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c240f0520 tx=0x7f8c240f5000 comp rx=0 tx=0).stop 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 shutdown_connections 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:6833/3866363606,v1:172.21.15.60:6835/3866363606] conn(0x55e3cd89e070 0x55e3cd8b06d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e3cd89d760 0x55e3cd8b0190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e3cd87e710 0x55e3cd8fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 --2- 172.21.15.3:0/2178308697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55e3cd851020 0x55e3cd8fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 >> 172.21.15.3:0/2178308697 conn(0x55e3cd8599d0 msgr2=0x55e3cd854f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c0cff9640 0 client.4698 ms_handle_reset on v2:172.21.15.60:6833/3866363606 2023-05-17T11:45:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 shutdown_connections 2023-05-17T11:45:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 1 -- 172.21.15.3:0/2178308697 wait complete. 2023-05-17T11:45:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c372b0000 20 client.4698 trim_cache size 0 max 16384 2023-05-17T11:45:50.353 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-05-17T11:45:50.354 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "ae6aed9e-9392-45b7-b249-815180a4cc03", 2023-05-17T11:45:50.354 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-05-17T11:45:50.354 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4300, 2023-05-17T11:45:50.354 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-05-17T11:45:50.354 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-05-17T11:45:50.354 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-05-17T11:45:50.355 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 14.826722974000001, 2023-05-17T11:45:50.355 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 8, 2023-05-17T11:45:50.355 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 23, 2023-05-17T11:45:50.355 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 23, 2023-05-17T11:45:50.355 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 20.105761685000001 2023-05-17T11:45:50.355 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-05-17T11:45:50.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c10066280 msgr2=0x7f8c10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c10066280 0x7f8c10068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800a810 tx=0x7f8c28008040 comp rx=0 tx=0).stop 2023-05-17T11:45:50.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 msgr2=0x7f8c2c0c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 0x7f8c2c0c3720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c240af040 tx=0x7f8c24019770 comp rx=0 tx=0).stop 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 shutdown_connections 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c10066280 0x7f8c10068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c2c163b50 0x7f8c2c0c3720 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c2c0b1770 0x7f8c2c0aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 --2- 172.21.15.3:0/1728363621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c2c0ad860 0x7f8c2c15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 >> 172.21.15.3:0/1728363621 conn(0x7f8c2c0b0b20 msgr2=0x7f8c2c0cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 shutdown_connections 2023-05-17T11:45:50.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.334+0000 7f8c33f39640 1 -- 172.21.15.3:0/1728363621 wait complete. 2023-05-17T11:45:50.362 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-17T11:45:50.391 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-17T11:45:50.391 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-17T11:45:50.391 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-17T11:45:50.392 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T11:45:50.392 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T11:45:50.392 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-17T11:45:50.393 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T11:45:50.393 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-17T11:45:50.393 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-17T11:45:50.393 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T11:45:50.393 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-17T11:45:50.394 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-17T11:45:50.394 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T11:45:50.394 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-17T11:45:50.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:50.395 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-05-17T11:45:50.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:50.404 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-05-17T11:45:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-05-17T11:45:50.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:45:50.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:50.469 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-05-17T11:45:50.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:50.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2023-05-17T11:45:50.539 INFO:teuthology.orchestra.run.smithi003.stderr:Cannot find device "ceph-brx" 2023-05-17T11:45:50.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:45:50.542 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-17T11:45:50.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T11:45:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 Processor -- start 2023-05-17T11:45:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 -- start start 2023-05-17T11:45:50.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fec74158f10 0x7fec74070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740c92f0 con 0x7fec740cc4c0 2023-05-17T11:45:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec74071480 con 0x7fec74158f10 2023-05-17T11:45:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec7b396640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c8a00 con 0x7fec74071c10 2023-05-17T11:45:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fec74158f10 0x7fec74070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fec74158f10 0x7fec74070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34144/0 (socket says 172.21.15.3:34144) 2023-05-17T11:45:50.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 -- 172.21.15.3:0/4228374671 learned_addr learned my addr 172.21.15.3:0/4228374671 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec78931640 1 --2- 172.21.15.3:0/4228374671 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 -- 172.21.15.3:0/4228374671 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 msgr2=0x7fec740cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:50.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 --2- 172.21.15.3:0/4228374671 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 -- 172.21.15.3:0/4228374671 >> v1:172.21.15.60:6789/0 conn(0x7fec740cc4c0 legacy=0x7fec7406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.710+0000 7fec79132640 1 -- 172.21.15.3:0/4228374671 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740716e0 con 0x7fec74158f10 2023-05-17T11:45:50.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec79132640 1 --2- 172.21.15.3:0/4228374671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec74158f10 0x7fec74070f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec70009870 tx=0x7fec7001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c3e8ee82d50cf8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec6bfff640 1 -- 172.21.15.3:0/4228374671 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700ab600 con 0x7fec74158f10 2023-05-17T11:45:50.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec6bfff640 1 -- 172.21.15.3:0/4228374671 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec700a7050 con 0x7fec74158f10 2023-05-17T11:45:50.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec6bfff640 1 -- 172.21.15.3:0/4228374671 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700ab980 con 0x7fec74158f10 2023-05-17T11:45:50.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 -- 172.21.15.3:0/4228374671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec74158f10 msgr2=0x7fec74070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 --2- 172.21.15.3:0/4228374671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec74158f10 0x7fec74070f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec70009870 tx=0x7fec7001c540 comp rx=0 tx=0).stop 2023-05-17T11:45:50.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 -- 172.21.15.3:0/4228374671 shutdown_connections 2023-05-17T11:45:50.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 --2- 172.21.15.3:0/4228374671 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 --2- 172.21.15.3:0/4228374671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec74158f10 0x7fec74070f40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 -- 172.21.15.3:0/4228374671 >> 172.21.15.3:0/4228374671 conn(0x7fec740b0b30 msgr2=0x7fec740cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 -- 172.21.15.3:0/4228374671 shutdown_connections 2023-05-17T11:45:50.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 -- 172.21.15.3:0/4228374671 wait complete. 2023-05-17T11:45:50.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 Processor -- start 2023-05-17T11:45:50.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.714+0000 7fec7b396640 1 -- start start 2023-05-17T11:45:50.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec740cc4c0 0x7fec74150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec74158f10 0x7fec741592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c8170 con 0x7fec740cc4c0 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c7290 con 0x7fec74158f10 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c7560 con 0x7fec74071c10 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec78931640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec740cc4c0 0x7fec74150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:43100/0 (socket says 172.21.15.3:43100) 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 -- 172.21.15.3:0/661838983 learned_addr learned my addr 172.21.15.3:0/661838983 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79933640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec74158f10 0x7fec741592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 -- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec74158f10 msgr2=0x7fec741592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec74158f10 0x7fec741592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 -- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec740cc4c0 msgr2=0x7fec74150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec740cc4c0 0x7fec74150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 -- 172.21.15.3:0/661838983 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700094d0 con 0x7fec74071c10 2023-05-17T11:45:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec79132640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740c6d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fec7001abf0 tx=0x7fec700192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700b4460 con 0x7fec74071c10 2023-05-17T11:45:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec700b45c0 con 0x7fec74071c10 2023-05-17T11:45:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700b4970 con 0x7fec74071c10 2023-05-17T11:45:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec740ca120 con 0x7fec74071c10 2023-05-17T11:45:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740c9f90 con 0x7fec74071c10 2023-05-17T11:45:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.718+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7406c340 con 0x7fec74071c10 2023-05-17T11:45:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.722+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec700b2070 con 0x7fec74071c10 2023-05-17T11:45:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.722+0000 7fec69ffb640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec580662b0 0x7fec58068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.722+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec700db030 con 0x7fec74071c10 2023-05-17T11:45:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.722+0000 7fec78931640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec580662b0 0x7fec58068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:50.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.722+0000 7fec78931640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec580662b0 0x7fec58068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec741f8250 tx=0x7fec64009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:50.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.722+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fec700eb860 con 0x7fec74071c10 2023-05-17T11:45:50.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.910+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fec7404de80 con 0x7fec74071c10 2023-05-17T11:45:50.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.910+0000 7fec69ffb640 1 -- 172.21.15.3:0/661838983 <== mon.2 v2:172.21.15.60:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fec700eee80 con 0x7fec74071c10 2023-05-17T11:45:50.921 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T11:45:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.910+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec580662b0 msgr2=0x7fec58068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.910+0000 7fec7b396640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec580662b0 0x7fec58068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec741f8250 tx=0x7fec64009190 comp rx=0 tx=0).stop 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.910+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 msgr2=0x7fec740c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.910+0000 7fec7b396640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740c6d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fec7001abf0 tx=0x7fec700192e0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 shutdown_connections 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fec580662b0 0x7fec58068760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec74158f10 0x7fec741592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec740cc4c0 0x7fec74150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 --2- 172.21.15.3:0/661838983 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fec74071c10 0x7fec740c6d50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:50.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 >> 172.21.15.3:0/661838983 conn(0x7fec740b0b30 msgr2=0x7fec740cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:50.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 shutdown_connections 2023-05-17T11:45:50.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:50.914+0000 7fec7b396640 1 -- 172.21.15.3:0/661838983 wait complete. 2023-05-17T11:45:50.941 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T11:45:50.941 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T11:45:50.941 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-05-17T11:45:50.941 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T11:45:50.941 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T11:45:50.942 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T11:45:50.942 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T11:45:50.942 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T11:45:50.942 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T11:45:50.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:50.943 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-05-17T11:45:50.952 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:50.952 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:50.952 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:50.952 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:50.953 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:50.953 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:50.954 INFO:teuthology.orchestra.run.smithi003.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T11:45:50.954 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:50.954 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2023-05-17T11:45:50.954 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-17T11:45:50.955 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42231sec preferred_lft 42231sec 2023-05-17T11:45:50.955 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-05-17T11:45:50.955 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:50.955 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:50.956 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:50.956 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2023-05-17T11:45:50.956 INFO:teuthology.orchestra.run.smithi003.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:50.956 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:50.957 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2023-05-17T11:45:50.957 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:50.957 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:50.957 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2023-05-17T11:45:50.958 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-17T11:45:50.958 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:50:a2:40:8c brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:50.958 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-17T11:45:50.958 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:50.958 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T11:45:50.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:50.959 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:50.959 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:50.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2023-05-17T11:45:50.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2023-05-17T11:45:50.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2023-05-17T11:45:50.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T11:45:50.960 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:51.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.059 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T11:45:51.077 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-05-17T11:45:51.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.080 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-05-17T11:45:51.153 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-05-17T11:45:51.153 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T11:45:51.154 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-17T11:45:51.154 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-17T11:45:51.154 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-17T11:45:51.154 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T11:45:51.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.155 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:51.155 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:51.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T11:45:51.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T11:45:51.156 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T11:45:51.156 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:51.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.246 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-05-17T11:45:51.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.255 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2023-05-17T11:45:51.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.306 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:51.307 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:51.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T11:45:51.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-17T11:45:51.307 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:51.392 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-17T11:45:51.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.393 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:51.393 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:51.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-17T11:45:51.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T11:45:51.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-17T11:45:51.394 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-17T11:45:51.394 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-17T11:45:51.394 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:51.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.563 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:51.563 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:51.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-05-17T11:45:51.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T11:45:51.564 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:51.603 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-17T11:45:51.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:45:51.604 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-17T11:45:51.653 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-17T11:45:51.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:45:51.654 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-17T11:45:51.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:45:51.762 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:51.762 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:51.819 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:51.821 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:51.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.821 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:45:51.869 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T11:45:51.870 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-17T11:45:51.917 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:45:51.936 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:51.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:51.995 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:51.997 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:51.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:51.998 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:45:52.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-05-17T11:45:52.010+0000 7f989a2ce580 -1 init, newargv = 0x55871e5f2570 newargc=15 2023-05-17T11:45:52.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44425]: starting ceph client 2023-05-17T11:45:52.031 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44425]: starting fuse 2023-05-17T11:45:53.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:45:53.155 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:53.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:53.218 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:53.220 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:53.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:53.221 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:45:53.270 INFO:teuthology.orchestra.run.smithi003.stdout:42 2023-05-17T11:45:53.271 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-17T11:45:53.271 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T11:45:53.271 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-05-17T11:45:53.272 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-05-17T11:45:53.272 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-05-17T11:45:53.272 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-05-17T11:45:53.272 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:53.273 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-05-17T11:45:53.273 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-17T11:45:53.273 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-05-17T11:45:53.274 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-17T11:45:53.274 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:53.274 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-05-17T11:45:53.274 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-05-17T11:45:53.275 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-05-17T11:45:53.275 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-05-17T11:45:53.275 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:53.275 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-05-17T11:45:53.276 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T11:45:53.276 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T11:45:53.276 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T11:45:53.277 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-05-17T11:45:53.277 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-05-17T11:45:53.277 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-05-17T11:45:53.279 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T11:45:53.279 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:53.279 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-05-17T11:45:53.279 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-05-17T11:45:53.401 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.44425.asok 2023-05-17T11:45:53.584 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44425.asok 2023-05-17T11:45:53.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:53.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44425.asok status 2023-05-17T11:45:53.761 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-17T11:45:53.762 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "44425", 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4663, 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-05-17T11:45:53.763 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4663 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3630786892 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:45:53.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3630786892 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.4663 172.21.15.3:0/3630786892", 2023-05-17T11:45:53.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "172.21.15.3:0/3630786892", 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 8, 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 23, 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-05-17T11:45:53.766 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-05-17T11:45:53.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T11:45:53.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 Processor -- start 2023-05-17T11:45:53.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 -- start start 2023-05-17T11:45:53.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f101c158f10 0x7f101c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:53.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c06bc30 0x7f101c06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:53.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c0c92f0 con 0x7f101c071c10 2023-05-17T11:45:53.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c06c5f0 con 0x7f101c158f10 2023-05-17T11:45:53.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.902+0000 7f1022e74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c071480 con 0x7f101c06bc30 2023-05-17T11:45:53.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1021411640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c06bc30 0x7f101c06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:53.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1020c10640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f101c158f10 0x7f101c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f101bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f101c071c10 0x7f101c0cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:57882/0 (socket says 172.21.15.3:57882) 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f101bfff640 1 -- 172.21.15.3:0/4241027179 learned_addr learned my addr 172.21.15.3:0/4241027179 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1020c10640 1 -- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c06bc30 msgr2=0x7f101c06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1020c10640 1 --2- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c06bc30 0x7f101c06c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1020c10640 1 -- 172.21.15.3:0/4241027179 >> v1:172.21.15.60:6789/0 conn(0x7f101c071c10 legacy=0x7f101c0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f101b7fe640 1 -- 172.21.15.3:0/4241027179 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735584600 0 0) 0x7f101c0c92f0 con 0x7f101c071c10 2023-05-17T11:45:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1020c10640 1 -- 172.21.15.3:0/4241027179 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0c8a00 con 0x7f101c158f10 2023-05-17T11:45:53.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.906+0000 7f1020c10640 1 --2- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c158f10 0x7f101c070f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f101000ba60 tx=0x7f101001eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=611c40f7876b19e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:53.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f101b7fe640 1 -- 172.21.15.3:0/4241027179 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100a7b10 con 0x7f101c158f10 2023-05-17T11:45:53.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f101b7fe640 1 -- 172.21.15.3:0/4241027179 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10100a7c70 con 0x7f101c158f10 2023-05-17T11:45:53.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f101b7fe640 1 -- 172.21.15.3:0/4241027179 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100af440 con 0x7f101c158f10 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c158f10 msgr2=0x7f101c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 --2- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c158f10 0x7f101c070f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f101000ba60 tx=0x7f101001eb50 comp rx=0 tx=0).stop 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- 172.21.15.3:0/4241027179 shutdown_connections 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 --2- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c06bc30 0x7f101c06c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 --2- 172.21.15.3:0/4241027179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c158f10 0x7f101c070f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- 172.21.15.3:0/4241027179 >> 172.21.15.3:0/4241027179 conn(0x7f101c0b0b30 msgr2=0x7f101c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:53.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- 172.21.15.3:0/4241027179 shutdown_connections 2023-05-17T11:45:53.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- 172.21.15.3:0/4241027179 wait complete. 2023-05-17T11:45:53.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 Processor -- start 2023-05-17T11:45:53.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- start start 2023-05-17T11:45:53.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 0x7f101c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c071c10 0x7f101c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c158f10 0x7f101c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0b3cb0 con 0x7f101c06bc30 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0afcb0 con 0x7f101c071c10 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.910+0000 7f1022e74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0c7810 con 0x7f101c158f10 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 0x7f101c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 0x7f101c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34160/0 (socket says 172.21.15.3:34160) 2023-05-17T11:45:53.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 -- 172.21.15.3:0/4254906594 learned_addr learned my addr 172.21.15.3:0/4254906594 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:53.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f101bfff640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c071c10 0x7f101c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1021411640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c158f10 0x7f101c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 -- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c158f10 msgr2=0x7f101c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c158f10 0x7f101c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 -- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c071c10 msgr2=0x7f101c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c071c10 0x7f101c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 -- 172.21.15.3:0/4254906594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101000b6c0 con 0x7f101c06bc30 2023-05-17T11:45:53.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1020c10640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 0x7f101c0af770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f101001b760 tx=0x7f101001b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:53.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100b9910 con 0x7f101c06bc30 2023-05-17T11:45:53.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10100b9a90 con 0x7f101c06bc30 2023-05-17T11:45:53.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100b9e40 con 0x7f101c06bc30 2023-05-17T11:45:53.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c0cc690 con 0x7f101c06bc30 2023-05-17T11:45:53.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0c8f80 con 0x7f101c06bc30 2023-05-17T11:45:53.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c069ab0 con 0x7f101c06bc30 2023-05-17T11:45:53.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10100af440 con 0x7f101c06bc30 2023-05-17T11:45:53.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.914+0000 7f10197fa640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1000066280 0x7f1000068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:53.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.918+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f101011e9a0 con 0x7f101c06bc30 2023-05-17T11:45:53.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.918+0000 7f101bfff640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1000066280 0x7f1000068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:53.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.918+0000 7f101bfff640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1000066280 0x7f1000068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f101c15bf40 tx=0x7f1008007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:53.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:53.918+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f10100ebd80 con 0x7f101c06bc30 2023-05-17T11:45:54.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.106+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f101c04de80 con 0x7f101c06bc30 2023-05-17T11:45:54.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.106+0000 7f10197fa640 1 -- 172.21.15.3:0/4254906594 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10100ef3a0 con 0x7f101c06bc30 2023-05-17T11:45:54.118 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T11:45:54.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1000066280 msgr2=0x7f1000068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:54.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1000066280 0x7f1000068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f101c15bf40 tx=0x7f1008007b60 comp rx=0 tx=0).stop 2023-05-17T11:45:54.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 msgr2=0x7f101c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:54.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 0x7f101c0af770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f101001b760 tx=0x7f101001b8f0 comp rx=0 tx=0).stop 2023-05-17T11:45:54.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 shutdown_connections 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1000066280 0x7f1000068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f101c158f10 0x7f101c0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f101c071c10 0x7f101c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 --2- 172.21.15.3:0/4254906594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c06bc30 0x7f101c0af770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 >> 172.21.15.3:0/4254906594 conn(0x7f101c0b0b30 msgr2=0x7f101c1630a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 shutdown_connections 2023-05-17T11:45:54.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:54.110+0000 7f1022e74640 1 -- 172.21.15.3:0/4254906594 wait complete. 2023-05-17T11:45:54.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T11:45:54.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T11:45:54.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-05-17T11:45:54.139 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-17T11:45:54.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-17T11:45:54.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T11:45:54.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T11:45:54.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T11:45:54.140 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-17T11:45:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.140 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.149 INFO:teuthology.orchestra.run.smithi003.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42228sec preferred_lft 42228sec 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:54.150 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:54.151 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:50:a2:40:8c brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T11:45:54.152 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-05-17T11:45:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.153 INFO:teuthology.orchestra.run.smithi003.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T11:45:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T11:45:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-05-17T11:45:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.154 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T11:45:54.219 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-05-17T11:45:54.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.221 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-05-17T11:45:54.275 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-05-17T11:45:54.275 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T11:45:54.275 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-17T11:45:54.275 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-17T11:45:54.275 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-17T11:45:54.275 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T11:45:54.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.276 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:54.276 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:54.277 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T11:45:54.277 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T11:45:54.277 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T11:45:54.277 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:54.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.367 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-05-17T11:45:54.375 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T11:45:54.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.376 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2023-05-17T11:45:54.425 INFO:teuthology.orchestra.run.smithi003.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-17T11:45:54.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.426 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:54.427 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:54.427 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T11:45:54.427 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-17T11:45:54.427 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:54.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-17T11:45:54.565 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:54.566 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:54.566 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:54.566 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.566 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:54.566 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.566 INFO:teuthology.orchestra.run.smithi003.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:45:54.567 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 3a:db:b5:27:14:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T11:45:54.567 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T11:45:54.567 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.567 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::38db:b5ff:fe27:1413/64 scope link 2023-05-17T11:45:54.567 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.568 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-17T11:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:54.630 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.631 INFO:teuthology.orchestra.run.smithi003.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 3a:db:b5:27:14:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T11:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T11:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.632 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::38db:b5ff:fe27:1413/64 scope link 2023-05-17T11:45:54.633 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:54.634 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-17T11:45:54.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.636 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:54.636 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:54.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-17T11:45:54.637 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-17T11:45:54.637 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-17T11:45:54.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-17T11:45:54.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-17T11:45:54.639 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:54.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:54.768 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:45:54.768 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:45:54.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.1 up 2023-05-17T11:45:54.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.1 master ceph-brx 2023-05-17T11:45:54.769 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:45:54.805 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-17T11:45:54.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:45:54.805 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-17T11:45:54.854 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-17T11:45:54.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:45:54.855 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-17T11:45:54.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:45:54.965 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:54.966 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:55.023 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:55.024 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:55.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:55.025 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:45:55.077 INFO:teuthology.orchestra.run.smithi003.stdout:42 2023-05-17T11:45:55.078 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-17T11:45:55.078 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-17T11:45:55.121 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:45:55.140 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:55.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:55.200 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:55.201 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:55.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:55.202 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:45:55.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi003.stderr:2023-05-17T11:45:55.202+0000 7f7436575580 -1 init, newargv = 0x56049c1a0610 newargc=15 2023-05-17T11:45:55.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi003.stderr:ceph-fuse[44563]: starting ceph client 2023-05-17T11:45:55.222 INFO:teuthology.orchestra.run.smithi003.stdout:42 2023-05-17T11:45:55.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi003.stderr:ceph-fuse[44563]: starting fuse 2023-05-17T11:45:56.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:45:56.347 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:56.348 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:56.412 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:56.414 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:56.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:56.415 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:45:56.466 INFO:teuthology.orchestra.run.smithi003.stdout:42 2023-05-17T11:45:56.466 INFO:teuthology.orchestra.run.smithi003.stdout:43 2023-05-17T11:45:56.466 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2023-05-17T11:45:56.467 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T11:45:56.467 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-05-17T11:45:56.467 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-05-17T11:45:56.467 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-05-17T11:45:56.468 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-05-17T11:45:56.468 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:56.468 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-05-17T11:45:56.468 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-17T11:45:56.468 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-05-17T11:45:56.469 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-17T11:45:56.469 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:56.469 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-05-17T11:45:56.469 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-05-17T11:45:56.470 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-05-17T11:45:56.470 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-05-17T11:45:56.470 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:56.470 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-05-17T11:45:56.471 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T11:45:56.471 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T11:45:56.471 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T11:45:56.471 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-05-17T11:45:56.471 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-05-17T11:45:56.472 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-05-17T11:45:56.472 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T11:45:56.472 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:45:56.472 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.2")) 2023-05-17T11:45:56.473 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-05-17T11:45:56.593 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.2.44563.asok 2023-05-17T11:45:56.774 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44563.asok 2023-05-17T11:45:56.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:56.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44563.asok status 2023-05-17T11:45:56.950 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-05-17T11:45:56.950 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-05-17T11:45:56.950 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-17T11:45:56.950 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-17T11:45:56.950 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "2", 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "44563", 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-05-17T11:45:56.951 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4722, 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4722 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-05-17T11:45:56.952 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.2:0", 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3818203659 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.2:0", 2023-05-17T11:45:56.953 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3818203659 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.4722 192.168.0.2:0/3818203659", 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.2:0/3818203659", 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 8, 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 23, 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-05-17T11:45:56.954 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-05-17T11:45:56.955 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-05-17T11:45:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-05-17T11:45:56.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T11:45:57.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.090+0000 7f84f53e1640 1 Processor -- start 2023-05-17T11:45:57.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.090+0000 7f84f53e1640 1 -- start start 2023-05-17T11:45:57.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84f53e1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 0x7f84f01605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84f53e1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84f00ce190 0x7f84f00b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84f53e1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f0160b20 con 0x7f84f00b2580 2023-05-17T11:45:57.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84f53e1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f00b2a00 con 0x7f84f00ce190 2023-05-17T11:45:57.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84f53e1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00cfc90 con 0x7f84f015f4a0 2023-05-17T11:45:57.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ef7fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f84f00b2580 0x7f84f006f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49488/0 (socket says 172.21.15.3:49488) 2023-05-17T11:45:57.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ef7fe640 1 -- 172.21.15.3:0/4015790614 learned_addr learned my addr 172.21.15.3:0/4015790614 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:45:57.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 0x7f84f01605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84e7fff640 1 --2- 172.21.15.3:0/4015790614 >> v2:172.21.15.60:3300/0 conn(0x7f84f00ce190 0x7f84f00b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643493601 0 0) 0x7f84e8001120 con 0x7f84f00b2580 2023-05-17T11:45:57.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84dc003530 con 0x7f84f00b2580 2023-05-17T11:45:57.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1324379137 0 0) 0x7f84dc003530 con 0x7f84f00b2580 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 msgr2=0x7f84f01605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 0x7f84f01605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 >> v2:172.21.15.60:3300/0 conn(0x7f84f00ce190 msgr2=0x7f84f00b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 --2- 172.21.15.3:0/4015790614 >> v2:172.21.15.60:3300/0 conn(0x7f84f00ce190 0x7f84f00b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00cff70 con 0x7f84f00b2580 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84e7fff640 1 --2- 172.21.15.3:0/4015790614 >> v2:172.21.15.60:3300/0 conn(0x7f84f00ce190 0x7f84f00b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f84e8001810 con 0x7f84f00b2580 2023-05-17T11:45:57.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 >> v1:172.21.15.3:6789/0 conn(0x7f84f00b2580 legacy=0x7f84f006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc0047d0 0x7f84dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 0x7f84dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b2a00 con 0x7f84dc0039f0 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00cfc90 con 0x7f84dc0047d0 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc00b990 con 0x7f84f015f4a0 2023-05-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84e7fff640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc0047d0 0x7f84dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84ef7fe640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 0x7f84dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 -- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 msgr2=0x7f84dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f015f4a0 0x7f84dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 -- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc0047d0 msgr2=0x7f84dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc0047d0 0x7f84dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84eeffd640 1 -- 172.21.15.3:0/4015790614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc003530 con 0x7f84dc0039f0 2023-05-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.094+0000 7f84e7fff640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc0047d0 0x7f84dc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:57.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84eeffd640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84dc003e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009fc0 tx=0x7f84e001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d7ff379a0ce75d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00a5b40 con 0x7f84dc0039f0 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000f040 con 0x7f84dc0039f0 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84ee7fc640 1 -- 172.21.15.3:0/4015790614 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00ad440 con 0x7f84dc0039f0 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84f53e1640 1 -- 172.21.15.3:0/4015790614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 msgr2=0x7f84dc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84f53e1640 1 --2- 172.21.15.3:0/4015790614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84dc003e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009fc0 tx=0x7f84e001cc60 comp rx=0 tx=0).stop 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84ef7fe640 1 -- 172.21.15.3:0/4015790614 reap_dead start 2023-05-17T11:45:57.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84f53e1640 1 -- 172.21.15.3:0/4015790614 shutdown_connections 2023-05-17T11:45:57.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84f53e1640 1 -- 172.21.15.3:0/4015790614 >> 172.21.15.3:0/4015790614 conn(0x7f84f006eac0 msgr2=0x7f84f00cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:57.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84f53e1640 1 -- 172.21.15.3:0/4015790614 shutdown_connections 2023-05-17T11:45:57.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.098+0000 7f84f53e1640 1 -- 172.21.15.3:0/4015790614 wait complete. 2023-05-17T11:45:57.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 Processor -- start 2023-05-17T11:45:57.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- start start 2023-05-17T11:45:57.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84f00c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f00b5180 0x7f84f01ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f00c6110 0x7f84f01eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b4d60 con 0x7f84dc0039f0 2023-05-17T11:45:57.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b40e0 con 0x7f84f00c6110 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b43c0 con 0x7f84f00b5180 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84f00c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84f00c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60530/0 (socket says 172.21.15.3:60530) 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 -- 172.21.15.3:0/1540020971 learned_addr learned my addr 172.21.15.3:0/1540020971 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84e7fff640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f00b5180 0x7f84f01ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84ef7fe640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f00c6110 0x7f84f01eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 -- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f00b5180 msgr2=0x7f84f01ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:57.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f00b5180 0x7f84f01ead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 -- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f00c6110 msgr2=0x7f84f01eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f00c6110 0x7f84f01eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 -- 172.21.15.3:0/1540020971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f015f870 con 0x7f84dc0039f0 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84eeffd640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84f00c5bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84e00b0040 tx=0x7f84e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0003ba0 con 0x7f84dc0039f0 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0003d00 con 0x7f84dc0039f0 2023-05-17T11:45:57.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0004240 con 0x7f84dc0039f0 2023-05-17T11:45:57.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f00caf90 con 0x7f84dc0039f0 2023-05-17T11:45:57.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f00ce560 con 0x7f84dc0039f0 2023-05-17T11:45:57.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.102+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f015c880 con 0x7f84dc0039f0 2023-05-17T11:45:57.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.106+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84e00b4040 con 0x7f84dc0039f0 2023-05-17T11:45:57.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.106+0000 7f84e77fe640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d00662b0 0x7f84d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:57.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.106+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84e011e3d0 con 0x7f84dc0039f0 2023-05-17T11:45:57.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.106+0000 7f84e7fff640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d00662b0 0x7f84d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:57.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.106+0000 7f84e7fff640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d00662b0 0x7f84d0068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84f00c5b00 tx=0x7f84d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:57.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.110+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f84e00eb8f0 con 0x7f84dc0039f0 2023-05-17T11:45:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84f004de80 con 0x7f84dc0039f0 2023-05-17T11:45:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84e77fe640 1 -- 172.21.15.3:0/1540020971 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84e00eef10 con 0x7f84dc0039f0 2023-05-17T11:45:57.309 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T11:45:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d00662b0 msgr2=0x7f84d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d00662b0 0x7f84d0068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84f00c5b00 tx=0x7f84d8008040 comp rx=0 tx=0).stop 2023-05-17T11:45:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 msgr2=0x7f84f00c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84f00c5bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84e00b0040 tx=0x7f84e0009750 comp rx=0 tx=0).stop 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 shutdown_connections 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d00662b0 0x7f84d0068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f00c6110 0x7f84f01eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f00b5180 0x7f84f01ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 --2- 172.21.15.3:0/1540020971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84dc0039f0 0x7f84f00c5bd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 >> 172.21.15.3:0/1540020971 conn(0x7f84f006eac0 msgr2=0x7f84f00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 shutdown_connections 2023-05-17T11:45:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:57.298+0000 7f84f53e1640 1 -- 172.21.15.3:0/1540020971 wait complete. 2023-05-17T11:45:57.328 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T11:45:57.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T11:45:57.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-05-17T11:45:57.329 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-17T11:45:57.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-17T11:45:57.329 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T11:45:57.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T11:45:57.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T11:45:57.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-17T11:45:57.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.331 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-05-17T11:45:57.340 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:57.340 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:57.340 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:57.340 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:57.340 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-05-17T11:45:57.341 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-17T11:45:57.342 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-05-17T11:45:57.342 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-05-17T11:45:57.342 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:57.342 INFO:teuthology.orchestra.run.smithi060.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:57.343 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:57.343 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-05-17T11:45:57.343 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:57.343 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:57.344 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-05-17T11:45:57.344 INFO:teuthology.orchestra.run.smithi060.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-17T11:45:57.344 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 02:42:8d:01:b9:af brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:57.344 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-17T11:45:57.345 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:57.345 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T11:45:57.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.346 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:57.346 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:57.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-05-17T11:45:57.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-05-17T11:45:57.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-05-17T11:45:57.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T11:45:57.348 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:57.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.461 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T11:45:57.480 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-05-17T11:45:57.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.483 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-05-17T11:45:57.549 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-05-17T11:45:57.549 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T11:45:57.549 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-17T11:45:57.550 INFO:teuthology.orchestra.run.smithi060.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-17T11:45:57.550 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-17T11:45:57.550 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T11:45:57.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.551 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:57.551 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:57.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T11:45:57.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T11:45:57.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T11:45:57.552 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:57.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.648 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-05-17T11:45:57.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.657 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-05-17T11:45:57.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.713 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:57.713 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:57.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T11:45:57.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-17T11:45:57.714 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:57.795 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-17T11:45:57.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.795 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:57.796 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:57.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-17T11:45:57.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T11:45:57.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-17T11:45:57.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-17T11:45:57.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-17T11:45:57.797 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:57.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:57.957 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:57.957 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:57.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-05-17T11:45:57.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T11:45:57.958 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:57.996 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-17T11:45:57.996 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:45:57.997 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-17T11:45:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-17T11:45:58.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:45:58.048 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-17T11:45:58.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-05-17T11:45:58.156 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:58.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:58.215 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:58.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:58.216 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-05-17T11:45:58.264 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T11:45:58.265 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-17T11:45:58.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-05-17T11:45:58.326 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:45:58.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:45:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:45:58.387 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:45:58.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:58.388 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-05-17T11:45:58.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi060.stderr:2023-05-17T11:45:58.408+0000 7f6df9849580 -1 init, newargv = 0x55614becd400 newargc=15 2023-05-17T11:45:58.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi060.stderr:ceph-fuse[41350]: starting ceph client 2023-05-17T11:45:58.422 INFO:teuthology.orchestra.run.smithi060.stdout:42 2023-05-17T11:45:58.422 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-17T11:45:58.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T11:45:58.423 DEBUG:teuthology.orchestra.run.smithi060:> import glob 2023-05-17T11:45:58.423 DEBUG:teuthology.orchestra.run.smithi060:> import re 2023-05-17T11:45:58.423 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-05-17T11:45:58.423 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-05-17T11:45:58.424 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:45:58.424 DEBUG:teuthology.orchestra.run.smithi060:> def _find_admin_socket(client_name): 2023-05-17T11:45:58.424 DEBUG:teuthology.orchestra.run.smithi060:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-17T11:45:58.424 DEBUG:teuthology.orchestra.run.smithi060:> files = glob.glob(asok_path) 2023-05-17T11:45:58.425 DEBUG:teuthology.orchestra.run.smithi060:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-17T11:45:58.425 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:45:58.425 DEBUG:teuthology.orchestra.run.smithi060:> # Given a non-glob path, it better be there 2023-05-17T11:45:58.425 DEBUG:teuthology.orchestra.run.smithi060:> if "*" not in asok_path: 2023-05-17T11:45:58.425 DEBUG:teuthology.orchestra.run.smithi060:> assert(len(files) == 1) 2023-05-17T11:45:58.426 DEBUG:teuthology.orchestra.run.smithi060:> return files[0] 2023-05-17T11:45:58.426 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:45:58.426 DEBUG:teuthology.orchestra.run.smithi060:> for f in files: 2023-05-17T11:45:58.426 DEBUG:teuthology.orchestra.run.smithi060:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T11:45:58.427 DEBUG:teuthology.orchestra.run.smithi060:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T11:45:58.427 DEBUG:teuthology.orchestra.run.smithi060:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T11:45:58.427 DEBUG:teuthology.orchestra.run.smithi060:> contents = proc_f.read() 2023-05-17T11:45:58.427 DEBUG:teuthology.orchestra.run.smithi060:> if mountpoint in contents: 2023-05-17T11:45:58.427 DEBUG:teuthology.orchestra.run.smithi060:> return f 2023-05-17T11:45:58.428 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T11:45:58.428 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:45:58.428 DEBUG:teuthology.orchestra.run.smithi060:> print(_find_admin_socket("client.1")) 2023-05-17T11:45:58.428 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-05-17T11:45:58.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi060.stderr:ceph-fuse[41350]: starting fuse 2023-05-17T11:45:58.547 INFO:teuthology.orchestra.run.smithi060.stdout:/var/run/ceph/ceph-client.1.41350.asok 2023-05-17T11:45:58.731 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41350.asok 2023-05-17T11:45:58.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:58.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41350.asok status 2023-05-17T11:45:58.905 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": { 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "entity_id": "1", 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": "smithi060", 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-17T11:45:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "pid": "41350", 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "root": "/" 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_count": 0, 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_pinned_count": 0, 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4690, 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "inst": { 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": { 2023-05-17T11:45:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4690 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 998035285 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-05-17T11:45:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 998035285 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "inst_str": "client.4690 192.168.0.1:0/998035285", 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr_str": "192.168.0.1:0/998035285", 2023-05-17T11:45:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "inode_count": 1, 2023-05-17T11:45:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_epoch": 8, 2023-05-17T11:45:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch": 23, 2023-05-17T11:45:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch_barrier": 0, 2023-05-17T11:45:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklisted": false, 2023-05-17T11:45:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs" 2023-05-17T11:45:58.910 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-05-17T11:45:58.920 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T11:45:59.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 Processor -- start 2023-05-17T11:45:59.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 -- start start 2023-05-17T11:45:59.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeac158f10 0x7fdeac070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:59.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdeac06bc30 0x7fdeac06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:59.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0c92f0 con 0x7fdeac071c10 2023-05-17T11:45:59.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac06c5f0 con 0x7fdeac06bc30 2023-05-17T11:45:59.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeb1796640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac071480 con 0x7fdeac158f10 2023-05-17T11:45:59.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeab7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdeac06bc30 0x7fdeac06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:59.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeab7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdeac06bc30 0x7fdeac06c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60536/0 (socket says 172.21.15.3:60536) 2023-05-17T11:45:59.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeab7fe640 1 -- 172.21.15.3:0/2640000957 learned_addr learned my addr 172.21.15.3:0/2640000957 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:59.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.058+0000 7fdeaaffd640 1 --2- 172.21.15.3:0/2640000957 >> v2:172.21.15.60:3300/0 conn(0x7fdeac158f10 0x7fdeac070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:59.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeab7fe640 1 -- 172.21.15.3:0/2640000957 >> v2:172.21.15.60:3300/0 conn(0x7fdeac158f10 msgr2=0x7fdeac070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:45:59.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeab7fe640 1 --2- 172.21.15.3:0/2640000957 >> v2:172.21.15.60:3300/0 conn(0x7fdeac158f10 0x7fdeac070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeab7fe640 1 -- 172.21.15.3:0/2640000957 >> v1:172.21.15.60:6789/0 conn(0x7fdeac071c10 legacy=0x7fdeac0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:59.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeab7fe640 1 -- 172.21.15.3:0/2640000957 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0c8a00 con 0x7fdeac06bc30 2023-05-17T11:45:59.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeab7fe640 1 --2- 172.21.15.3:0/2640000957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac06c0b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdeac06e090 tx=0x7fdea401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae676858d44c74d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:59.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeaa7fc640 1 -- 172.21.15.3:0/2640000957 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40a8420 con 0x7fdeac06bc30 2023-05-17T11:45:59.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeaa7fc640 1 -- 172.21.15.3:0/2640000957 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea40a8580 con 0x7fdeac06bc30 2023-05-17T11:45:59.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeaa7fc640 1 -- 172.21.15.3:0/2640000957 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40a8910 con 0x7fdeac06bc30 2023-05-17T11:45:59.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 -- 172.21.15.3:0/2640000957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 msgr2=0x7fdeac06c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2640000957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac06c0b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdeac06e090 tx=0x7fdea401c9d0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 -- 172.21.15.3:0/2640000957 shutdown_connections 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2640000957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac06c0b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2640000957 >> v2:172.21.15.60:3300/0 conn(0x7fdeac158f10 0x7fdeac070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 -- 172.21.15.3:0/2640000957 >> 172.21.15.3:0/2640000957 conn(0x7fdeac0b0b30 msgr2=0x7fdeac0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.062+0000 7fdeb1796640 1 -- 172.21.15.3:0/2640000957 shutdown_connections 2023-05-17T11:45:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- 172.21.15.3:0/2640000957 wait complete. 2023-05-17T11:45:59.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 Processor -- start 2023-05-17T11:45:59.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- start start 2023-05-17T11:45:59.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac071c10 0x7fdeac1624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdeac158f10 0x7fdeac0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c6570 con 0x7fdeac06bc30 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c6850 con 0x7fdeac071c10 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c6b30 con 0x7fdeac158f10 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac0c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60550/0 (socket says 172.21.15.3:60550) 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 -- 172.21.15.3:0/2524472538 learned_addr learned my addr 172.21.15.3:0/2524472538 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdea3fff640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac071c10 0x7fdeac1624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeab7fe640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdeac158f10 0x7fdeac0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 -- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdeac158f10 msgr2=0x7fdeac0c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdeac158f10 0x7fdeac0c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 -- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac071c10 msgr2=0x7fdeac1624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac071c10 0x7fdeac1624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 -- 172.21.15.3:0/2524472538 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009b30 con 0x7fdeac06bc30 2023-05-17T11:45:59.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdea3fff640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac071c10 0x7fdeac1624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:59.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeab7fe640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdeac158f10 0x7fdeac0c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:45:59.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeaaffd640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac0c1f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e870 tx=0x7fde9c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c009510 con 0x7fdeac06bc30 2023-05-17T11:45:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00eec0 con 0x7fdeac06bc30 2023-05-17T11:45:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac0cc690 con 0x7fdeac06bc30 2023-05-17T11:45:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00cb40 con 0x7fdeac06bc30 2023-05-17T11:45:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.066+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0c8f80 con 0x7fdeac06bc30 2023-05-17T11:45:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.070+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac165cc0 con 0x7fdeac06bc30 2023-05-17T11:45:59.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.070+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde9c00cca0 con 0x7fdeac06bc30 2023-05-17T11:45:59.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.070+0000 7fdea37fe640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fde8c066280 0x7fde8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:45:59.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.070+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde9c083ee0 con 0x7fdeac06bc30 2023-05-17T11:45:59.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.070+0000 7fdea3fff640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fde8c066280 0x7fde8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:45:59.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.070+0000 7fdea3fff640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fde8c066280 0x7fde8c068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdeac1f8530 tx=0x7fde94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:45:59.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.074+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fde9c0512c0 con 0x7fdeac06bc30 2023-05-17T11:45:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.266+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdeac04de80 con 0x7fdeac06bc30 2023-05-17T11:45:59.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.266+0000 7fdea37fe640 1 -- 172.21.15.3:0/2524472538 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde9c017070 con 0x7fdeac06bc30 2023-05-17T11:45:59.278 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T11:45:59.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fde8c066280 msgr2=0x7fde8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:59.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fde8c066280 0x7fde8c068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdeac1f8530 tx=0x7fde94009040 comp rx=0 tx=0).stop 2023-05-17T11:45:59.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 msgr2=0x7fdeac0c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:45:59.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac0c1f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e870 tx=0x7fde9c00ec70 comp rx=0 tx=0).stop 2023-05-17T11:45:59.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 shutdown_connections 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fde8c066280 0x7fde8c068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdeac158f10 0x7fdeac0c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac071c10 0x7fdeac1624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 --2- 172.21.15.3:0/2524472538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac06bc30 0x7fdeac0c1f50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 >> 172.21.15.3:0/2524472538 conn(0x7fdeac0b0b30 msgr2=0x7fdeac0703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 shutdown_connections 2023-05-17T11:45:59.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:45:59.270+0000 7fdeb1796640 1 -- 172.21.15.3:0/2524472538 wait complete. 2023-05-17T11:45:59.298 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T11:45:59.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T11:45:59.299 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-05-17T11:45:59.299 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-17T11:45:59.299 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-17T11:45:59.299 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T11:45:59.299 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T11:45:59.299 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T11:45:59.300 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-17T11:45:59.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.300 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-05-17T11:45:59.308 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.309 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42216sec preferred_lft 42216sec 2023-05-17T11:45:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 02:42:8d:01:b9:af brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T11:45:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-05-17T11:45:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.313 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T11:45:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T11:45:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-05-17T11:45:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.314 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T11:45:59.374 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-05-17T11:45:59.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.376 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-05-17T11:45:59.425 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-05-17T11:45:59.425 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T11:45:59.425 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-17T11:45:59.426 INFO:teuthology.orchestra.run.smithi060.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-17T11:45:59.426 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-17T11:45:59.426 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T11:45:59.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.426 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:59.427 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:59.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T11:45:59.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T11:45:59.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T11:45:59.428 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:59.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.516 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-05-17T11:45:59.564 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-17T11:45:59.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.565 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-05-17T11:45:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-17T11:45:59.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.621 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:59.621 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:59.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-17T11:45:59.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-17T11:45:59.621 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:59.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-17T11:45:59.764 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 7a:31:e9:c7:90:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7831:e9ff:fec7:9035/64 scope link 2023-05-17T11:45:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-17T11:45:59.828 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:45:59.828 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:45:59.828 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:45:59.828 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.828 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 7a:31:e9:c7:90:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7831:e9ff:fec7:9035/64 scope link 2023-05-17T11:45:59.829 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:45:59.830 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-17T11:45:59.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.831 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:59.831 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:59.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-17T11:45:59.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-17T11:45:59.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-17T11:45:59.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-17T11:45:59.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-17T11:45:59.833 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:45:59.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:45:59.964 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-05-17T11:45:59.964 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-05-17T11:45:59.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.1 up 2023-05-17T11:45:59.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.1 master ceph-brx 2023-05-17T11:45:59.965 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-05-17T11:46:00.002 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-17T11:46:00.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:46:00.003 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-17T11:46:00.056 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-17T11:46:00.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:46:00.057 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-17T11:46:00.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-05-17T11:46:00.164 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:46:00.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:46:00.221 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:46:00.223 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:46:00.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:00.224 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-05-17T11:46:00.271 INFO:teuthology.orchestra.run.smithi060.stdout:42 2023-05-17T11:46:00.272 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-17T11:46:00.272 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-17T11:46:00.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-05-17T11:46:00.338 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:46:00.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:46:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:46:00.400 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:46:00.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:00.401 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-05-17T11:46:00.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi060.stderr:2023-05-17T11:46:00.404+0000 7f06f6845580 -1 init, newargv = 0x55c95652a680 newargc=15 2023-05-17T11:46:00.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi060.stderr:ceph-fuse[41457]: starting ceph client 2023-05-17T11:46:00.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi060.stderr:ceph-fuse[41457]: starting fuse 2023-05-17T11:46:00.419 INFO:teuthology.orchestra.run.smithi060.stdout:42 2023-05-17T11:46:00.420 INFO:teuthology.orchestra.run.smithi060.stdout:43 2023-05-17T11:46:00.420 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2023-05-17T11:46:00.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T11:46:00.421 DEBUG:teuthology.orchestra.run.smithi060:> import glob 2023-05-17T11:46:00.421 DEBUG:teuthology.orchestra.run.smithi060:> import re 2023-05-17T11:46:00.421 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-05-17T11:46:00.421 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-05-17T11:46:00.421 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:46:00.422 DEBUG:teuthology.orchestra.run.smithi060:> def _find_admin_socket(client_name): 2023-05-17T11:46:00.422 DEBUG:teuthology.orchestra.run.smithi060:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-17T11:46:00.422 DEBUG:teuthology.orchestra.run.smithi060:> files = glob.glob(asok_path) 2023-05-17T11:46:00.422 DEBUG:teuthology.orchestra.run.smithi060:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-17T11:46:00.423 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:46:00.423 DEBUG:teuthology.orchestra.run.smithi060:> # Given a non-glob path, it better be there 2023-05-17T11:46:00.423 DEBUG:teuthology.orchestra.run.smithi060:> if "*" not in asok_path: 2023-05-17T11:46:00.423 DEBUG:teuthology.orchestra.run.smithi060:> assert(len(files) == 1) 2023-05-17T11:46:00.424 DEBUG:teuthology.orchestra.run.smithi060:> return files[0] 2023-05-17T11:46:00.424 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:46:00.424 DEBUG:teuthology.orchestra.run.smithi060:> for f in files: 2023-05-17T11:46:00.424 DEBUG:teuthology.orchestra.run.smithi060:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T11:46:00.424 DEBUG:teuthology.orchestra.run.smithi060:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T11:46:00.425 DEBUG:teuthology.orchestra.run.smithi060:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T11:46:00.425 DEBUG:teuthology.orchestra.run.smithi060:> contents = proc_f.read() 2023-05-17T11:46:00.425 DEBUG:teuthology.orchestra.run.smithi060:> if mountpoint in contents: 2023-05-17T11:46:00.425 DEBUG:teuthology.orchestra.run.smithi060:> return f 2023-05-17T11:46:00.426 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T11:46:00.426 DEBUG:teuthology.orchestra.run.smithi060:> 2023-05-17T11:46:00.426 DEBUG:teuthology.orchestra.run.smithi060:> print(_find_admin_socket("client.3")) 2023-05-17T11:46:00.426 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-05-17T11:46:00.543 INFO:teuthology.orchestra.run.smithi060.stdout:/var/run/ceph/ceph-client.3.41457.asok 2023-05-17T11:46:00.726 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41457.asok 2023-05-17T11:46:00.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:00.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41457.asok status 2023-05-17T11:46:00.897 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": { 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "entity_id": "3", 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": "smithi060", 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-17T11:46:00.898 INFO:teuthology.orchestra.run.smithi060.stdout: "pid": "41457", 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "root": "/" 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_count": 0, 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_pinned_count": 0, 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4708, 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "inst": { 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": { 2023-05-17T11:46:00.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4708 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.2:0", 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 4271551370 2023-05-17T11:46:00.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.2:0", 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 4271551370 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: "inst_str": "client.4708 192.168.0.2:0/4271551370", 2023-05-17T11:46:00.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr_str": "192.168.0.2:0/4271551370", 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout: "inode_count": 1, 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_epoch": 8, 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch": 23, 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch_barrier": 0, 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklisted": false, 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs" 2023-05-17T11:46:00.902 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-05-17T11:46:00.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:00.913 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-05-17T11:46:00.913 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:00.922 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-05-17T11:46:00.922 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:00.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:00.923 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:00.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:00.992 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-05-17T11:46:00.993 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-17T11:46:01.042 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-05-17T11:46:01.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-17T11:46:01.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:01.043 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-17T11:46:01.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:01.104 DEBUG:teuthology.orchestra.run.smithi060:> stat --file-system '--printf=%T 2023-05-17T11:46:01.104 DEBUG:teuthology.orchestra.run.smithi060:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-17T11:46:01.112 INFO:teuthology.orchestra.run.smithi060.stdout:fuseblk 2023-05-17T11:46:01.113 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-17T11:46:01.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:01.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-17T11:46:01.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:01.176 DEBUG:teuthology.orchestra.run.smithi060:> stat --file-system '--printf=%T 2023-05-17T11:46:01.177 DEBUG:teuthology.orchestra.run.smithi060:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-17T11:46:01.224 INFO:teuthology.orchestra.run.smithi060.stdout:fuseblk 2023-05-17T11:46:01.225 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-17T11:46:01.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:01.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-17T11:46:01.283 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-17T11:46:01.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 Processor -- start 2023-05-17T11:46:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 -- start start 2023-05-17T11:46:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38f006a1c0 0x7f38f006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f38f00c8a00 0x7f38f00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f015fd00 con 0x7f38f015c270 2023-05-17T11:46:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00c91a0 con 0x7f38f00c8a00 2023-05-17T11:46:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f87a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f015c640 con 0x7f38f006a1c0 2023-05-17T11:46:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f6542640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f38f015c270 0x7f38f0069ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49490/0 (socket says 172.21.15.3:49490) 2023-05-17T11:46:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f6542640 1 -- 172.21.15.3:0/2672177438 learned_addr learned my addr 172.21.15.3:0/2672177438 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.430+0000 7f38f6d43640 1 --2- 172.21.15.3:0/2672177438 >> v2:172.21.15.3:3300/0 conn(0x7f38f00c8a00 0x7f38f00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f5d41640 1 --2- 172.21.15.3:0/2672177438 >> v2:172.21.15.60:3300/0 conn(0x7f38f006a1c0 0x7f38f006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f5540640 1 -- 172.21.15.3:0/2672177438 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362877936 0 0) 0x7f38f015fd00 con 0x7f38f015c270 2023-05-17T11:46:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f5540640 1 -- 172.21.15.3:0/2672177438 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38dc003530 con 0x7f38f015c270 2023-05-17T11:46:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f6d43640 1 -- 172.21.15.3:0/2672177438 >> v2:172.21.15.60:3300/0 conn(0x7f38f006a1c0 msgr2=0x7f38f006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f6d43640 1 --2- 172.21.15.3:0/2672177438 >> v2:172.21.15.60:3300/0 conn(0x7f38f006a1c0 0x7f38f006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f6d43640 1 -- 172.21.15.3:0/2672177438 >> v1:172.21.15.3:6789/0 conn(0x7f38f015c270 legacy=0x7f38f0069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f6d43640 1 -- 172.21.15.3:0/2672177438 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00c8ec0 con 0x7f38f00c8a00 2023-05-17T11:46:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f6d43640 1 --2- 172.21.15.3:0/2672177438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f00c8a00 0x7f38f00cd1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38f006dea0 tx=0x7f38e801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9552dc4c90b1386 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:01.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f5540640 1 -- 172.21.15.3:0/2672177438 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80a8640 con 0x7f38f00c8a00 2023-05-17T11:46:01.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f5540640 1 -- 172.21.15.3:0/2672177438 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e80a87a0 con 0x7f38f00c8a00 2023-05-17T11:46:01.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f5540640 1 -- 172.21.15.3:0/2672177438 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80a8b30 con 0x7f38f00c8a00 2023-05-17T11:46:01.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f87a6640 1 -- 172.21.15.3:0/2672177438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f00c8a00 msgr2=0x7f38f00cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.434+0000 7f38f87a6640 1 --2- 172.21.15.3:0/2672177438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f00c8a00 0x7f38f00cd1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38f006dea0 tx=0x7f38e801c8e0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- 172.21.15.3:0/2672177438 shutdown_connections 2023-05-17T11:46:01.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 --2- 172.21.15.3:0/2672177438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f00c8a00 0x7f38f00cd1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 --2- 172.21.15.3:0/2672177438 >> v2:172.21.15.60:3300/0 conn(0x7f38f006a1c0 0x7f38f006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- 172.21.15.3:0/2672177438 >> 172.21.15.3:0/2672177438 conn(0x7f38f00b0b30 msgr2=0x7f38f00cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:01.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- 172.21.15.3:0/2672177438 shutdown_connections 2023-05-17T11:46:01.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- 172.21.15.3:0/2672177438 wait complete. 2023-05-17T11:46:01.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 Processor -- start 2023-05-17T11:46:01.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- start start 2023-05-17T11:46:01.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f38f006a1c0 0x7f38f00c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f00c8a00 0x7f38f00c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 0x7f38f00c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01f85f0 con 0x7f38f015c270 2023-05-17T11:46:01.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01f5510 con 0x7f38f00c8a00 2023-05-17T11:46:01.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f87a6640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00c75f0 con 0x7f38f006a1c0 2023-05-17T11:46:01.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 0x7f38f00c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 0x7f38f00c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60558/0 (socket says 172.21.15.3:60558) 2023-05-17T11:46:01.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 -- 172.21.15.3:0/3202065154 learned_addr learned my addr 172.21.15.3:0/3202065154 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6542640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f38f006a1c0 0x7f38f00c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f5d41640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f00c8a00 0x7f38f00c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 -- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f38f006a1c0 msgr2=0x7f38f00c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f38f006a1c0 0x7f38f00c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 -- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f00c8a00 msgr2=0x7f38f00c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f00c8a00 0x7f38f00c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.438+0000 7f38f6d43640 1 -- 172.21.15.3:0/3202065154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009a70 con 0x7f38f015c270 2023-05-17T11:46:01.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38f6d43640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 0x7f38f00c7f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38e801a510 tx=0x7f38e8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:01.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80b0600 con 0x7f38f015c270 2023-05-17T11:46:01.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e80b6040 con 0x7f38f015c270 2023-05-17T11:46:01.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f00ca850 con 0x7f38f015c270 2023-05-17T11:46:01.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80b0980 con 0x7f38f015c270 2023-05-17T11:46:01.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f0160510 con 0x7f38f015c270 2023-05-17T11:46:01.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f0160a30 con 0x7f38f015c270 2023-05-17T11:46:01.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38e80b0ae0 con 0x7f38f015c270 2023-05-17T11:46:01.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38e6ffd640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f38d40662b0 0x7f38d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38e811f100 con 0x7f38f015c270 2023-05-17T11:46:01.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.442+0000 7f38f6542640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f38d40662b0 0x7f38d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.446+0000 7f38f6542640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f38d40662b0 0x7f38d4068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0011f0 tx=0x7f38ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:01.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.446+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38e80ec4e0 con 0x7f38f015c270 2023-05-17T11:46:01.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.602+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38f01f8730 con 0x7f38f015c270 2023-05-17T11:46:01.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.602+0000 7f38e6ffd640 1 -- 172.21.15.3:0/3202065154 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f38f01f8730 con 0x7f38f015c270 2023-05-17T11:46:01.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:01.615 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:01.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f38d40662b0 msgr2=0x7f38d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f38d40662b0 0x7f38d4068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0011f0 tx=0x7f38ec009040 comp rx=0 tx=0).stop 2023-05-17T11:46:01.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 msgr2=0x7f38f00c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 0x7f38f00c7f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38e801a510 tx=0x7f38e8019680 comp rx=0 tx=0).stop 2023-05-17T11:46:01.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 shutdown_connections 2023-05-17T11:46:01.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f38d40662b0 0x7f38d4068760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f38f015c270 0x7f38f00c7f70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f00c8a00 0x7f38f00c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 --2- 172.21.15.3:0/3202065154 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f38f006a1c0 0x7f38f00c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 >> 172.21.15.3:0/3202065154 conn(0x7f38f00b0b30 msgr2=0x7f38f0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:01.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 shutdown_connections 2023-05-17T11:46:01.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.606+0000 7f38f87a6640 1 -- 172.21.15.3:0/3202065154 wait complete. 2023-05-17T11:46:01.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:01.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:01.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 Processor -- start 2023-05-17T11:46:01.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 -- start start 2023-05-17T11:46:01.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd0580ad440 0x7fd0580afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd0580cb4c0 0x7fd0580b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05809bcb0 con 0x7fd05815d3d0 2023-05-17T11:46:01.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580cdf90 con 0x7fd0580ad440 2023-05-17T11:46:01.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd0606f2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580ca130 con 0x7fd0580cb4c0 2023-05-17T11:46:01.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd0580ad440 0x7fd0580afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd0580ad440 0x7fd0580afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60570/0 (socket says 172.21.15.3:60570) 2023-05-17T11:46:01.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05e48e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd05815d3d0 0x7fd0580ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49502/0 (socket says 172.21.15.3:49502) 2023-05-17T11:46:01.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 -- 172.21.15.3:0/3299437638 learned_addr learned my addr 172.21.15.3:0/3299437638 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:01.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05ec8f640 1 --2- 172.21.15.3:0/3299437638 >> v2:172.21.15.60:3300/0 conn(0x7fd0580cb4c0 0x7fd0580b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 -- 172.21.15.3:0/3299437638 >> v2:172.21.15.60:3300/0 conn(0x7fd0580cb4c0 msgr2=0x7fd0580b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:01.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 --2- 172.21.15.3:0/3299437638 >> v2:172.21.15.60:3300/0 conn(0x7fd0580cb4c0 0x7fd0580b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 -- 172.21.15.3:0/3299437638 >> v1:172.21.15.3:6789/0 conn(0x7fd05815d3d0 legacy=0x7fd0580ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05dc8d640 1 -- 172.21.15.3:0/3299437638 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580cd490 con 0x7fd0580ad440 2023-05-17T11:46:01.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.766+0000 7fd05ec8f640 1 --2- 172.21.15.3:0/3299437638 >> v2:172.21.15.60:3300/0 conn(0x7fd0580cb4c0 0x7fd0580b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:01.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd05dc8d640 1 --2- 172.21.15.3:0/3299437638 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580afdb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ce2e0 tx=0x7fd04801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8c4214d05f4cd0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:01.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd05d48c640 1 -- 172.21.15.3:0/3299437638 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0480af600 con 0x7fd0580ad440 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd05d48c640 1 -- 172.21.15.3:0/3299437638 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0480af760 con 0x7fd0580ad440 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd05d48c640 1 -- 172.21.15.3:0/3299437638 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0480afaf0 con 0x7fd0580ad440 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 -- 172.21.15.3:0/3299437638 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 msgr2=0x7fd0580afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3299437638 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580afdb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ce2e0 tx=0x7fd04801bfb0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 -- 172.21.15.3:0/3299437638 shutdown_connections 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3299437638 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580afdb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3299437638 >> v2:172.21.15.60:3300/0 conn(0x7fd0580cb4c0 0x7fd0580b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 -- 172.21.15.3:0/3299437638 >> 172.21.15.3:0/3299437638 conn(0x7fd05806a740 msgr2=0x7fd0580cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 -- 172.21.15.3:0/3299437638 shutdown_connections 2023-05-17T11:46:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.770+0000 7fd0606f2640 1 -- 172.21.15.3:0/3299437638 wait complete. 2023-05-17T11:46:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 Processor -- start 2023-05-17T11:46:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- start start 2023-05-17T11:46:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0580cb4c0 0x7fd058155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd05815d3d0 0x7fd058150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd058151040 con 0x7fd0580ad440 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd058154ec0 con 0x7fd0580cb4c0 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0581551a0 con 0x7fd05815d3d0 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60578/0 (socket says 172.21.15.3:60578) 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 -- 172.21.15.3:0/3175198101 learned_addr learned my addr 172.21.15.3:0/3175198101 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05ec8f640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd05815d3d0 0x7fd058150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05dc8d640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0580cb4c0 0x7fd058155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 -- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd05815d3d0 msgr2=0x7fd058150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd05815d3d0 0x7fd058150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 -- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0580cb4c0 msgr2=0x7fd058155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0580cb4c0 0x7fd058155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 -- 172.21.15.3:0/3175198101 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0480094d0 con 0x7fd0580ad440 2023-05-17T11:46:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd05e48e640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580c5f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd05400c780 tx=0x7fd05400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:01.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0540072d0 con 0x7fd0580ad440 2023-05-17T11:46:01.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd054007430 con 0x7fd0580ad440 2023-05-17T11:46:01.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0540047f0 con 0x7fd0580ad440 2023-05-17T11:46:01.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0580700c0 con 0x7fd0580ad440 2023-05-17T11:46:01.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05806ff30 con 0x7fd0580ad440 2023-05-17T11:46:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.774+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd058167750 con 0x7fd0580ad440 2023-05-17T11:46:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.778+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd054004950 con 0x7fd0580ad440 2023-05-17T11:46:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.778+0000 7fd04effd640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd03c066280 0x7fd03c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.778+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0540832b0 con 0x7fd0580ad440 2023-05-17T11:46:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.778+0000 7fd05dc8d640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd03c066280 0x7fd03c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.778+0000 7fd05dc8d640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd03c066280 0x7fd03c068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd0480ae000 tx=0x7fd048009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.782+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd054050600 con 0x7fd0580ad440 2023-05-17T11:46:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.934+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd05804de80 con 0x7fd0580ad440 2023-05-17T11:46:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd04effd640 1 -- 172.21.15.3:0/3175198101 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0540180a0 con 0x7fd0580ad440 2023-05-17T11:46:01.947 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:01.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd03c066280 msgr2=0x7fd03c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd03c066280 0x7fd03c068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd0480ae000 tx=0x7fd048009040 comp rx=0 tx=0).stop 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 msgr2=0x7fd0580c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580c5f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd05400c780 tx=0x7fd05400cc40 comp rx=0 tx=0).stop 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 shutdown_connections 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd03c066280 0x7fd03c068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd05815d3d0 0x7fd058150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0580cb4c0 0x7fd058155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 --2- 172.21.15.3:0/3175198101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0580ad440 0x7fd0580c5f10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 >> 172.21.15.3:0/3175198101 conn(0x7fd05806a740 msgr2=0x7fd058153820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 shutdown_connections 2023-05-17T11:46:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:01.938+0000 7fd0606f2640 1 -- 172.21.15.3:0/3175198101 wait complete. 2023-05-17T11:46:01.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cef59e640 1 Processor -- start 2023-05-17T11:46:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cef59e640 1 -- start start 2023-05-17T11:46:02.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cef59e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5cf00b19f0 0x7f5cf00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cef59e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf006abb0 con 0x7f5cf00ceac0 2023-05-17T11:46:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cef59e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00cfdc0 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cef59e640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00cdbd0 con 0x7f5cf00b19f0 2023-05-17T11:46:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cee59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5cf00b19f0 0x7f5cf00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cee59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5cf00b19f0 0x7f5cf00d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60592/0 (socket says 172.21.15.3:60592) 2023-05-17T11:46:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cee59c640 1 -- 172.21.15.3:0/3029330518 learned_addr learned my addr 172.21.15.3:0/3029330518 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5ce5d9b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5cf00ceac0 0x7f5cf00cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49516/0 (socket says 172.21.15.3:49516) 2023-05-17T11:46:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cee59c640 1 -- 172.21.15.3:0/3029330518 >> v1:172.21.15.60:6789/0 conn(0x7f5cf00b1dc0 legacy=0x7f5cf00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cee59c640 1 -- 172.21.15.3:0/3029330518 >> v1:172.21.15.3:6789/0 conn(0x7f5cf00ceac0 legacy=0x7f5cf00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cedd9b640 1 -- 172.21.15.3:0/3029330518 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305416268 0 0) 0x7f5cf006abb0 con 0x7f5cf00ceac0 2023-05-17T11:46:02.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.098+0000 7f5cee59c640 1 -- 172.21.15.3:0/3029330518 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00cdeb0 con 0x7f5cf00b19f0 2023-05-17T11:46:02.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cee59c640 1 --2- 172.21.15.3:0/3029330518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00d03a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009870 tx=0x7f5ce001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f504024de0ca73 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cedd9b640 1 -- 172.21.15.3:0/3029330518 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00ac410 con 0x7f5cf00b19f0 2023-05-17T11:46:02.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cedd9b640 1 -- 172.21.15.3:0/3029330518 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce00ac570 con 0x7f5cf00b19f0 2023-05-17T11:46:02.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cedd9b640 1 -- 172.21.15.3:0/3029330518 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00ac900 con 0x7f5cf00b19f0 2023-05-17T11:46:02.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 -- 172.21.15.3:0/3029330518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b19f0 msgr2=0x7f5cf00d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 --2- 172.21.15.3:0/3029330518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00d03a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009870 tx=0x7f5ce001c3b0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 -- 172.21.15.3:0/3029330518 shutdown_connections 2023-05-17T11:46:02.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 --2- 172.21.15.3:0/3029330518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00d03a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 -- 172.21.15.3:0/3029330518 >> 172.21.15.3:0/3029330518 conn(0x7f5cf009bb20 msgr2=0x7f5cf00d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:02.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 -- 172.21.15.3:0/3029330518 shutdown_connections 2023-05-17T11:46:02.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.102+0000 7f5cef59e640 1 -- 172.21.15.3:0/3029330518 wait complete. 2023-05-17T11:46:02.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 Processor -- start 2023-05-17T11:46:02.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 -- start start 2023-05-17T11:46:02.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 0x7f5cf00c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5cf00ceac0 0x7f5cf0158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00c9de0 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00c6420 con 0x7f5cf00b19f0 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0158770 con 0x7f5cf00ceac0 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 0x7f5cf00c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 0x7f5cf00c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60594/0 (socket says 172.21.15.3:60594) 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 -- 172.21.15.3:0/326775323 learned_addr learned my addr 172.21.15.3:0/326775323 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cee59c640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ceed9d640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5cf00ceac0 0x7f5cf0158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 -- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5cf00ceac0 msgr2=0x7f5cf0158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5cf00ceac0 0x7f5cf0158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 -- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cf00b19f0 msgr2=0x7f5cf00cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 -- 172.21.15.3:0/326775323 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00094d0 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce5d9b640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 0x7f5cf00c98a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c4b0 tx=0x7f5cd800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80074e0 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8007660 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8004a30 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf00d08e0 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.106+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf00cd830 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.110+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf00d0a70 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.110+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5cd8004b90 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.110+0000 7f5ce77fe640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.110+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5cd8082ec0 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.110+0000 7f5cee59c640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.110+0000 7f5cee59c640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00ae000 tx=0x7f5ce00a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.114+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5cd8050410 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.266+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cf006a440 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.266+0000 7f5ce77fe640 1 -- 172.21.15.3:0/326775323 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5cd8018020 con 0x7f5cf00b1dc0 2023-05-17T11:46:02.278 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:02.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 msgr2=0x7f5cd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00ae000 tx=0x7f5ce00a6040 comp rx=0 tx=0).stop 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 msgr2=0x7f5cf00c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 0x7f5cf00c98a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c4b0 tx=0x7f5cd800c970 comp rx=0 tx=0).stop 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 shutdown_connections 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5cf00ceac0 0x7f5cf0158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5cf00b1dc0 0x7f5cf00c98a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 --2- 172.21.15.3:0/326775323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cf00b19f0 0x7f5cf00cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 >> 172.21.15.3:0/326775323 conn(0x7f5cf009bb20 msgr2=0x7f5cf00728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:02.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 shutdown_connections 2023-05-17T11:46:02.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.270+0000 7f5cef59e640 1 -- 172.21.15.3:0/326775323 wait complete. 2023-05-17T11:46:02.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:02.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.426+0000 7f5682f98640 1 Processor -- start 2023-05-17T11:46:02.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.426+0000 7f5682f98640 1 -- start start 2023-05-17T11:46:02.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5682f98640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5682f98640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f567c0b04c0 0x7f567c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5682f98640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c09bcb0 con 0x7f567c0cd2c0 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5682f98640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0cdf90 con 0x7f567c0b04c0 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5682f98640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0ca130 con 0x7f567c15d3d0 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5681535640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f567c0b04c0 0x7f567c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f567c0cd2c0 0x7f567c0afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49524/0 (socket says 172.21.15.3:49524) 2023-05-17T11:46:02.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567bfff640 1 -- 172.21.15.3:0/1896472669 learned_addr learned my addr 172.21.15.3:0/1896472669 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:02.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5680d34640 1 --2- 172.21.15.3:0/1896472669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567b7fe640 1 -- 172.21.15.3:0/1896472669 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310655640 0 0) 0x7f567c09bcb0 con 0x7f567c0cd2c0 2023-05-17T11:46:02.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567b7fe640 1 -- 172.21.15.3:0/1896472669 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f566c003530 con 0x7f567c0cd2c0 2023-05-17T11:46:02.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5681535640 1 -- 172.21.15.3:0/1896472669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 msgr2=0x7f567c0ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:02.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5681535640 1 --2- 172.21.15.3:0/1896472669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c0ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5681535640 1 -- 172.21.15.3:0/1896472669 >> v1:172.21.15.3:6789/0 conn(0x7f567c0cd2c0 legacy=0x7f567c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5681535640 1 -- 172.21.15.3:0/1896472669 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c09bf00 con 0x7f567c0b04c0 2023-05-17T11:46:02.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f5681535640 1 --2- 172.21.15.3:0/1896472669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06fb20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5674009d90 tx=0x7f567401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f493850b2fbd24d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567b7fe640 1 -- 172.21.15.3:0/1896472669 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5870 con 0x7f567c0b04c0 2023-05-17T11:46:02.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567b7fe640 1 -- 172.21.15.3:0/1896472669 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740a59d0 con 0x7f567c0b04c0 2023-05-17T11:46:02.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.430+0000 7f567b7fe640 1 -- 172.21.15.3:0/1896472669 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5d60 con 0x7f567c0b04c0 2023-05-17T11:46:02.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- 172.21.15.3:0/1896472669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 msgr2=0x7f567c06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 --2- 172.21.15.3:0/1896472669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06fb20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5674009d90 tx=0x7f567401c8c0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- 172.21.15.3:0/1896472669 shutdown_connections 2023-05-17T11:46:02.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 --2- 172.21.15.3:0/1896472669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06fb20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 --2- 172.21.15.3:0/1896472669 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c0ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- 172.21.15.3:0/1896472669 >> 172.21.15.3:0/1896472669 conn(0x7f567c06a740 msgr2=0x7f567c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:02.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- 172.21.15.3:0/1896472669 shutdown_connections 2023-05-17T11:46:02.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- 172.21.15.3:0/1896472669 wait complete. 2023-05-17T11:46:02.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 Processor -- start 2023-05-17T11:46:02.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- start start 2023-05-17T11:46:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f567c0cd2c0 0x7f567c152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c06c3f0 con 0x7f567c0b04c0 2023-05-17T11:46:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1633b0 con 0x7f567c0cd2c0 2023-05-17T11:46:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5682f98640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c163690 con 0x7f567c15d3d0 2023-05-17T11:46:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5680d34640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5680d34640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60608/0 (socket says 172.21.15.3:60608) 2023-05-17T11:46:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5680d34640 1 -- 172.21.15.3:0/1679678097 learned_addr learned my addr 172.21.15.3:0/1679678097 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:02.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5681535640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5680d34640 1 -- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 msgr2=0x7f567c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5680d34640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c06caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f567bfff640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f567c0cd2c0 0x7f567c152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.434+0000 7f5680d34640 1 -- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f567c0cd2c0 msgr2=0x7f567c152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5680d34640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f567c0cd2c0 0x7f567c152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5680d34640 1 -- 172.21.15.3:0/1679678097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674009a70 con 0x7f567c0b04c0 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5681535640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f567bfff640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f567c0cd2c0 0x7f567c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5680d34640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06beb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f567000e870 tx=0x7f567000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670009510 con 0x7f567c0b04c0 2023-05-17T11:46:02.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567000eec0 con 0x7f567c0b04c0 2023-05-17T11:46:02.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567000cb40 con 0x7f567c0b04c0 2023-05-17T11:46:02.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c070060 con 0x7f567c0b04c0 2023-05-17T11:46:02.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c15d7a0 con 0x7f567c0b04c0 2023-05-17T11:46:02.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c0701f0 con 0x7f567c0b04c0 2023-05-17T11:46:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f567000cca0 con 0x7f567c0b04c0 2023-05-17T11:46:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f56797fa640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f56600662b0 0x7f5660068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5670083e90 con 0x7f567c0b04c0 2023-05-17T11:46:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.438+0000 7f567bfff640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f56600662b0 0x7f5660068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.442+0000 7f567bfff640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f56600662b0 0x7f5660068760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f567c1f7c80 tx=0x7f5668009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.442+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5670051270 con 0x7f567c0b04c0 2023-05-17T11:46:02.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f567c163850 con 0x7f567c0b04c0 2023-05-17T11:46:02.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f56797fa640 1 -- 172.21.15.3:0/1679678097 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5670017020 con 0x7f567c0b04c0 2023-05-17T11:46:02.608 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:02.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f56600662b0 msgr2=0x7f5660068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f56600662b0 0x7f5660068760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f567c1f7c80 tx=0x7f5668009040 comp rx=0 tx=0).stop 2023-05-17T11:46:02.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 msgr2=0x7f567c06beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06beb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f567000e870 tx=0x7f567000ec70 comp rx=0 tx=0).stop 2023-05-17T11:46:02.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 shutdown_connections 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f56600662b0 0x7f5660068760 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f567c15d3d0 0x7f567c06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f567c0cd2c0 0x7f567c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 --2- 172.21.15.3:0/1679678097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f567c0b04c0 0x7f567c06beb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 >> 172.21.15.3:0/1679678097 conn(0x7f567c06a740 msgr2=0x7f567c156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 shutdown_connections 2023-05-17T11:46:02.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.598+0000 7f5682f98640 1 -- 172.21.15.3:0/1679678097 wait complete. 2023-05-17T11:46:02.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb154495640 1 Processor -- start 2023-05-17T11:46:02.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb154495640 1 -- start start 2023-05-17T11:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb154495640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 0x7fb14c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb154495640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c15c760 con 0x7fb14c0cf060 2023-05-17T11:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb154495640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0ccd40 con 0x7fb14c06d940 2023-05-17T11:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb154495640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0cdf60 con 0x7fb14c0cec30 2023-05-17T11:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb152a32640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb14c0cf060 0x7fb14c0c9ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49530/0 (socket says 172.21.15.3:49530) 2023-05-17T11:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb152a32640 1 -- 172.21.15.3:0/1258145170 learned_addr learned my addr 172.21.15.3:0/1258145170 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb151a30640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 0x7fb14c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784006424 0 0) 0x7fb14c15c760 con 0x7fb14c0cf060 2023-05-17T11:46:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138003530 con 0x7fb14c0cf060 2023-05-17T11:46:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460508646 0 0) 0x7fb138003530 con 0x7fb14c0cf060 2023-05-17T11:46:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 msgr2=0x7fb14c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 0x7fb14c0cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 >> v1:172.21.15.60:6789/0 conn(0x7fb14c06d940 legacy=0x7fb14c06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0cca60 con 0x7fb14c0cf060 2023-05-17T11:46:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fb144001a00 con 0x7fb14c0cf060 2023-05-17T11:46:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 >> v1:172.21.15.3:6789/0 conn(0x7fb14c0cf060 legacy=0x7fb14c0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 0x7fb1380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138003ef0 0x7fb1380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb138005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800b990 con 0x7fb138004d10 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800bb00 con 0x7fb138003ef0 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800bcc0 con 0x7fb14c0cec30 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb152a32640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb138005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.762+0000 7fb152231640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 0x7fb1380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb151a30640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138003ef0 0x7fb1380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 -- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 msgr2=0x7fb1380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:02.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c0cec30 0x7fb1380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 -- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138003ef0 msgr2=0x7fb1380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:02.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138003ef0 0x7fb1380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 -- 172.21.15.3:0/1258145170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138003530 con 0x7fb138004d10 2023-05-17T11:46:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb138005180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb14c070c20 tx=0x7fb14401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40241fc486b404b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1440aa670 con 0x7fb138004d10 2023-05-17T11:46:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1440aa7f0 con 0x7fb138004d10 2023-05-17T11:46:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb15122f640 1 -- 172.21.15.3:0/1258145170 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1440aabe0 con 0x7fb138004d10 2023-05-17T11:46:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb154495640 1 -- 172.21.15.3:0/1258145170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 msgr2=0x7fb138005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb154495640 1 --2- 172.21.15.3:0/1258145170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb138005180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb14c070c20 tx=0x7fb14401fa40 comp rx=0 tx=0).stop 2023-05-17T11:46:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb152a32640 1 -- 172.21.15.3:0/1258145170 reap_dead start 2023-05-17T11:46:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb154495640 1 -- 172.21.15.3:0/1258145170 shutdown_connections 2023-05-17T11:46:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.766+0000 7fb154495640 1 -- 172.21.15.3:0/1258145170 >> 172.21.15.3:0/1258145170 conn(0x7fb14c06b4e0 msgr2=0x7fb14c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 -- 172.21.15.3:0/1258145170 shutdown_connections 2023-05-17T11:46:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 -- 172.21.15.3:0/1258145170 wait complete. 2023-05-17T11:46:02.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 Processor -- start 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 -- start start 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb14c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c1e5ee0 0x7fb14c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb14c1e5240 0x7fb14c0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c45b0 con 0x7fb138004d10 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c39c0 con 0x7fb14c1e5240 2023-05-17T11:46:02.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb154495640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c14f1e0 con 0x7fb14c1e5ee0 2023-05-17T11:46:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb14c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb14c0c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60626/0 (socket says 172.21.15.3:60626) 2023-05-17T11:46:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 -- 172.21.15.3:0/3046913215 learned_addr learned my addr 172.21.15.3:0/3046913215 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb151a30640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c1e5ee0 0x7fb14c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152a32640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb14c1e5240 0x7fb14c0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 -- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c1e5ee0 msgr2=0x7fb14c14eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c1e5ee0 0x7fb14c14eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 -- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb14c1e5240 msgr2=0x7fb14c0b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb14c1e5240 0x7fb14c0b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 -- 172.21.15.3:0/3046913215 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0ce430 con 0x7fb138004d10 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.770+0000 7fb152231640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb14c0c49d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb14800f7f0 tx=0x7fb14800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480050d0 con 0x7fb138004d10 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148005250 con 0x7fb138004d10 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0ce150 con 0x7fb138004d10 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800d6d0 con 0x7fb138004d10 2023-05-17T11:46:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c0ce710 con 0x7fb138004d10 2023-05-17T11:46:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c0c46f0 con 0x7fb138004d10 2023-05-17T11:46:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb14800d830 con 0x7fb138004d10 2023-05-17T11:46:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb142ffd640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb130066280 0x7fb130068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:02.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb148083c90 con 0x7fb138004d10 2023-05-17T11:46:02.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb151a30640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb130066280 0x7fb130068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:02.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.774+0000 7fb151a30640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb130066280 0x7fb130068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb14c06e010 tx=0x7fb13c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.778+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb14c0c46f0 con 0x7fb138004d10 2023-05-17T11:46:02.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.934+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb14c0c46f0 con 0x7fb138004d10 2023-05-17T11:46:02.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb142ffd640 1 -- 172.21.15.3:0/3046913215 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb14c0c46f0 con 0x7fb138004d10 2023-05-17T11:46:02.947 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:02.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb130066280 msgr2=0x7fb130068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb130066280 0x7fb130068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb14c06e010 tx=0x7fb13c009190 comp rx=0 tx=0).stop 2023-05-17T11:46:02.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 msgr2=0x7fb14c0c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:02.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb14c0c49d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb14800f7f0 tx=0x7fb14800fbf0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 shutdown_connections 2023-05-17T11:46:02.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb130066280 0x7fb130068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb14c1e5240 0x7fb14c0b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb14c1e5ee0 0x7fb14c14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 --2- 172.21.15.3:0/3046913215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb138004d10 0x7fb14c0c49d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:02.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 >> 172.21.15.3:0/3046913215 conn(0x7fb14c06b4e0 msgr2=0x7fb14c15b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:02.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 shutdown_connections 2023-05-17T11:46:02.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:02.938+0000 7fb154495640 1 -- 172.21.15.3:0/3046913215 wait complete. 2023-05-17T11:46:02.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:03.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 Processor -- start 2023-05-17T11:46:03.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 -- start start 2023-05-17T11:46:03.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3d9406cd50 0x7f3d94065980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d94160ac0 0x7f3d9406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d94161010 con 0x7f3d9415c5c0 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d94069b50 con 0x7f3d9406cd50 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d9a7bc640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9415c990 con 0x7f3d94160ac0 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3d9406cd50 0x7f3d94065980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3d9406cd50 0x7f3d94065980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60640/0 (socket says 172.21.15.3:60640) 2023-05-17T11:46:03.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 -- 172.21.15.3:0/2480800476 learned_addr learned my addr 172.21.15.3:0/2480800476 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d98d59640 1 --2- 172.21.15.3:0/2480800476 >> v2:172.21.15.60:3300/0 conn(0x7f3d94160ac0 0x7f3d9406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 -- 172.21.15.3:0/2480800476 >> v2:172.21.15.60:3300/0 conn(0x7f3d94160ac0 msgr2=0x7f3d9406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 --2- 172.21.15.3:0/2480800476 >> v2:172.21.15.60:3300/0 conn(0x7f3d94160ac0 0x7f3d9406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 -- 172.21.15.3:0/2480800476 >> v1:172.21.15.60:6789/0 conn(0x7f3d9415c5c0 legacy=0x7f3d9406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.094+0000 7f3d937fe640 1 -- 172.21.15.3:0/2480800476 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940c9320 con 0x7f3d9406cd50 2023-05-17T11:46:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d937fe640 1 --2- 172.21.15.3:0/2480800476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9406cd50 0x7f3d94065980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3d940cc7f0 tx=0x7f3d8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6faf2ebeefca89 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d92ffd640 1 -- 172.21.15.3:0/2480800476 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880aa5f0 con 0x7f3d9406cd50 2023-05-17T11:46:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d92ffd640 1 -- 172.21.15.3:0/2480800476 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880aa750 con 0x7f3d9406cd50 2023-05-17T11:46:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d92ffd640 1 -- 172.21.15.3:0/2480800476 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880aaae0 con 0x7f3d9406cd50 2023-05-17T11:46:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/2480800476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9406cd50 msgr2=0x7f3d94065980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/2480800476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9406cd50 0x7f3d94065980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3d940cc7f0 tx=0x7f3d8801c490 comp rx=0 tx=0).stop 2023-05-17T11:46:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/2480800476 shutdown_connections 2023-05-17T11:46:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/2480800476 >> v2:172.21.15.60:3300/0 conn(0x7f3d94160ac0 0x7f3d9406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/2480800476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9406cd50 0x7f3d94065980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/2480800476 >> 172.21.15.3:0/2480800476 conn(0x7f3d940b1530 msgr2=0x7f3d940cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/2480800476 shutdown_connections 2023-05-17T11:46:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.098+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/2480800476 wait complete. 2023-05-17T11:46:03.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 Processor -- start 2023-05-17T11:46:03.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 -- start start 2023-05-17T11:46:03.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3d9406cd50 0x7f3d94151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 0x7f3d940ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d94160ac0 0x7f3d94070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941523e0 con 0x7f3d9415c5c0 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9415abd0 con 0x7f3d94160ac0 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9415a050 con 0x7f3d9406cd50 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 0x7f3d940ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 0x7f3d940ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60656/0 (socket says 172.21.15.3:60656) 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 -- 172.21.15.3:0/3656640304 learned_addr learned my addr 172.21.15.3:0/3656640304 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:03.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d93fff640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3d9406cd50 0x7f3d94151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d98d59640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d94160ac0 0x7f3d94070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 -- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3d9406cd50 msgr2=0x7f3d94151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3d9406cd50 0x7f3d94151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 -- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d94160ac0 msgr2=0x7f3d94070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d94160ac0 0x7f3d94070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 -- 172.21.15.3:0/3656640304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880094d0 con 0x7f3d9415c5c0 2023-05-17T11:46:03.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d937fe640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 0x7f3d940ad530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ac040 tx=0x7f3d8801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880b3800 con 0x7f3d9415c5c0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880b3960 con 0x7f3d9415c5c0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d940cd050 con 0x7f3d9415c5c0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880b3cf0 con 0x7f3d9415c5c0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.102+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940ce910 con 0x7f3d9415c5c0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.106+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d940cd1e0 con 0x7f3d9415c5c0 2023-05-17T11:46:03.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.106+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d880c6390 con 0x7f3d9415c5c0 2023-05-17T11:46:03.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.106+0000 7f3d90ff9640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3d80066280 0x7f3d80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.106+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d880a7070 con 0x7f3d9415c5c0 2023-05-17T11:46:03.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.106+0000 7f3d93fff640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3d80066280 0x7f3d80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.106+0000 7f3d93fff640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3d80066280 0x7f3d80068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004e30 tx=0x7f3d84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.110+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3d880ebb10 con 0x7f3d9415c5c0 2023-05-17T11:46:03.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d9404de80 con 0x7f3d9415c5c0 2023-05-17T11:46:03.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d90ff9640 1 -- 172.21.15.3:0/3656640304 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f3d880ef130 con 0x7f3d9415c5c0 2023-05-17T11:46:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:03.277 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:03.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3d80066280 msgr2=0x7f3d80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3d80066280 0x7f3d80068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004e30 tx=0x7f3d84009040 comp rx=0 tx=0).stop 2023-05-17T11:46:03.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 msgr2=0x7f3d940ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 0x7f3d940ad530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ac040 tx=0x7f3d8801acd0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 shutdown_connections 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3d80066280 0x7f3d80068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d94160ac0 0x7f3d94070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d9415c5c0 0x7f3d940ad530 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 --2- 172.21.15.3:0/3656640304 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3d9406cd50 0x7f3d94151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 >> 172.21.15.3:0/3656640304 conn(0x7f3d940b1530 msgr2=0x7f3d94158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 shutdown_connections 2023-05-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.266+0000 7f3d9a7bc640 1 -- 172.21.15.3:0/3656640304 wait complete. 2023-05-17T11:46:03.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:03.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:03.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 Processor -- start 2023-05-17T11:46:03.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 -- start start 2023-05-17T11:46:03.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00b2950 0x7fdcf009bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdcf00ad760 0x7fdcf00cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdcf00cddf0 0x7fdcf00c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf006d020 con 0x7fdcf00cddf0 2023-05-17T11:46:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf00b2d20 con 0x7fdcf00ad760 2023-05-17T11:46:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf6641640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01591b0 con 0x7fdcf00b2950 2023-05-17T11:46:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdcf00cddf0 0x7fdcf00c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdcf00cddf0 0x7fdcf00c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60664/0 (socket says 172.21.15.3:60664) 2023-05-17T11:46:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 -- 172.21.15.3:0/3555514164 learned_addr learned my addr 172.21.15.3:0/3555514164 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcef7fe640 1 --2- 172.21.15.3:0/3555514164 >> v2:172.21.15.60:3300/0 conn(0x7fdcf00ad760 0x7fdcf00cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdceffff640 1 --2- 172.21.15.3:0/3555514164 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00b2950 0x7fdcf009bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 -- 172.21.15.3:0/3555514164 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00b2950 msgr2=0x7fdcf009bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 --2- 172.21.15.3:0/3555514164 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00b2950 0x7fdcf009bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 -- 172.21.15.3:0/3555514164 >> v2:172.21.15.60:3300/0 conn(0x7fdcf00ad760 msgr2=0x7fdcf00cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 --2- 172.21.15.3:0/3555514164 >> v2:172.21.15.60:3300/0 conn(0x7fdcf00ad760 0x7fdcf00cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.430+0000 7fdcf4bde640 1 -- 172.21.15.3:0/3555514164 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf00adb90 con 0x7fdcf00cddf0 2023-05-17T11:46:03.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf4bde640 1 --2- 172.21.15.3:0/3555514164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00cddf0 0x7fdcf00c8980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0068090 tx=0x7fdce801e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489ec090ba6eec5b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdceeffd640 1 -- 172.21.15.3:0/3555514164 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80a7780 con 0x7fdcf00cddf0 2023-05-17T11:46:03.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdceeffd640 1 -- 172.21.15.3:0/3555514164 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce80a78e0 con 0x7fdcf00cddf0 2023-05-17T11:46:03.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdceeffd640 1 -- 172.21.15.3:0/3555514164 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80a7c70 con 0x7fdcf00cddf0 2023-05-17T11:46:03.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 -- 172.21.15.3:0/3555514164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00cddf0 msgr2=0x7fdcf00c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 --2- 172.21.15.3:0/3555514164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00cddf0 0x7fdcf00c8980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0068090 tx=0x7fdce801e8f0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 -- 172.21.15.3:0/3555514164 shutdown_connections 2023-05-17T11:46:03.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 --2- 172.21.15.3:0/3555514164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00cddf0 0x7fdcf00c8980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 --2- 172.21.15.3:0/3555514164 >> v2:172.21.15.60:3300/0 conn(0x7fdcf00ad760 0x7fdcf00cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 --2- 172.21.15.3:0/3555514164 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00b2950 0x7fdcf009bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 -- 172.21.15.3:0/3555514164 >> 172.21.15.3:0/3555514164 conn(0x7fdcf006a740 msgr2=0x7fdcf00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:03.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 -- 172.21.15.3:0/3555514164 shutdown_connections 2023-05-17T11:46:03.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 -- 172.21.15.3:0/3555514164 wait complete. 2023-05-17T11:46:03.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 Processor -- start 2023-05-17T11:46:03.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.434+0000 7fdcf6641640 1 -- start start 2023-05-17T11:46:03.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00ad760 0x7fdcf00b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 0x7fdcf0070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf00cddf0 0x7fdcf0158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0070690 con 0x7fdcf00b2950 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0158b50 con 0x7fdcf00cddf0 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00708a0 con 0x7fdcf00ad760 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 0x7fdcf0070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 0x7fdcf0070150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60680/0 (socket says 172.21.15.3:60680) 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 -- 172.21.15.3:0/2558529725 learned_addr learned my addr 172.21.15.3:0/2558529725 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf4bde640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf00cddf0 0x7fdcf0158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdceffff640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00ad760 0x7fdcf00b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 -- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00ad760 msgr2=0x7fdcf00b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00ad760 0x7fdcf00b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 -- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf00cddf0 msgr2=0x7fdcf0158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf00cddf0 0x7fdcf0158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 -- 172.21.15.3:0/2558529725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009b30 con 0x7fdcf00b2950 2023-05-17T11:46:03.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcef7fe640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 0x7fdcf0070150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdce400d800 tx=0x7fdce400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400b6c0 con 0x7fdcf00b2950 2023-05-17T11:46:03.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400b820 con 0x7fdcf00b2950 2023-05-17T11:46:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf006d490 con 0x7fdcf00b2950 2023-05-17T11:46:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400bb90 con 0x7fdcf00b2950 2023-05-17T11:46:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf00cc380 con 0x7fdcf00b2950 2023-05-17T11:46:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.438+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00cb8d0 con 0x7fdcf00b2950 2023-05-17T11:46:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.442+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdce400bcf0 con 0x7fdcf00b2950 2023-05-17T11:46:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.442+0000 7fdcecff9640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdcdc066280 0x7fdcdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.442+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdce40842b0 con 0x7fdcf00b2950 2023-05-17T11:46:03.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.442+0000 7fdceffff640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdcdc066280 0x7fdcdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.442+0000 7fdceffff640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdcdc066280 0x7fdcdc068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdce000b950 tx=0x7fdce0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.446+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdce40551b0 con 0x7fdcf00b2950 2023-05-17T11:46:03.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcf004de80 con 0x7fdcf00b2950 2023-05-17T11:46:03.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcecff9640 1 -- 172.21.15.3:0/2558529725 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdce4054d40 con 0x7fdcf00b2950 2023-05-17T11:46:03.608 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:03.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdcdc066280 msgr2=0x7fdcdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdcdc066280 0x7fdcdc068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdce000b950 tx=0x7fdce0008040 comp rx=0 tx=0).stop 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 msgr2=0x7fdcf0070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 0x7fdcf0070150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdce400d800 tx=0x7fdce400dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 shutdown_connections 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdcdc066280 0x7fdcdc068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf00cddf0 0x7fdcf0158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf00b2950 0x7fdcf0070150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 --2- 172.21.15.3:0/2558529725 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdcf00ad760 0x7fdcf00b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.598+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 >> 172.21.15.3:0/2558529725 conn(0x7fdcf006a740 msgr2=0x7fdcf00cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:03.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.602+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 shutdown_connections 2023-05-17T11:46:03.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.602+0000 7fdcf6641640 1 -- 172.21.15.3:0/2558529725 wait complete. 2023-05-17T11:46:03.629 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:03.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.758+0000 7f2e8c3e1640 1 Processor -- start 2023-05-17T11:46:03.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.758+0000 7f2e8c3e1640 1 -- start start 2023-05-17T11:46:03.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.758+0000 7f2e8c3e1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e840ad440 0x7f2e840afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.758+0000 7f2e8c3e1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 0x7f2e840b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.758+0000 7f2e8c3e1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8409bcb0 con 0x7f2e8415d3d0 2023-05-17T11:46:03.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.758+0000 7f2e8c3e1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e840cdf90 con 0x7f2e840ad440 2023-05-17T11:46:03.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8c3e1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840ca130 con 0x7f2e840cb4c0 2023-05-17T11:46:03.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a17d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2e8415d3d0 0x7f2e840ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49544/0 (socket says 172.21.15.3:49544) 2023-05-17T11:46:03.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a17d640 1 -- 172.21.15.3:0/4265766356 learned_addr learned my addr 172.21.15.3:0/4265766356 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:03.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 0x7f2e840b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8997c640 1 --2- 172.21.15.3:0/4265766356 >> v2:172.21.15.60:3300/0 conn(0x7f2e840ad440 0x7f2e840afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503283121 0 0) 0x7f2e8409bcb0 con 0x7f2e8415d3d0 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e70003530 con 0x7f2e8415d3d0 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668037967 0 0) 0x7f2e70003530 con 0x7f2e8415d3d0 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 msgr2=0x7f2e840b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 0x7f2e840b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 >> v2:172.21.15.60:3300/0 conn(0x7f2e840ad440 msgr2=0x7f2e840afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 --2- 172.21.15.3:0/4265766356 >> v2:172.21.15.60:3300/0 conn(0x7f2e840ad440 0x7f2e840afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840cd490 con 0x7f2e8415d3d0 2023-05-17T11:46:03.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f2e80001680 con 0x7f2e8415d3d0 2023-05-17T11:46:03.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 >> v1:172.21.15.3:6789/0 conn(0x7f2e8415d3d0 legacy=0x7f2e840ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 0x7f2e70003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e70003f00 0x7f2e700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e70004d10 0x7f2e70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840ca130 con 0x7f2e70004d10 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7000b9f0 con 0x7f2e70003f00 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7000bbb0 con 0x7f2e840cb4c0 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e70004d10 0x7f2e70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a17d640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 0x7f2e70003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8997c640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e70003f00 0x7f2e700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 -- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 msgr2=0x7f2e70003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e840cb4c0 0x7f2e70003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 -- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e70003f00 msgr2=0x7f2e700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:03.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e70003f00 0x7f2e700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8a97e640 1 -- 172.21.15.3:0/4265766356 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70003530 con 0x7f2e70004d10 2023-05-17T11:46:03.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.762+0000 7f2e8997c640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e70003f00 0x7f2e700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:03.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e70004d10 0x7f2e70005180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009f90 tx=0x7f2e7c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c5772e791193d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0a5a10 con 0x7f2e70004d10 2023-05-17T11:46:03.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00f040 con 0x7f2e70004d10 2023-05-17T11:46:03.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8917b640 1 -- 172.21.15.3:0/4265766356 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0a5db0 con 0x7f2e70004d10 2023-05-17T11:46:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/4265766356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e70004d10 msgr2=0x7f2e70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/4265766356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e70004d10 0x7f2e70005180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009f90 tx=0x7f2e7c01cc20 comp rx=0 tx=0).stop 2023-05-17T11:46:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8a97e640 1 -- 172.21.15.3:0/4265766356 reap_dead start 2023-05-17T11:46:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/4265766356 shutdown_connections 2023-05-17T11:46:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/4265766356 >> 172.21.15.3:0/4265766356 conn(0x7f2e8406a740 msgr2=0x7f2e840cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/4265766356 shutdown_connections 2023-05-17T11:46:03.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/4265766356 wait complete. 2023-05-17T11:46:03.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 Processor -- start 2023-05-17T11:46:03.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.766+0000 7f2e8c3e1640 1 -- start start 2023-05-17T11:46:03.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e70004d10 0x7f2e84162510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 0x7f2e841572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e840aed00 0x7f2e841520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8406c210 con 0x7f2e840c5400 2023-05-17T11:46:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84152f70 con 0x7f2e840aed00 2023-05-17T11:46:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8406b600 con 0x7f2e70004d10 2023-05-17T11:46:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 0x7f2e841572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 0x7f2e841572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60698/0 (socket says 172.21.15.3:60698) 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 -- 172.21.15.3:0/3890577931 learned_addr learned my addr 172.21.15.3:0/3890577931 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8a17d640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e70004d10 0x7f2e84162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e840aed00 0x7f2e841520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 -- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e70004d10 msgr2=0x7f2e84162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e70004d10 0x7f2e84162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 -- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e840aed00 msgr2=0x7f2e841520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e840aed00 0x7f2e841520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 -- 172.21.15.3:0/3890577931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8415d7a0 con 0x7f2e840c5400 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8a17d640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e70004d10 0x7f2e84162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8a97e640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e840aed00 0x7f2e841520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8997c640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 0x7f2e841572c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e74011590 tx=0x7f2e74011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74004220 con 0x7f2e840c5400 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74004380 con 0x7f2e840c5400 2023-05-17T11:46:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740158b0 con 0x7f2e840c5400 2023-05-17T11:46:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e840ca6b0 con 0x7f2e840c5400 2023-05-17T11:46:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e84164b20 con 0x7f2e840c5400 2023-05-17T11:46:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8406c380 con 0x7f2e840c5400 2023-05-17T11:46:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.770+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e74015a10 con 0x7f2e840c5400 2023-05-17T11:46:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.774+0000 7f2e7affd640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e68066280 0x7f2e68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.774+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e740841b0 con 0x7f2e840c5400 2023-05-17T11:46:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.774+0000 7f2e8a17d640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e68066280 0x7f2e68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.774+0000 7f2e8a17d640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e68066280 0x7f2e68068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e800010f0 tx=0x7f2e80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:03.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.778+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2e74055150 con 0x7f2e840c5400 2023-05-17T11:46:03.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.930+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e8404de80 con 0x7f2e840c5400 2023-05-17T11:46:03.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.930+0000 7f2e7affd640 1 -- 172.21.15.3:0/3890577931 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e740044f0 con 0x7f2e840c5400 2023-05-17T11:46:03.942 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:03.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e68066280 msgr2=0x7f2e68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e68066280 0x7f2e68068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e800010f0 tx=0x7f2e80009040 comp rx=0 tx=0).stop 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 msgr2=0x7f2e841572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 0x7f2e841572c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e74011590 tx=0x7f2e74011a50 comp rx=0 tx=0).stop 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 shutdown_connections 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e68066280 0x7f2e68068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e840aed00 0x7f2e841520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e840c5400 0x7f2e841572c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 --2- 172.21.15.3:0/3890577931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e70004d10 0x7f2e84162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:03.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 >> 172.21.15.3:0/3890577931 conn(0x7f2e8406a740 msgr2=0x7f2e840ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:03.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 shutdown_connections 2023-05-17T11:46:03.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:03.934+0000 7f2e8c3e1640 1 -- 172.21.15.3:0/3890577931 wait complete. 2023-05-17T11:46:03.962 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:04.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.090+0000 7f4c3c4d1640 1 Processor -- start 2023-05-17T11:46:04.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.090+0000 7f4c3c4d1640 1 -- start start 2023-05-17T11:46:04.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3c4d1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3c4d1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4c340cd2c0 0x7f4c340afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3c4d1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c340ad440 0x7f4c340b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3c4d1640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c340cdf90 con 0x7f4c340cd2c0 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3c4d1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3409bcb0 con 0x7f4c340ad440 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3c4d1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3409bf00 con 0x7f4c3415d3d0 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4c340cd2c0 0x7f4c340afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4c340cd2c0 0x7f4c340afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60706/0 (socket says 172.21.15.3:60706) 2023-05-17T11:46:04.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 -- 172.21.15.3:0/3228967069 learned_addr learned my addr 172.21.15.3:0/3228967069 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:04.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3aa6e640 1 --2- 172.21.15.3:0/3228967069 >> v2:172.21.15.60:3300/0 conn(0x7f4c340ad440 0x7f4c340b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3a26d640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 -- 172.21.15.3:0/3228967069 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 msgr2=0x7f4c340ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:04.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 -- 172.21.15.3:0/3228967069 >> v2:172.21.15.60:3300/0 conn(0x7f4c340ad440 msgr2=0x7f4c340b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:04.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3228967069 >> v2:172.21.15.60:3300/0 conn(0x7f4c340ad440 0x7f4c340b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c39a6c640 1 -- 172.21.15.3:0/3228967069 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340ca3d0 con 0x7f4c340cd2c0 2023-05-17T11:46:04.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.094+0000 7f4c3a26d640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:04.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340cd2c0 0x7f4c340afdb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4c340c1e30 tx=0x7f4c2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bff772df1d5adba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3926b640 1 -- 172.21.15.3:0/3228967069 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240ab600 con 0x7f4c340cd2c0 2023-05-17T11:46:04.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3926b640 1 -- 172.21.15.3:0/3228967069 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c240a7050 con 0x7f4c340cd2c0 2023-05-17T11:46:04.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3926b640 1 -- 172.21.15.3:0/3228967069 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240ab980 con 0x7f4c340cd2c0 2023-05-17T11:46:04.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3228967069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340cd2c0 msgr2=0x7f4c340afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340cd2c0 0x7f4c340afdb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4c340c1e30 tx=0x7f4c2401c470 comp rx=0 tx=0).stop 2023-05-17T11:46:04.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3228967069 shutdown_connections 2023-05-17T11:46:04.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3228967069 >> v2:172.21.15.60:3300/0 conn(0x7f4c340ad440 0x7f4c340b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340cd2c0 0x7f4c340afdb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3228967069 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3228967069 >> 172.21.15.3:0/3228967069 conn(0x7f4c3406a740 msgr2=0x7f4c340cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:04.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3228967069 shutdown_connections 2023-05-17T11:46:04.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3228967069 wait complete. 2023-05-17T11:46:04.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 Processor -- start 2023-05-17T11:46:04.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.098+0000 7f4c3c4d1640 1 -- start start 2023-05-17T11:46:04.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 0x7f4c340c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c340cd2c0 0x7f4c34154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34154e60 con 0x7f4c340ad440 2023-05-17T11:46:04.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34162130 con 0x7f4c340cd2c0 2023-05-17T11:46:04.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340aead0 con 0x7f4c3415d3d0 2023-05-17T11:46:04.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 0x7f4c340c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 0x7f4c340c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60714/0 (socket says 172.21.15.3:60714) 2023-05-17T11:46:04.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 -- 172.21.15.3:0/3235132146 learned_addr learned my addr 172.21.15.3:0/3235132146 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:04.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c340cd2c0 0x7f4c34154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3aa6e640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 -- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 msgr2=0x7f4c340ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 -- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c340cd2c0 msgr2=0x7f4c34154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c340cd2c0 0x7f4c34154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 -- 172.21.15.3:0/3235132146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240094d0 con 0x7f4c340ad440 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c340cd2c0 0x7f4c34154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3a26d640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 0x7f4c340c48e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c7f0 tx=0x7f4c3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30007820 con 0x7f4c340ad440 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c30007980 con 0x7f4c340ad440 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30007d30 con 0x7f4c340ad440 2023-05-17T11:46:04.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c340c92b0 con 0x7f4c340ad440 2023-05-17T11:46:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c340c9120 con 0x7f4c340ad440 2023-05-17T11:46:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c340c9440 con 0x7f4c340ad440 2023-05-17T11:46:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.102+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c300113f0 con 0x7f4c340ad440 2023-05-17T11:46:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.106+0000 7f4c2affd640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4c18066280 0x7f4c18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.106+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c30084110 con 0x7f4c340ad440 2023-05-17T11:46:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.106+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4c18066280 0x7f4c18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.106+0000 7f4c39a6c640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4c18066280 0x7f4c18068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4c240ad000 tx=0x7f4c24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.110+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4c300514f0 con 0x7f4c340ad440 2023-05-17T11:46:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c3404de80 con 0x7f4c340ad440 2023-05-17T11:46:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c2affd640 1 -- 172.21.15.3:0/3235132146 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c30054b10 con 0x7f4c340ad440 2023-05-17T11:46:04.272 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4c18066280 msgr2=0x7f4c18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4c18066280 0x7f4c18068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4c240ad000 tx=0x7f4c24008040 comp rx=0 tx=0).stop 2023-05-17T11:46:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 msgr2=0x7f4c340c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 0x7f4c340c48e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c7f0 tx=0x7f4c3000ccb0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 shutdown_connections 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4c18066280 0x7f4c18068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4c3415d3d0 0x7f4c340ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c340cd2c0 0x7f4c34154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 --2- 172.21.15.3:0/3235132146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c340ad440 0x7f4c340c48e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 >> 172.21.15.3:0/3235132146 conn(0x7f4c3406a740 msgr2=0x7f4c34157170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 shutdown_connections 2023-05-17T11:46:04.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.262+0000 7f4c3c4d1640 1 -- 172.21.15.3:0/3235132146 wait complete. 2023-05-17T11:46:04.293 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:04.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.422+0000 7fe3db866640 1 Processor -- start 2023-05-17T11:46:04.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.422+0000 7fe3db866640 1 -- start start 2023-05-17T11:46:04.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3db866640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3d415d3d0 0x7fe3d40ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3db866640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40cd2c0 0x7fe3d40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3db866640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d409bcb0 con 0x7fe3d40ad440 2023-05-17T11:46:04.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3db866640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d40cdf90 con 0x7fe3d415d3d0 2023-05-17T11:46:04.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3db866640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40ca130 con 0x7fe3d40cd2c0 2023-05-17T11:46:04.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d9e03640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe3d40ad440 0x7fe3d406fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49550/0 (socket says 172.21.15.3:49550) 2023-05-17T11:46:04.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d8e01640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40cd2c0 0x7fe3d40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d9e03640 1 -- 172.21.15.3:0/1543028775 learned_addr learned my addr 172.21.15.3:0/1543028775 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:04.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d9602640 1 --2- 172.21.15.3:0/1543028775 >> v2:172.21.15.60:3300/0 conn(0x7fe3d415d3d0 0x7fe3d40ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3cbfff640 1 -- 172.21.15.3:0/1543028775 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731816367 0 0) 0x7fe3d409bcb0 con 0x7fe3d40ad440 2023-05-17T11:46:04.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3cbfff640 1 -- 172.21.15.3:0/1543028775 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c0003530 con 0x7fe3d40ad440 2023-05-17T11:46:04.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d8e01640 1 -- 172.21.15.3:0/1543028775 >> v2:172.21.15.60:3300/0 conn(0x7fe3d415d3d0 msgr2=0x7fe3d40ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:04.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d8e01640 1 --2- 172.21.15.3:0/1543028775 >> v2:172.21.15.60:3300/0 conn(0x7fe3d415d3d0 0x7fe3d40ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d8e01640 1 -- 172.21.15.3:0/1543028775 >> v1:172.21.15.3:6789/0 conn(0x7fe3d40ad440 legacy=0x7fe3d406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d8e01640 1 -- 172.21.15.3:0/1543028775 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d409bf00 con 0x7fe3d40cd2c0 2023-05-17T11:46:04.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.426+0000 7fe3d9602640 1 --2- 172.21.15.3:0/1543028775 >> v2:172.21.15.60:3300/0 conn(0x7fe3d415d3d0 0x7fe3d40ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:04.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3d8e01640 1 --2- 172.21.15.3:0/1543028775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40cd2c0 0x7fe3d40afdb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40097c0 tx=0x7fe3c401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=125b55ec8b5f3058 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3cbfff640 1 -- 172.21.15.3:0/1543028775 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40ab600 con 0x7fe3d40cd2c0 2023-05-17T11:46:04.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3cbfff640 1 -- 172.21.15.3:0/1543028775 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c40a7050 con 0x7fe3d40cd2c0 2023-05-17T11:46:04.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3cbfff640 1 -- 172.21.15.3:0/1543028775 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40ab980 con 0x7fe3d40cd2c0 2023-05-17T11:46:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 -- 172.21.15.3:0/1543028775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40cd2c0 msgr2=0x7fe3d40afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 --2- 172.21.15.3:0/1543028775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40cd2c0 0x7fe3d40afdb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40097c0 tx=0x7fe3c401c3f0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 -- 172.21.15.3:0/1543028775 shutdown_connections 2023-05-17T11:46:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 --2- 172.21.15.3:0/1543028775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40cd2c0 0x7fe3d40afdb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 --2- 172.21.15.3:0/1543028775 >> v2:172.21.15.60:3300/0 conn(0x7fe3d415d3d0 0x7fe3d40ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 -- 172.21.15.3:0/1543028775 >> 172.21.15.3:0/1543028775 conn(0x7fe3d406a740 msgr2=0x7fe3d40cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:04.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 -- 172.21.15.3:0/1543028775 shutdown_connections 2023-05-17T11:46:04.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.430+0000 7fe3db866640 1 -- 172.21.15.3:0/1543028775 wait complete. 2023-05-17T11:46:04.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 Processor -- start 2023-05-17T11:46:04.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- start start 2023-05-17T11:46:04.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40ad440 0x7fe3d415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d40cd2c0 0x7fe3d40c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 0x7fe3d41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4161d40 con 0x7fe3d415d3d0 2023-05-17T11:46:04.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4162000 con 0x7fe3d40cd2c0 2023-05-17T11:46:04.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41622e0 con 0x7fe3d40ad440 2023-05-17T11:46:04.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 0x7fe3d41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 0x7fe3d41591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60718/0 (socket says 172.21.15.3:60718) 2023-05-17T11:46:04.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 -- 172.21.15.3:0/1090127597 learned_addr learned my addr 172.21.15.3:0/1090127597 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:04.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 -- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40ad440 msgr2=0x7fe3d415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40ad440 0x7fe3d415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 -- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d40cd2c0 msgr2=0x7fe3d40c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d8e01640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d40cd2c0 0x7fe3d40c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d40cd2c0 0x7fe3d40c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 -- 172.21.15.3:0/1090127597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009420 con 0x7fe3d415d3d0 2023-05-17T11:46:04.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d8e01640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d40cd2c0 0x7fe3d40c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:04.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3d9e03640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 0x7fe3d41591e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00cb40 tx=0x7fe3cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00aca0 con 0x7fe3d415d3d0 2023-05-17T11:46:04.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00ae00 con 0x7fe3d415d3d0 2023-05-17T11:46:04.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc012620 con 0x7fe3d415d3d0 2023-05-17T11:46:04.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c4009420 con 0x7fe3d415d3d0 2023-05-17T11:46:04.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d40b02f0 con 0x7fe3d415d3d0 2023-05-17T11:46:04.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.434+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d415d7a0 con 0x7fe3d415d3d0 2023-05-17T11:46:04.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.438+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3cc007070 con 0x7fe3d415d3d0 2023-05-17T11:46:04.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.438+0000 7fe3c9ffb640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe3b8066280 0x7fe3b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.438+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3cc083db0 con 0x7fe3d415d3d0 2023-05-17T11:46:04.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.438+0000 7fe3d9602640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe3b8066280 0x7fe3b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.438+0000 7fe3d9602640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe3b8066280 0x7fe3b8068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0006e90 tx=0x7fe3d0006de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.442+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe3cc088070 con 0x7fe3d415d3d0 2023-05-17T11:46:04.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:46:04.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:46:04.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3d40b0480 con 0x7fe3d415d3d0 2023-05-17T11:46:04.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3c9ffb640 1 -- 172.21.15.3:0/1090127597 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3cc0170a0 con 0x7fe3d415d3d0 2023-05-17T11:46:04.607 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:04.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe3b8066280 msgr2=0x7fe3b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe3b8066280 0x7fe3b8068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0006e90 tx=0x7fe3d0006de0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 msgr2=0x7fe3d41591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 0x7fe3d41591e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00cb40 tx=0x7fe3cc00a060 comp rx=0 tx=0).stop 2023-05-17T11:46:04.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 shutdown_connections 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fe3b8066280 0x7fe3b8068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3d415d3d0 0x7fe3d41591e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d40cd2c0 0x7fe3d40c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 --2- 172.21.15.3:0/1090127597 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fe3d40ad440 0x7fe3d415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 >> 172.21.15.3:0/1090127597 conn(0x7fe3d406a740 msgr2=0x7fe3d4072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 shutdown_connections 2023-05-17T11:46:04.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.598+0000 7fe3db866640 1 -- 172.21.15.3:0/1090127597 wait complete. 2023-05-17T11:46:04.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:04.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 Processor -- start 2023-05-17T11:46:04.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 -- start start 2023-05-17T11:46:04.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83280b1d30 0x7f832806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f83280d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832806b3c0 con 0x7f83280d0870 2023-05-17T11:46:04.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83280b2100 con 0x7f83280b1d30 2023-05-17T11:46:04.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832c909640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280d0cb0 con 0x7f83280cf190 2023-05-17T11:46:04.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f8326d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83280b1d30 0x7f832806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832759e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f83280d0870 0x7f83280b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49564/0 (socket says 172.21.15.3:49564) 2023-05-17T11:46:04.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f8326d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83280b1d30 0x7f832806ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60724/0 (socket says 172.21.15.3:60724) 2023-05-17T11:46:04.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832759e640 1 -- 172.21.15.3:0/3321579729 learned_addr learned my addr 172.21.15.3:0/3321579729 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f831ffff640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f83280d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f8326d9d640 1 -- 172.21.15.3:0/3321579729 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 msgr2=0x7f83280d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f8326d9d640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f83280d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f8326d9d640 1 -- 172.21.15.3:0/3321579729 >> v1:172.21.15.3:6789/0 conn(0x7f83280d0870 legacy=0x7f83280b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f8326d9d640 1 -- 172.21.15.3:0/3321579729 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832806b5f0 con 0x7f83280b1d30 2023-05-17T11:46:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f832659c640 1 -- 172.21.15.3:0/3321579729 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071549294 0 0) 0x7f832806b3c0 con 0x7f83280d0870 2023-05-17T11:46:04.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.798+0000 7f831ffff640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f83280d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:04.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f8326d9d640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f832806ae80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f83180097c0 tx=0x7f831801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9706cac421eccd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832659c640 1 -- 172.21.15.3:0/3321579729 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180a8970 con 0x7f83280b1d30 2023-05-17T11:46:04.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832659c640 1 -- 172.21.15.3:0/3321579729 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83180a8ad0 con 0x7f83280b1d30 2023-05-17T11:46:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832659c640 1 -- 172.21.15.3:0/3321579729 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180a8e60 con 0x7f83280b1d30 2023-05-17T11:46:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 -- 172.21.15.3:0/3321579729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 msgr2=0x7f832806ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f832806ae80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f83180097c0 tx=0x7f831801ec70 comp rx=0 tx=0).stop 2023-05-17T11:46:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 -- 172.21.15.3:0/3321579729 shutdown_connections 2023-05-17T11:46:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f83280d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 --2- 172.21.15.3:0/3321579729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f832806ae80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 -- 172.21.15.3:0/3321579729 >> 172.21.15.3:0/3321579729 conn(0x7f8328071b00 msgr2=0x7f832809bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 -- 172.21.15.3:0/3321579729 shutdown_connections 2023-05-17T11:46:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 -- 172.21.15.3:0/3321579729 wait complete. 2023-05-17T11:46:04.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 Processor -- start 2023-05-17T11:46:04.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.802+0000 7f832c909640 1 -- start start 2023-05-17T11:46:04.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f83280c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f832814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83280d0870 0x7f83281f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281f2970 con 0x7f83280b1d30 2023-05-17T11:46:04.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280caad0 con 0x7f83280d0870 2023-05-17T11:46:04.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280c9ec0 con 0x7f83280cf190 2023-05-17T11:46:04.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f83280c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f83280c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60726/0 (socket says 172.21.15.3:60726) 2023-05-17T11:46:04.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 -- 172.21.15.3:0/1753045681 learned_addr learned my addr 172.21.15.3:0/1753045681 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:04.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 -- 172.21.15.3:0/1753045681 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 msgr2=0x7f832814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f832814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 -- 172.21.15.3:0/1753045681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83280d0870 msgr2=0x7f83281f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83280d0870 0x7f83281f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 -- 172.21.15.3:0/1753045681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318009420 con 0x7f83280b1d30 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f8326d9d640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f83280c9830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f831801d320 tx=0x7f831801d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180a8970 con 0x7f83280b1d30 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8318004030 con 0x7f83280b1d30 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832806bbb0 con 0x7f83280b1d30 2023-05-17T11:46:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180043a0 con 0x7f83280b1d30 2023-05-17T11:46:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832806b8d0 con 0x7f83280b1d30 2023-05-17T11:46:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83280cce50 con 0x7f83280b1d30 2023-05-17T11:46:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.806+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8318003620 con 0x7f83280b1d30 2023-05-17T11:46:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.810+0000 7f831f7fe640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8308066280 0x7f8308068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.810+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8318121af0 con 0x7f83280b1d30 2023-05-17T11:46:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.810+0000 7f831ffff640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8308066280 0x7f8308068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.810+0000 7f831ffff640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8308066280 0x7f8308068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f832815aea0 tx=0x7f8310008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:04.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.814+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f83180eeed0 con 0x7f83280b1d30 2023-05-17T11:46:04.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.966+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8328067130 con 0x7f83280b1d30 2023-05-17T11:46:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.966+0000 7f831f7fe640 1 -- 172.21.15.3:0/1753045681 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f83180c2090 con 0x7f83280b1d30 2023-05-17T11:46:04.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:04.978 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:04.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8308066280 msgr2=0x7f8308068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8308066280 0x7f8308068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f832815aea0 tx=0x7f8310008040 comp rx=0 tx=0).stop 2023-05-17T11:46:04.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 msgr2=0x7f83280c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:04.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f83280c9830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f831801d320 tx=0x7f831801d4b0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 shutdown_connections 2023-05-17T11:46:04.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8308066280 0x7f8308068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83280d0870 0x7f83281f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f83280cf190 0x7f832814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 --2- 172.21.15.3:0/1753045681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83280b1d30 0x7f83280c9830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:04.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 >> 172.21.15.3:0/1753045681 conn(0x7f8328071b00 msgr2=0x7f83280b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:04.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 shutdown_connections 2023-05-17T11:46:04.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:04.970+0000 7f832c909640 1 -- 172.21.15.3:0/1753045681 wait complete. 2023-05-17T11:46:04.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:04.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 Processor -- start 2023-05-17T11:46:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 -- start start 2023-05-17T11:46:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff1700ca780 0x7ff1700afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1700cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1700adb30 con 0x7ff170158730 2023-05-17T11:46:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17015cd90 con 0x7ff1700ca780 2023-05-17T11:46:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff177152640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700b0760 con 0x7ff1700b02f0 2023-05-17T11:46:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff1700ca780 0x7ff1700afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff1700ca780 0x7ff1700afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60732/0 (socket says 172.21.15.3:60732) 2023-05-17T11:46:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 -- 172.21.15.3:0/693531822 learned_addr learned my addr 172.21.15.3:0/693531822 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff1756ef640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1700cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 -- 172.21.15.3:0/693531822 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 msgr2=0x7ff1700cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1700cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 -- 172.21.15.3:0/693531822 >> v1:172.21.15.60:6789/0 conn(0x7ff170158730 legacy=0x7ff1700ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff16ffff640 1 -- 172.21.15.3:0/693531822 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17015c110 con 0x7ff1700ca780 2023-05-17T11:46:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.130+0000 7ff1756ef640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1700cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff16ffff640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700afdb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff15c006fd0 tx=0x7ff15c01e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfb524d71c53a52 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff16f7fe640 1 -- 172.21.15.3:0/693531822 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c004230 con 0x7ff1700ca780 2023-05-17T11:46:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff16f7fe640 1 -- 172.21.15.3:0/693531822 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0ab070 con 0x7ff1700ca780 2023-05-17T11:46:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff16f7fe640 1 -- 172.21.15.3:0/693531822 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0a7710 con 0x7ff1700ca780 2023-05-17T11:46:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 -- 172.21.15.3:0/693531822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 msgr2=0x7ff1700afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700afdb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff15c006fd0 tx=0x7ff15c01e9d0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 -- 172.21.15.3:0/693531822 shutdown_connections 2023-05-17T11:46:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1700cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 --2- 172.21.15.3:0/693531822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700afdb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 -- 172.21.15.3:0/693531822 >> 172.21.15.3:0/693531822 conn(0x7ff17006a740 msgr2=0x7ff1700cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 -- 172.21.15.3:0/693531822 shutdown_connections 2023-05-17T11:46:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.134+0000 7ff177152640 1 -- 172.21.15.3:0/693531822 wait complete. 2023-05-17T11:46:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 Processor -- start 2023-05-17T11:46:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- start start 2023-05-17T11:46:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1701554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff170158730 0x7ff1700ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700abd40 con 0x7ff1700ca780 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700ac130 con 0x7ff170158730 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700ac410 con 0x7ff1700b02f0 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700acb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60744/0 (socket says 172.21.15.3:60744) 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 -- 172.21.15.3:0/2296654627 learned_addr learned my addr 172.21.15.3:0/2296654627 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff1756ef640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff170158730 0x7ff1700ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff174eee640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1701554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 -- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 msgr2=0x7ff1701554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1701554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 -- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff170158730 msgr2=0x7ff1700ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff170158730 0x7ff1700ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 -- 172.21.15.3:0/2296654627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c00b780 con 0x7ff1700ca780 2023-05-17T11:46:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff174eee640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1701554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16ffff640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700acb90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00ba70 tx=0x7ff15c01b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0a8b30 con 0x7ff1700ca780 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0a8c90 con 0x7ff1700ca780 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c003620 con 0x7ff1700ca780 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1700c8980 con 0x7ff1700ca780 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17015c9b0 con 0x7ff1700ca780 2023-05-17T11:46:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.138+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1700c8b10 con 0x7ff1700ca780 2023-05-17T11:46:05.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.142+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff15c0037a0 con 0x7ff1700ca780 2023-05-17T11:46:05.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.142+0000 7ff16d7fa640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff154066280 0x7ff154068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.142+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff15c11e200 con 0x7ff1700ca780 2023-05-17T11:46:05.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.142+0000 7ff174eee640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff154066280 0x7ff154068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.142+0000 7ff174eee640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff154066280 0x7ff154068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff164000f70 tx=0x7ff164009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.146+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff15c0eb690 con 0x7ff1700ca780 2023-05-17T11:46:05.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff17004de80 con 0x7ff1700ca780 2023-05-17T11:46:05.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff16d7fa640 1 -- 172.21.15.3:0/2296654627 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff15c0eecb0 con 0x7ff1700ca780 2023-05-17T11:46:05.312 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:05.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff154066280 msgr2=0x7ff154068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff154066280 0x7ff154068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff164000f70 tx=0x7ff164009040 comp rx=0 tx=0).stop 2023-05-17T11:46:05.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 msgr2=0x7ff1700acb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700acb90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00ba70 tx=0x7ff15c01b770 comp rx=0 tx=0).stop 2023-05-17T11:46:05.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 shutdown_connections 2023-05-17T11:46:05.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7ff154066280 0x7ff154068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff170158730 0x7ff1700ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1700ca780 0x7ff1700acb90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 --2- 172.21.15.3:0/2296654627 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7ff1700b02f0 0x7ff1701554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 >> 172.21.15.3:0/2296654627 conn(0x7ff17006a740 msgr2=0x7ff170157330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:05.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 shutdown_connections 2023-05-17T11:46:05.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.302+0000 7ff177152640 1 -- 172.21.15.3:0/2296654627 wait complete. 2023-05-17T11:46:05.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:05.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.462+0000 7f7a23cd1640 1 Processor -- start 2023-05-17T11:46:05.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.462+0000 7f7a23cd1640 1 -- start start 2023-05-17T11:46:05.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a23cd1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 0x7f7a1c06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a23cd1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c06d020 con 0x7f7a1c0b2950 2023-05-17T11:46:05.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a23cd1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0b2d20 con 0x7f7a1c09bd90 2023-05-17T11:46:05.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a23cd1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0adba0 con 0x7f7a1c0ad760 2023-05-17T11:46:05.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a21a6d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7a1c0b2950 0x7f7a1c0cd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49578/0 (socket says 172.21.15.3:49578) 2023-05-17T11:46:05.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a21a6d640 1 -- 172.21.15.3:0/3736961758 learned_addr learned my addr 172.21.15.3:0/3736961758 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:05.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 0x7f7a1c06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280908064 0 0) 0x7f7a1c06d020 con 0x7f7a1c0b2950 2023-05-17T11:46:05.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003530 con 0x7f7a1c0b2950 2023-05-17T11:46:05.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001927044 0 0) 0x7f7a1c0b2d20 con 0x7f7a1c09bd90 2023-05-17T11:46:05.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c06d020 con 0x7f7a1c09bd90 2023-05-17T11:46:05.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506079881 0 0) 0x7f7a08003530 con 0x7f7a1c0b2950 2023-05-17T11:46:05.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 msgr2=0x7f7a1c06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 0x7f7a1c06bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 >> v1:172.21.15.60:6789/0 conn(0x7f7a1c09bd90 legacy=0x7f7a1c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c1591b0 con 0x7f7a1c0b2950 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f7a18001680 con 0x7f7a1c0b2950 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 >> v1:172.21.15.3:6789/0 conn(0x7f7a1c0b2950 legacy=0x7f7a1c0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 0x7f7a08003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a080040a0 0x7f7a080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0adba0 con 0x7f7a08004d10 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0800ba40 con 0x7f7a080040a0 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0800bc00 con 0x7f7a1c0ad760 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a21a6d640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 0x7f7a08003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2126c640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a080040a0 0x7f7a080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 -- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 msgr2=0x7f7a08003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ad760 0x7f7a08003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 -- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a080040a0 msgr2=0x7f7a080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a080040a0 0x7f7a080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.466+0000 7f7a2226e640 1 -- 172.21.15.3:0/3736961758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08003530 con 0x7f7a08004d10 2023-05-17T11:46:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a2226e640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a08005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009bd0 tx=0x7f7a1401ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a4b0324fc6390f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18007ea0 con 0x7f7a08004d10 2023-05-17T11:46:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400f040 con 0x7f7a08004d10 2023-05-17T11:46:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a20a6b640 1 -- 172.21.15.3:0/3736961758 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140af440 con 0x7f7a08004d10 2023-05-17T11:46:05.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 -- 172.21.15.3:0/3736961758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 msgr2=0x7f7a08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/3736961758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a08005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009bd0 tx=0x7f7a1401ee50 comp rx=0 tx=0).stop 2023-05-17T11:46:05.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a2226e640 1 -- 172.21.15.3:0/3736961758 reap_dead start 2023-05-17T11:46:05.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 -- 172.21.15.3:0/3736961758 shutdown_connections 2023-05-17T11:46:05.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 -- 172.21.15.3:0/3736961758 >> 172.21.15.3:0/3736961758 conn(0x7f7a1c06a740 msgr2=0x7f7a1c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:05.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 -- 172.21.15.3:0/3736961758 shutdown_connections 2023-05-17T11:46:05.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 -- 172.21.15.3:0/3736961758 wait complete. 2023-05-17T11:46:05.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 Processor -- start 2023-05-17T11:46:05.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.470+0000 7f7a23cd1640 1 -- start start 2023-05-17T11:46:05.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a1c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1c0af910 0x7f7a1c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ce900 0x7f7a1c0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c15c230 con 0x7f7a08004d10 2023-05-17T11:46:05.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0adce0 con 0x7f7a1c0af910 2023-05-17T11:46:05.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0cf2e0 con 0x7f7a1c0ce900 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a1c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a1c156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60756/0 (socket says 172.21.15.3:60756) 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 -- 172.21.15.3:0/4117352839 learned_addr learned my addr 172.21.15.3:0/4117352839 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a2226e640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ce900 0x7f7a1c0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a2126c640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1c0af910 0x7f7a1c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 -- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ce900 msgr2=0x7f7a1c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ce900 0x7f7a1c0ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 -- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1c0af910 msgr2=0x7f7a1c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1c0af910 0x7f7a1c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 -- 172.21.15.3:0/4117352839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0cb5f0 con 0x7f7a08004d10 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a21a6d640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a1c156840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001060 tx=0x7f7a180129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18014750 con 0x7f7a08004d10 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a180148d0 con 0x7f7a08004d10 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0cc0a0 con 0x7f7a08004d10 2023-05-17T11:46:05.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18014c80 con 0x7f7a08004d10 2023-05-17T11:46:05.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c06d4b0 con 0x7f7a08004d10 2023-05-17T11:46:05.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c04de80 con 0x7f7a08004d10 2023-05-17T11:46:05.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.474+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a180153e0 con 0x7f7a08004d10 2023-05-17T11:46:05.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.478+0000 7f7a127fc640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7a00066280 0x7f7a00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.478+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a180868e0 con 0x7f7a08004d10 2023-05-17T11:46:05.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.478+0000 7f7a2126c640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7a00066280 0x7f7a00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.478+0000 7f7a2126c640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7a00066280 0x7f7a00068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c007fd0 tx=0x7f7a0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.482+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7a18053d70 con 0x7f7a08004d10 2023-05-17T11:46:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.634+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a1c0ad4c0 con 0x7f7a08004d10 2023-05-17T11:46:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.634+0000 7f7a127fc640 1 -- 172.21.15.3:0/4117352839 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a1801c0a0 con 0x7f7a08004d10 2023-05-17T11:46:05.645 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:05.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.634+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7a00066280 msgr2=0x7f7a00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.634+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7a00066280 0x7f7a00068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c007fd0 tx=0x7f7a0c009040 comp rx=0 tx=0).stop 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.634+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 msgr2=0x7f7a1c156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.634+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a1c156840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001060 tx=0x7f7a180129a0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 shutdown_connections 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7a00066280 0x7f7a00068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7a1c0ce900 0x7f7a1c0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1c0af910 0x7f7a1c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 --2- 172.21.15.3:0/4117352839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a08004d10 0x7f7a1c156840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 >> 172.21.15.3:0/4117352839 conn(0x7f7a1c06a740 msgr2=0x7f7a1c0ac340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:05.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 shutdown_connections 2023-05-17T11:46:05.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.638+0000 7f7a23cd1640 1 -- 172.21.15.3:0/4117352839 wait complete. 2023-05-17T11:46:05.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:05.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 Processor -- start 2023-05-17T11:46:05.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 -- start start 2023-05-17T11:46:05.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a9006d940 0x7f3a9006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a900cec30 0x7f3a900cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9015c760 con 0x7f3a900cf090 2023-05-17T11:46:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900cdf60 con 0x7f3a900cec30 2023-05-17T11:46:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a960e5640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900ccd40 con 0x7f3a9006d940 2023-05-17T11:46:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a8effd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a900cec30 0x7f3a900cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a8effd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a900cec30 0x7f3a900cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60760/0 (socket says 172.21.15.3:60760) 2023-05-17T11:46:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.794+0000 7f3a8effd640 1 -- 172.21.15.3:0/794031137 learned_addr learned my addr 172.21.15.3:0/794031137 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8f7fe640 1 --2- 172.21.15.3:0/794031137 >> v2:172.21.15.60:3300/0 conn(0x7f3a9006d940 0x7f3a9006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8effd640 1 -- 172.21.15.3:0/794031137 >> v2:172.21.15.60:3300/0 conn(0x7f3a9006d940 msgr2=0x7f3a9006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8effd640 1 --2- 172.21.15.3:0/794031137 >> v2:172.21.15.60:3300/0 conn(0x7f3a9006d940 0x7f3a9006dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8effd640 1 -- 172.21.15.3:0/794031137 >> v1:172.21.15.3:6789/0 conn(0x7f3a900cf090 legacy=0x7f3a900c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8effd640 1 -- 172.21.15.3:0/794031137 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9006e250 con 0x7f3a900cec30 2023-05-17T11:46:05.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8e7fc640 1 -- 172.21.15.3:0/794031137 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591615001 0 0) 0x7f3a9015c760 con 0x7f3a900cf090 2023-05-17T11:46:05.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8effd640 1 --2- 172.21.15.3:0/794031137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cec30 0x7f3a900cbde0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a90071f00 tx=0x7f3a8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a242cdfd186c18 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8e7fc640 1 -- 172.21.15.3:0/794031137 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840ac640 con 0x7f3a900cec30 2023-05-17T11:46:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8e7fc640 1 -- 172.21.15.3:0/794031137 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a840ac7a0 con 0x7f3a900cec30 2023-05-17T11:46:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a8e7fc640 1 -- 172.21.15.3:0/794031137 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840acb30 con 0x7f3a900cec30 2023-05-17T11:46:05.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a960e5640 1 -- 172.21.15.3:0/794031137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cec30 msgr2=0x7f3a900cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a960e5640 1 --2- 172.21.15.3:0/794031137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cec30 0x7f3a900cbde0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a90071f00 tx=0x7f3a8401c4d0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a960e5640 1 -- 172.21.15.3:0/794031137 shutdown_connections 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a960e5640 1 --2- 172.21.15.3:0/794031137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cec30 0x7f3a900cbde0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a960e5640 1 --2- 172.21.15.3:0/794031137 >> v2:172.21.15.60:3300/0 conn(0x7f3a9006d940 0x7f3a9006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.798+0000 7f3a960e5640 1 -- 172.21.15.3:0/794031137 >> 172.21.15.3:0/794031137 conn(0x7f3a9006b4e0 msgr2=0x7f3a900cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- 172.21.15.3:0/794031137 shutdown_connections 2023-05-17T11:46:05.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- 172.21.15.3:0/794031137 wait complete. 2023-05-17T11:46:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 Processor -- start 2023-05-17T11:46:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- start start 2023-05-17T11:46:05.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9006d940 0x7f3a9015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3a900cec30 0x7f3a9015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 0x7f3a900b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9015a920 con 0x7f3a900cf090 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90159f50 con 0x7f3a9006d940 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90159940 con 0x7f3a900cec30 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 0x7f3a900b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 0x7f3a900b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60768/0 (socket says 172.21.15.3:60768) 2023-05-17T11:46:05.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 -- 172.21.15.3:0/2899464234 learned_addr learned my addr 172.21.15.3:0/2899464234 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:05.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8f7fe640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9006d940 0x7f3a9015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8effd640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3a900cec30 0x7f3a9015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 -- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3a900cec30 msgr2=0x7f3a9015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3a900cec30 0x7f3a9015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 -- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9006d940 msgr2=0x7f3a9015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9006d940 0x7f3a9015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 -- 172.21.15.3:0/2899464234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840094d0 con 0x7f3a900cf090 2023-05-17T11:46:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8effd640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3a900cec30 0x7f3a9015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a8ffff640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 0x7f3a900b3ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a88002240 tx=0x7f3a8800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88003db0 con 0x7f3a900cf090 2023-05-17T11:46:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800ce30 con 0x7f3a900cf090 2023-05-17T11:46:05.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.802+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a900ce710 con 0x7f3a900cf090 2023-05-17T11:46:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88005270 con 0x7f3a900cf090 2023-05-17T11:46:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a900ce430 con 0x7f3a900cf090 2023-05-17T11:46:05.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a900cc730 con 0x7f3a900cf090 2023-05-17T11:46:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a880053d0 con 0x7f3a900cf090 2023-05-17T11:46:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a77fff640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3a7c066280 0x7f3a7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a880834a0 con 0x7f3a900cf090 2023-05-17T11:46:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a8f7fe640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3a7c066280 0x7f3a7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:05.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.806+0000 7f3a8f7fe640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3a7c066280 0x7f3a7c068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009b60 tx=0x7f3a80009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:05.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.810+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3a880509c0 con 0x7f3a900cf090 2023-05-17T11:46:05.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.966+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a901597a0 con 0x7f3a900cf090 2023-05-17T11:46:05.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.966+0000 7f3a77fff640 1 -- 172.21.15.3:0/2899464234 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a901597a0 con 0x7f3a900cf090 2023-05-17T11:46:05.978 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:05.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3a7c066280 msgr2=0x7f3a7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3a7c066280 0x7f3a7c068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009b60 tx=0x7f3a80009190 comp rx=0 tx=0).stop 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 msgr2=0x7f3a900b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 0x7f3a900b3ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a88002240 tx=0x7f3a8800cbe0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 shutdown_connections 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3a7c066280 0x7f3a7c068730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a900cf090 0x7f3a900b3ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3a900cec30 0x7f3a9015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 --2- 172.21.15.3:0/2899464234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9006d940 0x7f3a9015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:05.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 >> 172.21.15.3:0/2899464234 conn(0x7f3a9006b4e0 msgr2=0x7f3a900ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:05.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 shutdown_connections 2023-05-17T11:46:05.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:05.970+0000 7f3a960e5640 1 -- 172.21.15.3:0/2899464234 wait complete. 2023-05-17T11:46:05.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:06.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 Processor -- start 2023-05-17T11:46:06.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 -- start start 2023-05-17T11:46:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc52015c0b0 0x7fc520070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc5201601c0 0x7fc5201605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52015fd30 con 0x7fc52015c480 2023-05-17T11:46:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52015d540 con 0x7fc5201601c0 2023-05-17T11:46:06.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc524edf640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52015cca0 con 0x7fc52015c0b0 2023-05-17T11:46:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc5201601c0 0x7fc5201605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc5201601c0 0x7fc5201605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60782/0 (socket says 172.21.15.3:60782) 2023-05-17T11:46:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 -- 172.21.15.3:0/866206528 learned_addr learned my addr 172.21.15.3:0/866206528 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51e59c640 1 --2- 172.21.15.3:0/866206528 >> v2:172.21.15.60:3300/0 conn(0x7fc52015c0b0 0x7fc520070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 -- 172.21.15.3:0/866206528 >> v2:172.21.15.60:3300/0 conn(0x7fc52015c0b0 msgr2=0x7fc520070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 --2- 172.21.15.3:0/866206528 >> v2:172.21.15.60:3300/0 conn(0x7fc52015c0b0 0x7fc520070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 -- 172.21.15.3:0/866206528 >> v1:172.21.15.60:6789/0 conn(0x7fc52015c480 legacy=0x7fc5200cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51ed9d640 1 -- 172.21.15.3:0/866206528 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52015cf80 con 0x7fc5201601c0 2023-05-17T11:46:06.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.130+0000 7fc51dd9b640 1 -- 172.21.15.3:0/866206528 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586788957 0 0) 0x7fc52015fd30 con 0x7fc52015c480 2023-05-17T11:46:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc51ed9d640 1 --2- 172.21.15.3:0/866206528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5201601c0 0x7fc5201605e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc52006aa30 tx=0x7fc51801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74afdc3238853e09 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc51dd9b640 1 -- 172.21.15.3:0/866206528 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a57a0 con 0x7fc5201601c0 2023-05-17T11:46:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc51dd9b640 1 -- 172.21.15.3:0/866206528 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5180a5900 con 0x7fc5201601c0 2023-05-17T11:46:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc51dd9b640 1 -- 172.21.15.3:0/866206528 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a5c90 con 0x7fc5201601c0 2023-05-17T11:46:06.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 -- 172.21.15.3:0/866206528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5201601c0 msgr2=0x7fc5201605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 --2- 172.21.15.3:0/866206528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5201601c0 0x7fc5201605e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc52006aa30 tx=0x7fc51801c9d0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 -- 172.21.15.3:0/866206528 shutdown_connections 2023-05-17T11:46:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 --2- 172.21.15.3:0/866206528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5201601c0 0x7fc5201605e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 --2- 172.21.15.3:0/866206528 >> v2:172.21.15.60:3300/0 conn(0x7fc52015c0b0 0x7fc520070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 -- 172.21.15.3:0/866206528 >> 172.21.15.3:0/866206528 conn(0x7fc5200d05b0 msgr2=0x7fc5200d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:06.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 -- 172.21.15.3:0/866206528 shutdown_connections 2023-05-17T11:46:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 -- 172.21.15.3:0/866206528 wait complete. 2023-05-17T11:46:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 Processor -- start 2023-05-17T11:46:06.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.134+0000 7fc524edf640 1 -- start start 2023-05-17T11:46:06.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 0x7fc520147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52015c480 0x7fc5200c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc5201601c0 0x7fc5200c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520150430 con 0x7fc52015c0b0 2023-05-17T11:46:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52014f820 con 0x7fc52015c480 2023-05-17T11:46:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52014fb00 con 0x7fc5201601c0 2023-05-17T11:46:06.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 0x7fc520147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 0x7fc520147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60798/0 (socket says 172.21.15.3:60798) 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 -- 172.21.15.3:0/4125908266 learned_addr learned my addr 172.21.15.3:0/4125908266 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 -- 172.21.15.3:0/4125908266 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc5201601c0 msgr2=0x7fc5200c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc5201601c0 0x7fc5200c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 -- 172.21.15.3:0/4125908266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52015c480 msgr2=0x7fc5200c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52015c480 0x7fc5200c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 -- 172.21.15.3:0/4125908266 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518009b30 con 0x7fc52015c0b0 2023-05-17T11:46:06.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc51e59c640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 0x7fc520147a40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e930 tx=0x7fc51000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510009690 con 0x7fc52015c0b0 2023-05-17T11:46:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51000ca00 con 0x7fc52015c0b0 2023-05-17T11:46:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51000cd70 con 0x7fc52015c0b0 2023-05-17T11:46:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5200cb410 con 0x7fc52015c0b0 2023-05-17T11:46:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200cb280 con 0x7fc52015c0b0 2023-05-17T11:46:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520168ea0 con 0x7fc52015c0b0 2023-05-17T11:46:06.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.138+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc510013470 con 0x7fc52015c0b0 2023-05-17T11:46:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.142+0000 7fc516ffd640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc500066280 0x7fc500068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.142+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc510084070 con 0x7fc52015c0b0 2023-05-17T11:46:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.142+0000 7fc517fff640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc500066280 0x7fc500068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.142+0000 7fc517fff640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc500066280 0x7fc500068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc508007fd0 tx=0x7fc508007940 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.146+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc5100b46f0 con 0x7fc52015c0b0 2023-05-17T11:46:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc52004de80 con 0x7fc52015c0b0 2023-05-17T11:46:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc516ffd640 1 -- 172.21.15.3:0/4125908266 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5100170a0 con 0x7fc52015c0b0 2023-05-17T11:46:06.313 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc500066280 msgr2=0x7fc500068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc500066280 0x7fc500068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc508007fd0 tx=0x7fc508007940 comp rx=0 tx=0).stop 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 msgr2=0x7fc520147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 0x7fc520147a40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e930 tx=0x7fc51000edf0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 shutdown_connections 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc500066280 0x7fc500068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc5201601c0 0x7fc5200c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52015c480 0x7fc5200c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 --2- 172.21.15.3:0/4125908266 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc52015c0b0 0x7fc520147a40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 >> 172.21.15.3:0/4125908266 conn(0x7fc5200d05b0 msgr2=0x7fc5200cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 shutdown_connections 2023-05-17T11:46:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.302+0000 7fc524edf640 1 -- 172.21.15.3:0/4125908266 wait complete. 2023-05-17T11:46:06.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.458+0000 7f424dec3640 1 Processor -- start 2023-05-17T11:46:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.458+0000 7f424dec3640 1 -- start start 2023-05-17T11:46:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f424dec3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42480716d0 0x7f424806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f424dec3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f42480b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f424dec3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42480ca490 con 0x7f424815a2e0 2023-05-17T11:46:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f424dec3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480cacf0 con 0x7f42480716d0 2023-05-17T11:46:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f424dec3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4248070140 con 0x7f42480c9fd0 2023-05-17T11:46:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f4246ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f424815a2e0 0x7f4248071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36886/0 (socket says 172.21.15.3:36886) 2023-05-17T11:46:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f4246ffd640 1 -- 172.21.15.3:0/1051887396 learned_addr learned my addr 172.21.15.3:0/1051887396 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42477fe640 1 --2- 172.21.15.3:0/1051887396 >> v2:172.21.15.60:3300/0 conn(0x7f42480716d0 0x7f424806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f4247fff640 1 --2- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f42480b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42467fc640 1 -- 172.21.15.3:0/1051887396 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570412322 0 0) 0x7f42480ca490 con 0x7f424815a2e0 2023-05-17T11:46:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42467fc640 1 -- 172.21.15.3:0/1051887396 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4230003530 con 0x7f424815a2e0 2023-05-17T11:46:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42477fe640 1 -- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 msgr2=0x7f42480b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42477fe640 1 --2- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f42480b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42477fe640 1 -- 172.21.15.3:0/1051887396 >> v1:172.21.15.3:6789/0 conn(0x7f424815a2e0 legacy=0x7f4248071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.462+0000 7f42477fe640 1 -- 172.21.15.3:0/1051887396 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480ca730 con 0x7f42480716d0 2023-05-17T11:46:06.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f42477fe640 1 --2- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42480716d0 0x7f424806fc00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb739a82377ef33a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f42467fc640 1 -- 172.21.15.3:0/1051887396 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380ab650 con 0x7f42480716d0 2023-05-17T11:46:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f42467fc640 1 -- 172.21.15.3:0/1051887396 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380ab7b0 con 0x7f42480716d0 2023-05-17T11:46:06.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f42467fc640 1 -- 172.21.15.3:0/1051887396 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380abb40 con 0x7f42480716d0 2023-05-17T11:46:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 -- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42480716d0 msgr2=0x7f424806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 --2- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42480716d0 0x7f424806fc00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801c450 comp rx=0 tx=0).stop 2023-05-17T11:46:06.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 -- 172.21.15.3:0/1051887396 shutdown_connections 2023-05-17T11:46:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 --2- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f42480b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 --2- 172.21.15.3:0/1051887396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42480716d0 0x7f424806fc00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 -- 172.21.15.3:0/1051887396 >> 172.21.15.3:0/1051887396 conn(0x7f42480b0b30 msgr2=0x7f42480cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 -- 172.21.15.3:0/1051887396 shutdown_connections 2023-05-17T11:46:06.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 -- 172.21.15.3:0/1051887396 wait complete. 2023-05-17T11:46:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 Processor -- start 2023-05-17T11:46:06.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.466+0000 7f424dec3640 1 -- start start 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 0x7f42480c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f4248154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f424815a2e0 0x7f42480aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c8260 con 0x7f42480716d0 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c7ca0 con 0x7f424815a2e0 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c7f80 con 0x7f42480c9fd0 2023-05-17T11:46:06.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 0x7f42480c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 0x7f42480c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41304/0 (socket says 172.21.15.3:41304) 2023-05-17T11:46:06.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 -- 172.21.15.3:0/1801732429 learned_addr learned my addr 172.21.15.3:0/1801732429 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 -- 172.21.15.3:0/1801732429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 msgr2=0x7f4248154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f4248154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 -- 172.21.15.3:0/1801732429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f424815a2e0 msgr2=0x7f42480aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f424815a2e0 0x7f42480aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 -- 172.21.15.3:0/1801732429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4238009420 con 0x7f42480716d0 2023-05-17T11:46:06.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f42477fe640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 0x7f42480c7610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f42380ad040 tx=0x7f423801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380bf610 con 0x7f42480716d0 2023-05-17T11:46:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380bf7b0 con 0x7f42480716d0 2023-05-17T11:46:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380bfb60 con 0x7f42480716d0 2023-05-17T11:46:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4248166c20 con 0x7f42480716d0 2023-05-17T11:46:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42480c8e80 con 0x7f42480716d0 2023-05-17T11:46:06.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4248166db0 con 0x7f42480716d0 2023-05-17T11:46:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.470+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42380b5400 con 0x7f42480716d0 2023-05-17T11:46:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.474+0000 7f422ffff640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4234066280 0x7f4234068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.474+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f423811e7a0 con 0x7f42480716d0 2023-05-17T11:46:06.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.474+0000 7f4246ffd640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4234066280 0x7f4234068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.474+0000 7f4246ffd640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4234066280 0x7f4234068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f423c007fd0 tx=0x7f423c007940 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.474+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f42380ebca0 con 0x7f42480716d0 2023-05-17T11:46:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.630+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42480c3540 con 0x7f42480716d0 2023-05-17T11:46:06.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f422ffff640 1 -- 172.21.15.3:0/1801732429 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f42480c3540 con 0x7f42480716d0 2023-05-17T11:46:06.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:06.643 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4234066280 msgr2=0x7f4234068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4234066280 0x7f4234068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f423c007fd0 tx=0x7f423c007940 comp rx=0 tx=0).stop 2023-05-17T11:46:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 msgr2=0x7f42480c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 0x7f42480c7610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f42380ad040 tx=0x7f423801ac90 comp rx=0 tx=0).stop 2023-05-17T11:46:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 shutdown_connections 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4234066280 0x7f4234068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f424815a2e0 0x7f42480aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f42480c9fd0 0x7f4248154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 --2- 172.21.15.3:0/1801732429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42480716d0 0x7f42480c7610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 >> 172.21.15.3:0/1801732429 conn(0x7f42480b0b30 msgr2=0x7f4248071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 shutdown_connections 2023-05-17T11:46:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.634+0000 7f424dec3640 1 -- 172.21.15.3:0/1801732429 wait complete. 2023-05-17T11:46:06.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:06.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 Processor -- start 2023-05-17T11:46:06.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 -- start start 2023-05-17T11:46:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f380b2950 0x7f2f3809bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380ad760 0x7f2f380cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3806d020 con 0x7f2f380cddf0 2023-05-17T11:46:06.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380b2d20 con 0x7f2f380b2950 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.794+0000 7f2f401e1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f381591b0 con 0x7f2f380ad760 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f380b2950 0x7f2f3809bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3e77e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2f380cddf0 0x7f2f380c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36902/0 (socket says 172.21.15.3:36902) 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f380b2950 0x7f2f3809bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41318/0 (socket says 172.21.15.3:41318) 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3e77e640 1 -- 172.21.15.3:0/2552522220 learned_addr learned my addr 172.21.15.3:0/2552522220 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3d77c640 1 --2- 172.21.15.3:0/2552522220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380ad760 0x7f2f380cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 -- 172.21.15.3:0/2552522220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380ad760 msgr2=0x7f2f380cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 --2- 172.21.15.3:0/2552522220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380ad760 0x7f2f380cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 -- 172.21.15.3:0/2552522220 >> v1:172.21.15.3:6789/0 conn(0x7f2f380cddf0 legacy=0x7f2f380c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 -- 172.21.15.3:0/2552522220 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380adb90 con 0x7f2f380b2950 2023-05-17T11:46:06.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3cf7b640 1 -- 172.21.15.3:0/2552522220 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289382084 0 0) 0x7f2f3806d020 con 0x7f2f380cddf0 2023-05-17T11:46:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3df7d640 1 --2- 172.21.15.3:0/2552522220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3809bd90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f340097c0 tx=0x7f2f3401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eee73601612970 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3cf7b640 1 -- 172.21.15.3:0/2552522220 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340ab600 con 0x7f2f380b2950 2023-05-17T11:46:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3cf7b640 1 -- 172.21.15.3:0/2552522220 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340a7050 con 0x7f2f380b2950 2023-05-17T11:46:06.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.798+0000 7f2f3cf7b640 1 -- 172.21.15.3:0/2552522220 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340ab980 con 0x7f2f380b2950 2023-05-17T11:46:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- 172.21.15.3:0/2552522220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 msgr2=0x7f2f3809bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 --2- 172.21.15.3:0/2552522220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3809bd90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f340097c0 tx=0x7f2f3401c450 comp rx=0 tx=0).stop 2023-05-17T11:46:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- 172.21.15.3:0/2552522220 shutdown_connections 2023-05-17T11:46:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 --2- 172.21.15.3:0/2552522220 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380ad760 0x7f2f380cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 --2- 172.21.15.3:0/2552522220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3809bd90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- 172.21.15.3:0/2552522220 >> 172.21.15.3:0/2552522220 conn(0x7f2f3806a740 msgr2=0x7f2f380cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- 172.21.15.3:0/2552522220 shutdown_connections 2023-05-17T11:46:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- 172.21.15.3:0/2552522220 wait complete. 2023-05-17T11:46:06.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 Processor -- start 2023-05-17T11:46:06.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- start start 2023-05-17T11:46:06.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f380ad760 0x7f2f381553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380cddf0 0x7f2f3815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38155920 con 0x7f2f380b2950 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815a580 con 0x7f2f380ad760 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f401e1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815a2a0 con 0x7f2f380cddf0 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3815a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41326/0 (socket says 172.21.15.3:41326) 2023-05-17T11:46:06.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 -- 172.21.15.3:0/303703457 learned_addr learned my addr 172.21.15.3:0/303703457 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3df7d640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f380ad760 0x7f2f381553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3e77e640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380cddf0 0x7f2f3815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 -- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380cddf0 msgr2=0x7f2f3815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380cddf0 0x7f2f3815ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 -- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f380ad760 msgr2=0x7f2f381553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f380ad760 0x7f2f381553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3d77c640 1 -- 172.21.15.3:0/303703457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34009420 con 0x7f2f380b2950 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3df7d640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f380ad760 0x7f2f381553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.802+0000 7f2f3e77e640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380cddf0 0x7f2f3815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f3d77c640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3815a850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800d800 tx=0x7f2f2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800b6c0 con 0x7f2f380b2950 2023-05-17T11:46:06.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800b820 con 0x7f2f380b2950 2023-05-17T11:46:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380cc380 con 0x7f2f380b2950 2023-05-17T11:46:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800bb90 con 0x7f2f380b2950 2023-05-17T11:46:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3806d4b0 con 0x7f2f380b2950 2023-05-17T11:46:06.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380cb8d0 con 0x7f2f380b2950 2023-05-17T11:46:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f2800bcf0 con 0x7f2f380b2950 2023-05-17T11:46:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f2e7fc640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f1c0662b0 0x7f2f1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.806+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f28084360 con 0x7f2f380b2950 2023-05-17T11:46:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.810+0000 7f2f3df7d640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f1c0662b0 0x7f2f1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:06.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.810+0000 7f2f3df7d640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f1c0662b0 0x7f2f1c068760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f340ad000 tx=0x7f2f340a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:06.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.810+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2f280551d0 con 0x7f2f380b2950 2023-05-17T11:46:06.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f3804de80 con 0x7f2f380b2950 2023-05-17T11:46:06.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f2e7fc640 1 -- 172.21.15.3:0/303703457 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f28054d60 con 0x7f2f380b2950 2023-05-17T11:46:06.977 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:06.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f1c0662b0 msgr2=0x7f2f1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f1c0662b0 0x7f2f1c068760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f340ad000 tx=0x7f2f340a6000 comp rx=0 tx=0).stop 2023-05-17T11:46:06.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 msgr2=0x7f2f3815a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3815a850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800d800 tx=0x7f2f2800dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 shutdown_connections 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2f1c0662b0 0x7f2f1c068760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2f380cddf0 0x7f2f3815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f380b2950 0x7f2f3815a850 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 --2- 172.21.15.3:0/303703457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f380ad760 0x7f2f381553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 >> 172.21.15.3:0/303703457 conn(0x7f2f3806a740 msgr2=0x7f2f380ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:06.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 shutdown_connections 2023-05-17T11:46:06.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:06.966+0000 7f2f401e1640 1 -- 172.21.15.3:0/303703457 wait complete. 2023-05-17T11:46:06.996 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 Processor -- start 2023-05-17T11:46:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 -- start start 2023-05-17T11:46:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd85406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd8540ceac0 0x7fd85406b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85406abb0 con 0x7fd8540b19f0 2023-05-17T11:46:07.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540cdbd0 con 0x7fd8540ceac0 2023-05-17T11:46:07.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd859da2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8540cdeb0 con 0x7fd8540d0ab0 2023-05-17T11:46:07.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd8540ceac0 0x7fd85406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd8540ceac0 0x7fd85406b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41340/0 (socket says 172.21.15.3:41340) 2023-05-17T11:46:07.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 -- 172.21.15.3:0/2025497223 learned_addr learned my addr 172.21.15.3:0/2025497223 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:07.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd853fff640 1 --2- 172.21.15.3:0/2025497223 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd85406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 -- 172.21.15.3:0/2025497223 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 msgr2=0x7fd85406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:07.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 --2- 172.21.15.3:0/2025497223 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd85406b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 -- 172.21.15.3:0/2025497223 >> v1:172.21.15.60:6789/0 conn(0x7fd8540b19f0 legacy=0x7fd8540d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.126+0000 7fd8595a1640 1 -- 172.21.15.3:0/2025497223 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540ce190 con 0x7fd8540ceac0 2023-05-17T11:46:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd8595a1640 1 --2- 172.21.15.3:0/2025497223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540ceac0 0x7fd85406b860 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009e50 tx=0x7fd84c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f495175afe101e52 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd8537fe640 1 -- 172.21.15.3:0/2025497223 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0a56b0 con 0x7fd8540ceac0 2023-05-17T11:46:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd8537fe640 1 -- 172.21.15.3:0/2025497223 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c0a5810 con 0x7fd8540ceac0 2023-05-17T11:46:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd8537fe640 1 -- 172.21.15.3:0/2025497223 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0a5ba0 con 0x7fd8540ceac0 2023-05-17T11:46:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 -- 172.21.15.3:0/2025497223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540ceac0 msgr2=0x7fd85406b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 --2- 172.21.15.3:0/2025497223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540ceac0 0x7fd85406b860 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009e50 tx=0x7fd84c01c8c0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 -- 172.21.15.3:0/2025497223 shutdown_connections 2023-05-17T11:46:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 --2- 172.21.15.3:0/2025497223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540ceac0 0x7fd85406b860 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 --2- 172.21.15.3:0/2025497223 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd85406b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 -- 172.21.15.3:0/2025497223 >> 172.21.15.3:0/2025497223 conn(0x7fd85409bb20 msgr2=0x7fd8540d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 -- 172.21.15.3:0/2025497223 shutdown_connections 2023-05-17T11:46:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.130+0000 7fd859da2640 1 -- 172.21.15.3:0/2025497223 wait complete. 2023-05-17T11:46:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 Processor -- start 2023-05-17T11:46:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 -- start start 2023-05-17T11:46:07.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540b19f0 0x7fd854154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 0x7fd8541f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd8541f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85415b8e0 con 0x7fd8540b19f0 2023-05-17T11:46:07.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85415c530 con 0x7fd8540ceac0 2023-05-17T11:46:07.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd859da2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85415acd0 con 0x7fd8540d0ab0 2023-05-17T11:46:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd858da0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540b19f0 0x7fd854154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 0x7fd8541f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 0x7fd8541f7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:37010/0 (socket says 172.21.15.3:37010) 2023-05-17T11:46:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 -- 172.21.15.3:0/3341609311 learned_addr learned my addr 172.21.15.3:0/3341609311 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd8595a1640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd8541f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 -- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 msgr2=0x7fd8541f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd8541f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 -- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540b19f0 msgr2=0x7fd854154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540b19f0 0x7fd854154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd853fff640 1 -- 172.21.15.3:0/3341609311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c009b30 con 0x7fd8540ceac0 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.134+0000 7fd858da0640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540b19f0 0x7fd854154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd853fff640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 0x7fd8541f7fc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e840 tx=0x7fd84000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840009510 con 0x7fd8540ceac0 2023-05-17T11:46:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000ee90 con 0x7fd8540ceac0 2023-05-17T11:46:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd854169230 con 0x7fd8540ceac0 2023-05-17T11:46:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000cb80 con 0x7fd8540ceac0 2023-05-17T11:46:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85406c5b0 con 0x7fd8540ceac0 2023-05-17T11:46:07.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8541693c0 con 0x7fd8540ceac0 2023-05-17T11:46:07.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd84000cce0 con 0x7fd8540ceac0 2023-05-17T11:46:07.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd8517fa640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd838066280 0x7fd838068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd840084530 con 0x7fd8540ceac0 2023-05-17T11:46:07.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.138+0000 7fd858da0640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd838066280 0x7fd838068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.142+0000 7fd858da0640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd838066280 0x7fd838068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd848007fd0 tx=0x7fd848009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.142+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd840051a40 con 0x7fd8540ceac0 2023-05-17T11:46:07.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8540cd3c0 con 0x7fd8540ceac0 2023-05-17T11:46:07.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd8517fa640 1 -- 172.21.15.3:0/3341609311 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd840055060 con 0x7fd8540ceac0 2023-05-17T11:46:07.308 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd838066280 msgr2=0x7fd838068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd838066280 0x7fd838068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd848007fd0 tx=0x7fd848009040 comp rx=0 tx=0).stop 2023-05-17T11:46:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 msgr2=0x7fd8541f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 0x7fd8541f7fc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e840 tx=0x7fd84000ec40 comp rx=0 tx=0).stop 2023-05-17T11:46:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 shutdown_connections 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd838066280 0x7fd838068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd8540d0ab0 0x7fd8541f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8540ceac0 0x7fd8541f7fc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 --2- 172.21.15.3:0/3341609311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8540b19f0 0x7fd854154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 >> 172.21.15.3:0/3341609311 conn(0x7fd85409bb20 msgr2=0x7fd854158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 shutdown_connections 2023-05-17T11:46:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.298+0000 7fd859da2640 1 -- 172.21.15.3:0/3341609311 wait complete. 2023-05-17T11:46:07.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:07.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.458+0000 7f85c5c2a640 1 Processor -- start 2023-05-17T11:46:07.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.458+0000 7f85c5c2a640 1 -- start start 2023-05-17T11:46:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5c2a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c0158a40 0x7f85c00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5c2a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f85c00b0370 0x7f85c00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5c2a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c015cbc0 con 0x7f85c0158e10 2023-05-17T11:46:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5c2a640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c015d740 con 0x7f85c00b0370 2023-05-17T11:46:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5c2a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c015cea0 con 0x7f85c0158a40 2023-05-17T11:46:07.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f85c00b0370 0x7f85c00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f85c00b0370 0x7f85c00cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41356/0 (socket says 172.21.15.3:41356) 2023-05-17T11:46:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 -- 172.21.15.3:0/2053487546 learned_addr learned my addr 172.21.15.3:0/2053487546 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c4c28640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c0158a40 0x7f85c00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 -- 172.21.15.3:0/2053487546 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c0158a40 msgr2=0x7f85c00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c0158a40 0x7f85c00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 -- 172.21.15.3:0/2053487546 >> v1:172.21.15.60:6789/0 conn(0x7f85c0158e10 legacy=0x7f85c00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 -- 172.21.15.3:0/2053487546 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c015d180 con 0x7f85c00b0370 2023-05-17T11:46:07.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c4c28640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c0158a40 0x7f85c00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85c5429640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c00b0370 0x7f85c00cd0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009e50 tx=0x7f85b801eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6c33d0c9ceb41d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85bf7fe640 1 -- 172.21.15.3:0/2053487546 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80a7910 con 0x7f85c00b0370 2023-05-17T11:46:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85bf7fe640 1 -- 172.21.15.3:0/2053487546 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b80a7a70 con 0x7f85c00b0370 2023-05-17T11:46:07.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.462+0000 7f85bf7fe640 1 -- 172.21.15.3:0/2053487546 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80a7e00 con 0x7f85c00b0370 2023-05-17T11:46:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2053487546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c00b0370 msgr2=0x7f85c00cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c00b0370 0x7f85c00cd0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009e50 tx=0x7f85b801eb90 comp rx=0 tx=0).stop 2023-05-17T11:46:07.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2053487546 shutdown_connections 2023-05-17T11:46:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c00b0370 0x7f85c00cd0c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2053487546 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c0158a40 0x7f85c00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2053487546 >> 172.21.15.3:0/2053487546 conn(0x7f85c0069ab0 msgr2=0x7f85c0069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2053487546 shutdown_connections 2023-05-17T11:46:07.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2053487546 wait complete. 2023-05-17T11:46:07.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 Processor -- start 2023-05-17T11:46:07.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- start start 2023-05-17T11:46:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85c00b0370 0x7f85c014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 0x7f85c0162e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c01633b0 0x7f85c01591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00b30f0 con 0x7f85c0158a40 2023-05-17T11:46:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00b2470 con 0x7f85c00b0370 2023-05-17T11:46:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85c5c2a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00b2750 con 0x7f85c01633b0 2023-05-17T11:46:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85bffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 0x7f85c0162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85bffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 0x7f85c0162e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41370/0 (socket says 172.21.15.3:41370) 2023-05-17T11:46:07.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.466+0000 7f85bffff640 1 -- 172.21.15.3:0/2808065663 learned_addr learned my addr 172.21.15.3:0/2808065663 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85c4c28640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85c00b0370 0x7f85c014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85c5429640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c01633b0 0x7f85c01591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bffff640 1 -- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c01633b0 msgr2=0x7f85c01591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bffff640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c01633b0 0x7f85c01591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bffff640 1 -- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85c00b0370 msgr2=0x7f85c014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bffff640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85c00b0370 0x7f85c014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bffff640 1 -- 172.21.15.3:0/2808065663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8009b30 con 0x7f85c0158a40 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bffff640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 0x7f85c0162e70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c3c0 tx=0x7f85ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0052d0 con 0x7f85c0158a40 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac005430 con 0x7f85c0158a40 2023-05-17T11:46:07.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac003840 con 0x7f85c0158a40 2023-05-17T11:46:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c015c900 con 0x7f85c0158a40 2023-05-17T11:46:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c015c770 con 0x7f85c0158a40 2023-05-17T11:46:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00cde10 con 0x7f85c0158a40 2023-05-17T11:46:07.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85ac0039a0 con 0x7f85c0158a40 2023-05-17T11:46:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.470+0000 7f85bd7fa640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85a4066280 0x7f85a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.474+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85ac0832d0 con 0x7f85c0158a40 2023-05-17T11:46:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.474+0000 7f85c4c28640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85a4066280 0x7f85a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.474+0000 7f85c4c28640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85a4066280 0x7f85a4068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85b40098b0 tx=0x7f85b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.474+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f85ac0506b0 con 0x7f85c0158a40 2023-05-17T11:46:07.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85c00616e0 con 0x7f85c0158a40 2023-05-17T11:46:07.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85bd7fa640 1 -- 172.21.15.3:0/2808065663 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85ac053cd0 con 0x7f85c0158a40 2023-05-17T11:46:07.645 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85a4066280 msgr2=0x7f85a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85a4066280 0x7f85a4068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85b40098b0 tx=0x7f85b4008040 comp rx=0 tx=0).stop 2023-05-17T11:46:07.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 msgr2=0x7f85c0162e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 0x7f85c0162e70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c3c0 tx=0x7f85ac00c880 comp rx=0 tx=0).stop 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 shutdown_connections 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f85a4066280 0x7f85a4068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f85c01633b0 0x7f85c01591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85c0158a40 0x7f85c0162e70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 --2- 172.21.15.3:0/2808065663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85c00b0370 0x7f85c014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.634+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 >> 172.21.15.3:0/2808065663 conn(0x7f85c0069ab0 msgr2=0x7f85c0071380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.638+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 shutdown_connections 2023-05-17T11:46:07.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.638+0000 7f85c5c2a640 1 -- 172.21.15.3:0/2808065663 wait complete. 2023-05-17T11:46:07.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:07.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 Processor -- start 2023-05-17T11:46:07.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 -- start start 2023-05-17T11:46:07.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa804070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa80415c480 0x7fa8040cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80415fd30 con 0x7fa8040cb0b0 2023-05-17T11:46:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80415d540 con 0x7fa80415c480 2023-05-17T11:46:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.794+0000 7fa808d6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80415cca0 con 0x7fa80415c0b0 2023-05-17T11:46:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa80415c480 0x7fa8040cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa80415c480 0x7fa8040cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41376/0 (socket says 172.21.15.3:41376) 2023-05-17T11:46:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 -- 172.21.15.3:0/2369260113 learned_addr learned my addr 172.21.15.3:0/2369260113 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:07.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa80259c640 1 --2- 172.21.15.3:0/2369260113 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa804070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 -- 172.21.15.3:0/2369260113 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 msgr2=0x7fa804070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:07.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 --2- 172.21.15.3:0/2369260113 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa804070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 -- 172.21.15.3:0/2369260113 >> v1:172.21.15.60:6789/0 conn(0x7fa8040cb0b0 legacy=0x7fa8041601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 -- 172.21.15.3:0/2369260113 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80415cf80 con 0x7fa80415c480 2023-05-17T11:46:07.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa7fbfff640 1 --2- 172.21.15.3:0/2369260113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa80415c480 0x7fa8040cab70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a87e522b58b8f2c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa801d9b640 1 -- 172.21.15.3:0/2369260113 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab620 con 0x7fa80415c480 2023-05-17T11:46:07.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa801d9b640 1 -- 172.21.15.3:0/2369260113 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0ab780 con 0x7fa80415c480 2023-05-17T11:46:07.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.798+0000 7fa801d9b640 1 -- 172.21.15.3:0/2369260113 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0abb10 con 0x7fa80415c480 2023-05-17T11:46:07.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- 172.21.15.3:0/2369260113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa80415c480 msgr2=0x7fa8040cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 --2- 172.21.15.3:0/2369260113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa80415c480 0x7fa8040cab70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec01c510 comp rx=0 tx=0).stop 2023-05-17T11:46:07.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- 172.21.15.3:0/2369260113 shutdown_connections 2023-05-17T11:46:07.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 --2- 172.21.15.3:0/2369260113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa80415c480 0x7fa8040cab70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 --2- 172.21.15.3:0/2369260113 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa804070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- 172.21.15.3:0/2369260113 >> 172.21.15.3:0/2369260113 conn(0x7fa8040d05b0 msgr2=0x7fa8040d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:07.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- 172.21.15.3:0/2369260113 shutdown_connections 2023-05-17T11:46:07.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- 172.21.15.3:0/2369260113 wait complete. 2023-05-17T11:46:07.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 Processor -- start 2023-05-17T11:46:07.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- start start 2023-05-17T11:46:07.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 0x7fa80414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa80414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa80415c480 0x7fa80406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c3cf0 con 0x7fa8040cb0b0 2023-05-17T11:46:07.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80414fb50 con 0x7fa80415c480 2023-05-17T11:46:07.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa808d6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80414fe30 con 0x7fa80415c0b0 2023-05-17T11:46:07.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 0x7fa80414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 0x7fa80414ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41386/0 (socket says 172.21.15.3:41386) 2023-05-17T11:46:07.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 -- 172.21.15.3:0/53224415 learned_addr learned my addr 172.21.15.3:0/53224415 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:07.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa802d9d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa80415c480 0x7fa80406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa7fbfff640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa80414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 -- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 msgr2=0x7fa80414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa80414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 -- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa80415c480 msgr2=0x7fa80406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa80415c480 0x7fa80406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa80259c640 1 -- 172.21.15.3:0/53224415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0094d0 con 0x7fa8040cb0b0 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.802+0000 7fa7fbfff640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa80414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa80259c640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 0x7fa80414ea20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d800 tx=0x7fa7f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b6c0 con 0x7fa8040cb0b0 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b820 con 0x7fa8040cb0b0 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400bb90 con 0x7fa8040cb0b0 2023-05-17T11:46:07.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa804160a60 con 0x7fa8040cb0b0 2023-05-17T11:46:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8041608d0 con 0x7fa8040cb0b0 2023-05-17T11:46:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa804168ea0 con 0x7fa8040cb0b0 2023-05-17T11:46:07.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7f400bcf0 con 0x7fa8040cb0b0 2023-05-17T11:46:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7faffd640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa7e40662b0 0x7fa7e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7f4084150 con 0x7fa8040cb0b0 2023-05-17T11:46:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.806+0000 7fa7fbfff640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa7e40662b0 0x7fa7e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:07.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.810+0000 7fa7fbfff640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa7e40662b0 0x7fa7e4068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0af000 tx=0x7fa7ec0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:07.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.810+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa7f4051660 con 0x7fa8040cb0b0 2023-05-17T11:46:07.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa80404de80 con 0x7fa8040cb0b0 2023-05-17T11:46:07.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa7faffd640 1 -- 172.21.15.3:0/53224415 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7f4054c80 con 0x7fa8040cb0b0 2023-05-17T11:46:07.975 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:07.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa7e40662b0 msgr2=0x7fa7e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa7e40662b0 0x7fa7e4068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0af000 tx=0x7fa7ec0a7000 comp rx=0 tx=0).stop 2023-05-17T11:46:07.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 msgr2=0x7fa80414ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:07.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 0x7fa80414ea20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d800 tx=0x7fa7f400dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 shutdown_connections 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa7e40662b0 0x7fa7e4068760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa80415c480 0x7fa80406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa80415c0b0 0x7fa80414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 --2- 172.21.15.3:0/53224415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8040cb0b0 0x7fa80414ea20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 >> 172.21.15.3:0/53224415 conn(0x7fa8040d05b0 msgr2=0x7fa8040cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 shutdown_connections 2023-05-17T11:46:07.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:07.966+0000 7fa808d6d640 1 -- 172.21.15.3:0/53224415 wait complete. 2023-05-17T11:46:08.040 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-17T11:46:08.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-17T11:46:08.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.166+0000 7fea5e8f2640 1 Processor -- start 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.166+0000 7fea5e8f2640 1 -- start start 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5e8f2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea5815d0b0 0x7fea5815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5e8f2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5806d790 con 0x7fea5806d9f0 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5e8f2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5815cc20 con 0x7fea580cbf20 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5e8f2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5806cfe0 con 0x7fea5815d0b0 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea57fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fea5806d9f0 0x7fea5806ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36918/0 (socket says 172.21.15.3:36918) 2023-05-17T11:46:08.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea57fff640 1 -- 172.21.15.3:0/2817099362 learned_addr learned my addr 172.21.15.3:0/2817099362 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/2817099362 >> v2:172.21.15.60:3300/0 conn(0x7fea5815d0b0 0x7fea5815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612053758 0 0) 0x7fea5806d790 con 0x7fea5806d9f0 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea40003530 con 0x7fea5806d9f0 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365810245 0 0) 0x7fea40003530 con 0x7fea5806d9f0 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 >> v2:172.21.15.60:3300/0 conn(0x7fea5815d0b0 msgr2=0x7fea5815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 --2- 172.21.15.3:0/2817099362 >> v2:172.21.15.60:3300/0 conn(0x7fea5815d0b0 0x7fea5815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 >> v1:172.21.15.60:6789/0 conn(0x7fea580cbf20 legacy=0x7fea5806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5806d1d0 con 0x7fea5806d9f0 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fea48001680 con 0x7fea5806d9f0 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 >> v1:172.21.15.3:6789/0 conn(0x7fea5806d9f0 legacy=0x7fea5806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea400039f0 0x7fea40003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea400047d0 0x7fea40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea40005180 0x7fea4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4000c060 con 0x7fea40005180 2023-05-17T11:46:08.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4000c1a0 con 0x7fea400039f0 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4000c360 con 0x7fea400047d0 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea40005180 0x7fea4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea57fff640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea400039f0 0x7fea40003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea577fe640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea400047d0 0x7fea40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 -- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea400047d0 msgr2=0x7fea40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea400047d0 0x7fea40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 -- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea400039f0 msgr2=0x7fea40003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:08.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea400039f0 0x7fea40003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.170+0000 7fea5ce8f640 1 -- 172.21.15.3:0/2817099362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40003530 con 0x7fea40005180 2023-05-17T11:46:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5ce8f640 1 -- 172.21.15.3:0/2817099362 reap_dead start 2023-05-17T11:46:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea40005180 0x7fea4000b990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea50009fc0 tx=0x7fea5001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5971d4a61aba0dfa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500a5cb0 con 0x7fea40005180 2023-05-17T11:46:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000f040 con 0x7fea40005180 2023-05-17T11:46:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea56ffd640 1 -- 172.21.15.3:0/2817099362 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003be0 con 0x7fea40005180 2023-05-17T11:46:08.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 -- 172.21.15.3:0/2817099362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea40005180 msgr2=0x7fea4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea40005180 0x7fea4000b990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea50009fc0 tx=0x7fea5001cca0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 -- 172.21.15.3:0/2817099362 shutdown_connections 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/2817099362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea40005180 0x7fea4000b990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 -- 172.21.15.3:0/2817099362 >> 172.21.15.3:0/2817099362 conn(0x7fea5806b4e0 msgr2=0x7fea580cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 -- 172.21.15.3:0/2817099362 shutdown_connections 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 -- 172.21.15.3:0/2817099362 wait complete. 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.174+0000 7fea5e8f2640 1 Processor -- start 2023-05-17T11:46:08.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- start start 2023-05-17T11:46:08.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea40005180 0x7fea58153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea580aef40 0x7fea580b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 0x7fea5815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5815eeb0 con 0x7fea5815e4d0 2023-05-17T11:46:08.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580affe0 con 0x7fea580aef40 2023-05-17T11:46:08.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580b0470 con 0x7fea40005180 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 0x7fea5815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea57fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea40005180 0x7fea58153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea580aef40 0x7fea580b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea57fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea40005180 0x7fea58153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:37702/0 (socket says 172.21.15.3:37702) 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 0x7fea5815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41410/0 (socket says 172.21.15.3:41410) 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea57fff640 1 -- 172.21.15.3:0/1024898381 learned_addr learned my addr 172.21.15.3:0/1024898381 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 -- 172.21.15.3:0/1024898381 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea40005180 msgr2=0x7fea58153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea40005180 0x7fea58153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 -- 172.21.15.3:0/1024898381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea580aef40 msgr2=0x7fea580b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea580aef40 0x7fea580b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 -- 172.21.15.3:0/1024898381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5815c8b0 con 0x7fea5815e4d0 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5ce8f640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 0x7fea5815e970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea580aeb30 tx=0x7fea50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003ba0 con 0x7fea5815e4d0 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50003d00 con 0x7fea5815e4d0 2023-05-17T11:46:08.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50004220 con 0x7fea5815e4d0 2023-05-17T11:46:08.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5806d4b0 con 0x7fea5815e4d0 2023-05-17T11:46:08.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea580cccd0 con 0x7fea5815e4d0 2023-05-17T11:46:08.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.178+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea580b0170 con 0x7fea5815e4d0 2023-05-17T11:46:08.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.182+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea50004380 con 0x7fea5815e4d0 2023-05-17T11:46:08.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.182+0000 7fea54ff9640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea44066280 0x7fea44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.182+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea5011e3b0 con 0x7fea5815e4d0 2023-05-17T11:46:08.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.182+0000 7fea57fff640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea44066280 0x7fea44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.182+0000 7fea57fff640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea44066280 0x7fea44068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea48007d30 tx=0x7fea48000ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:08.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.186+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fea500eb790 con 0x7fea5815e4d0 2023-05-17T11:46:08.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.390+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fea5804de80 con 0x7fea5815e4d0 2023-05-17T11:46:08.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.666+0000 7fea54ff9640 1 -- 172.21.15.3:0/1024898381 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v57) v1 ==== 147+0+0 (secure 0 0 0) 0x7fea500eedb0 con 0x7fea5815e4d0 2023-05-17T11:46:08.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea44066280 msgr2=0x7fea44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea44066280 0x7fea44068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea48007d30 tx=0x7fea48000ee0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 msgr2=0x7fea5815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 0x7fea5815e970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea580aeb30 tx=0x7fea50009750 comp rx=0 tx=0).stop 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 shutdown_connections 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea44066280 0x7fea44068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea5815e4d0 0x7fea5815e970 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea580aef40 0x7fea580b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 --2- 172.21.15.3:0/1024898381 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea40005180 0x7fea58153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 >> 172.21.15.3:0/1024898381 conn(0x7fea5806b4e0 msgr2=0x7fea5815fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:08.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 shutdown_connections 2023-05-17T11:46:08.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.670+0000 7fea5e8f2640 1 -- 172.21.15.3:0/1024898381 wait complete. 2023-05-17T11:46:08.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T11:46:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4fb7b640 1 Processor -- start 2023-05-17T11:46:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4fb7b640 1 -- start start 2023-05-17T11:46:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4fb7b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4806cef0 0x7f3e4815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4fb7b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4815cb00 con 0x7f3e48156460 2023-05-17T11:46:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4fb7b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4815cde0 con 0x7f3e4806e7d0 2023-05-17T11:46:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4fb7b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4815d0c0 con 0x7f3e4806cef0 2023-05-17T11:46:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4d917640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3e48156460 0x7f3e4806c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36934/0 (socket says 172.21.15.3:36934) 2023-05-17T11:46:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4d917640 1 -- 172.21.15.3:0/3098971458 learned_addr learned my addr 172.21.15.3:0/3098971458 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4d116640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4806cef0 0x7f3e4815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390498140 0 0) 0x7f3e4815cb00 con 0x7f3e48156460 2023-05-17T11:46:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e34003530 con 0x7f3e48156460 2023-05-17T11:46:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021253872 0 0) 0x7f3e4815cde0 con 0x7f3e4806e7d0 2023-05-17T11:46:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4815cb00 con 0x7f3e4806e7d0 2023-05-17T11:46:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761880717 0 0) 0x7f3e34003530 con 0x7f3e48156460 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4806cef0 msgr2=0x7f3e4815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4806cef0 0x7f3e4815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 >> v1:172.21.15.60:6789/0 conn(0x7f3e4806e7d0 legacy=0x7f3e480ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4815d3a0 con 0x7f3e48156460 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f3e44001680 con 0x7f3e48156460 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.830+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 >> v1:172.21.15.3:6789/0 conn(0x7f3e48156460 legacy=0x7f3e4806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e34003b40 0x7f3e34003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e340047d0 0x7f3e34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e34005180 0x7f3e3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4815d0c0 con 0x7f3e34003b40 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3400bf50 con 0x7f3e340047d0 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3400c110 con 0x7f3e34005180 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d116640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4806cef0 0x7f3e4815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e34003b40 0x7f3e34003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4e118640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e34005180 0x7f3e3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d116640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e340047d0 0x7f3e34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 -- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e34005180 msgr2=0x7f3e3400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e34005180 0x7f3e3400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 -- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e340047d0 msgr2=0x7f3e34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e340047d0 0x7f3e34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 -- 172.21.15.3:0/3098971458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34003530 con 0x7f3e34003b40 2023-05-17T11:46:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d116640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e340047d0 0x7f3e34004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4d917640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e34003b40 0x7f3e34003f30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400c160 tx=0x7f3e4401cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea0bf17dc424f12 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440058e0 con 0x7f3e34003b40 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44005a60 con 0x7f3e34003b40 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.834+0000 7f3e4c915640 1 -- 172.21.15.3:0/3098971458 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44005e10 con 0x7f3e34003b40 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/3098971458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e34003b40 msgr2=0x7f3e34003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/3098971458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e34003b40 0x7f3e34003f30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400c160 tx=0x7f3e4401cb00 comp rx=0 tx=0).stop 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4e118640 1 -- 172.21.15.3:0/3098971458 reap_dead start 2023-05-17T11:46:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/3098971458 shutdown_connections 2023-05-17T11:46:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/3098971458 >> 172.21.15.3:0/3098971458 conn(0x7f3e480b14a0 msgr2=0x7f3e480cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/3098971458 shutdown_connections 2023-05-17T11:46:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/3098971458 wait complete. 2023-05-17T11:46:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 Processor -- start 2023-05-17T11:46:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- start start 2023-05-17T11:46:08.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e34003b40 0x7f3e481501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 0x7f3e481527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4814f8a0 0x7f3e4814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e48151500 con 0x7f3e48151990 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4815fe30 con 0x7f3e34003b40 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4fb7b640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e481508f0 con 0x7f3e4814f8a0 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 0x7f3e481527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 0x7f3e481527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41440/0 (socket says 172.21.15.3:41440) 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 -- 172.21.15.3:0/1039578018 learned_addr learned my addr 172.21.15.3:0/1039578018 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4e118640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4814f8a0 0x7f3e4814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d917640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e34003b40 0x7f3e481501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 -- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4814f8a0 msgr2=0x7f3e4814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4814f8a0 0x7f3e4814ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 -- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e34003b40 msgr2=0x7f3e481501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:08.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e34003b40 0x7f3e481501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 -- 172.21.15.3:0/1039578018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480ae440 con 0x7f3e48151990 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d917640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e34003b40 0x7f3e481501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4e118640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4814f8a0 0x7f3e4814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.838+0000 7f3e4d116640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 0x7f3e481527f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e38010830 tx=0x7f3e38010920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38014800 con 0x7f3e48151990 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e38014960 con 0x7f3e48151990 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38014cd0 con 0x7f3e48151990 2023-05-17T11:46:08.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e480ad410 con 0x7f3e48151990 2023-05-17T11:46:08.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e480ae5d0 con 0x7f3e48151990 2023-05-17T11:46:08.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4804de80 con 0x7f3e48151990 2023-05-17T11:46:08.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e380253a0 con 0x7f3e48151990 2023-05-17T11:46:08.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e3e7fc640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e2c066280 0x7f3e2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:08.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e38084080 con 0x7f3e48151990 2023-05-17T11:46:08.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.842+0000 7f3e4d917640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e2c066280 0x7f3e2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:08.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.846+0000 7f3e4d917640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e2c066280 0x7f3e2c068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e440aa000 tx=0x7f3e44001a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:08.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:08.846+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3e380b46f0 con 0x7f3e48151990 2023-05-17T11:46:09.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.002+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3e48151640 con 0x7f3e48151990 2023-05-17T11:46:09.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.006+0000 7f3e3e7fc640 1 -- 172.21.15.3:0/1039578018 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e380513e0 con 0x7f3e48151990 2023-05-17T11:46:09.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e2c066280 msgr2=0x7f3e2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e2c066280 0x7f3e2c068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e440aa000 tx=0x7f3e44001a00 comp rx=0 tx=0).stop 2023-05-17T11:46:09.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 msgr2=0x7f3e481527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 0x7f3e481527f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e38010830 tx=0x7f3e38010920 comp rx=0 tx=0).stop 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 shutdown_connections 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e2c066280 0x7f3e2c068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e4814f8a0 0x7f3e4814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e48151990 0x7f3e481527f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 --2- 172.21.15.3:0/1039578018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e34003b40 0x7f3e481501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 >> 172.21.15.3:0/1039578018 conn(0x7f3e480b14a0 msgr2=0x7f3e480ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 shutdown_connections 2023-05-17T11:46:09.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.010+0000 7f3e4fb7b640 1 -- 172.21.15.3:0/1039578018 wait complete. 2023-05-17T11:46:09.039 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T11:46:09.039 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T11:46:09.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T11:46:09.167 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T11:46:09.168 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:46:09.168 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:09.176 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:46:09.177 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:09.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:09.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 Processor -- start 2023-05-17T11:46:09.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 -- start start 2023-05-17T11:46:09.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c0716d0 0x7f9b4c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b4c15a2e0 0x7f9b4c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0ca490 con 0x7f9b4c0c9fd0 2023-05-17T11:46:09.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0cacf0 con 0x7f9b4c15a2e0 2023-05-17T11:46:09.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b546f9640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c070140 con 0x7f9b4c0716d0 2023-05-17T11:46:09.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.394+0000 7f9b51c94640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b4c15a2e0 0x7f9b4c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b52c96640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9b4c0c9fd0 0x7f9b4c0b1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36944/0 (socket says 172.21.15.3:36944) 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b52c96640 1 -- 172.21.15.3:0/500123310 learned_addr learned my addr 172.21.15.3:0/500123310 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b52495640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c0716d0 0x7f9b4c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51c94640 1 -- 172.21.15.3:0/500123310 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c0716d0 msgr2=0x7f9b4c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51c94640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c0716d0 0x7f9b4c06fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51c94640 1 -- 172.21.15.3:0/500123310 >> v1:172.21.15.3:6789/0 conn(0x7f9b4c0c9fd0 legacy=0x7f9b4c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51c94640 1 -- 172.21.15.3:0/500123310 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c071fe0 con 0x7f9b4c15a2e0 2023-05-17T11:46:09.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b52495640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c0716d0 0x7f9b4c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:09.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51c94640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c15a2e0 0x7f9b4c071aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0097c0 tx=0x7f9b3c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9987ac384e5b1adc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:09.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51493640 1 -- 172.21.15.3:0/500123310 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0ab650 con 0x7f9b4c15a2e0 2023-05-17T11:46:09.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51493640 1 -- 172.21.15.3:0/500123310 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0ab7b0 con 0x7f9b4c15a2e0 2023-05-17T11:46:09.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.398+0000 7f9b51493640 1 -- 172.21.15.3:0/500123310 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0abb40 con 0x7f9b4c15a2e0 2023-05-17T11:46:09.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- 172.21.15.3:0/500123310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c15a2e0 msgr2=0x7f9b4c071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c15a2e0 0x7f9b4c071aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0097c0 tx=0x7f9b3c01c450 comp rx=0 tx=0).stop 2023-05-17T11:46:09.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- 172.21.15.3:0/500123310 shutdown_connections 2023-05-17T11:46:09.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c15a2e0 0x7f9b4c071aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 --2- 172.21.15.3:0/500123310 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c0716d0 0x7f9b4c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- 172.21.15.3:0/500123310 >> 172.21.15.3:0/500123310 conn(0x7f9b4c0b0b30 msgr2=0x7f9b4c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:09.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- 172.21.15.3:0/500123310 shutdown_connections 2023-05-17T11:46:09.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- 172.21.15.3:0/500123310 wait complete. 2023-05-17T11:46:09.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 Processor -- start 2023-05-17T11:46:09.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- start start 2023-05-17T11:46:09.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 0x7f9b4c14a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b4c0c9fd0 0x7f9b4c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c15a2e0 0x7f9b4c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1457c0 con 0x7f9b4c0716d0 2023-05-17T11:46:09.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1453a0 con 0x7f9b4c0c9fd0 2023-05-17T11:46:09.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b546f9640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0aedf0 con 0x7f9b4c15a2e0 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 0x7f9b4c14a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 0x7f9b4c14a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41456/0 (socket says 172.21.15.3:41456) 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 -- 172.21.15.3:0/1506164865 learned_addr learned my addr 172.21.15.3:0/1506164865 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52c96640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c15a2e0 0x7f9b4c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b51c94640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b4c0c9fd0 0x7f9b4c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 -- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c15a2e0 msgr2=0x7f9b4c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c15a2e0 0x7f9b4c155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 -- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b4c0c9fd0 msgr2=0x7f9b4c14d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b4c0c9fd0 0x7f9b4c14d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 -- 172.21.15.3:0/1506164865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009420 con 0x7f9b4c0716d0 2023-05-17T11:46:09.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b51c94640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b4c0c9fd0 0x7f9b4c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:09.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.402+0000 7f9b52495640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 0x7f9b4c14a540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800d800 tx=0x7f9b4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:09.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480096c0 con 0x7f9b4c0716d0 2023-05-17T11:46:09.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48009820 con 0x7f9b4c0716d0 2023-05-17T11:46:09.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48009bd0 con 0x7f9b4c0716d0 2023-05-17T11:46:09.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c0c8e80 con 0x7f9b4c0716d0 2023-05-17T11:46:09.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c0c8ba0 con 0x7f9b4c0716d0 2023-05-17T11:46:09.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c0b1910 con 0x7f9b4c0716d0 2023-05-17T11:46:09.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b48009d30 con 0x7f9b4c0716d0 2023-05-17T11:46:09.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b42ffd640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b30066280 0x7f9b30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b48084470 con 0x7f9b4c0716d0 2023-05-17T11:46:09.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b51c94640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b30066280 0x7f9b30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.406+0000 7f9b51c94640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b30066280 0x7f9b30068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0af000 tx=0x7f9b3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:09.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.410+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9b480518e0 con 0x7f9b4c0716d0 2023-05-17T11:46:09.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.566+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b4c0aec50 con 0x7f9b4c0716d0 2023-05-17T11:46:09.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b42ffd640 1 -- 172.21.15.3:0/1506164865 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f9b4c0aec50 con 0x7f9b4c0716d0 2023-05-17T11:46:09.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:09.580 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:09.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b30066280 msgr2=0x7f9b30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b30066280 0x7f9b30068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0af000 tx=0x7f9b3c008040 comp rx=0 tx=0).stop 2023-05-17T11:46:09.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 msgr2=0x7f9b4c14a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 0x7f9b4c14a540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800d800 tx=0x7f9b4800dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 shutdown_connections 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9b30066280 0x7f9b30068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9b4c15a2e0 0x7f9b4c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b4c0c9fd0 0x7f9b4c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 --2- 172.21.15.3:0/1506164865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b4c0716d0 0x7f9b4c14a540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 >> 172.21.15.3:0/1506164865 conn(0x7f9b4c0b0b30 msgr2=0x7f9b4c1592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:09.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 shutdown_connections 2023-05-17T11:46:09.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.570+0000 7f9b546f9640 1 -- 172.21.15.3:0/1506164865 wait complete. 2023-05-17T11:46:09.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:09.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:09.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.730+0000 7f7ba1d39640 1 Processor -- start 2023-05-17T11:46:09.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.730+0000 7f7ba1d39640 1 -- start start 2023-05-17T11:46:09.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7ba1d39640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b9c15d3d0 0x7f7b9c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7ba1d39640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b9c0b04c0 0x7f7b9c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7ba1d39640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c09bcb0 con 0x7f7b9c0cd2c0 2023-05-17T11:46:09.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7ba1d39640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0cdf90 con 0x7f7b9c15d3d0 2023-05-17T11:46:09.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7ba1d39640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0ca130 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b9c15d3d0 0x7f7b9c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b9c15d3d0 0x7f7b9c0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41468/0 (socket says 172.21.15.3:41468) 2023-05-17T11:46:09.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9affd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7b9c0cd2c0 0x7f7b9c0afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36954/0 (socket says 172.21.15.3:36954) 2023-05-17T11:46:09.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/2593924200 learned_addr learned my addr 172.21.15.3:0/2593924200 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:09.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9bfff640 1 --2- 172.21.15.3:0/2593924200 >> v2:172.21.15.60:3300/0 conn(0x7f7b9c0b04c0 0x7f7b9c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/2593924200 >> v2:172.21.15.60:3300/0 conn(0x7f7b9c0b04c0 msgr2=0x7f7b9c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:09.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 --2- 172.21.15.3:0/2593924200 >> v2:172.21.15.60:3300/0 conn(0x7f7b9c0b04c0 0x7f7b9c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/2593924200 >> v1:172.21.15.3:6789/0 conn(0x7f7b9c0cd2c0 legacy=0x7f7b9c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/2593924200 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c09bf00 con 0x7f7b9c15d3d0 2023-05-17T11:46:09.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.734+0000 7f7b9a7fc640 1 -- 172.21.15.3:0/2593924200 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815055443 0 0) 0x7f7b9c09bcb0 con 0x7f7b9c0cd2c0 2023-05-17T11:46:09.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7b9b7fe640 1 --2- 172.21.15.3:0/2593924200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c0ccd80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c061730 tx=0x7f7b8c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d208cb893767d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:09.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7b9a7fc640 1 -- 172.21.15.3:0/2593924200 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0ad660 con 0x7f7b9c15d3d0 2023-05-17T11:46:09.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7b9a7fc640 1 -- 172.21.15.3:0/2593924200 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0ad7c0 con 0x7f7b9c15d3d0 2023-05-17T11:46:09.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7b9a7fc640 1 -- 172.21.15.3:0/2593924200 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0adb50 con 0x7f7b9c15d3d0 2023-05-17T11:46:09.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 -- 172.21.15.3:0/2593924200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c15d3d0 msgr2=0x7f7b9c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/2593924200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c0ccd80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c061730 tx=0x7f7b8c01c470 comp rx=0 tx=0).stop 2023-05-17T11:46:09.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 -- 172.21.15.3:0/2593924200 shutdown_connections 2023-05-17T11:46:09.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/2593924200 >> v2:172.21.15.60:3300/0 conn(0x7f7b9c0b04c0 0x7f7b9c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/2593924200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c0ccd80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 -- 172.21.15.3:0/2593924200 >> 172.21.15.3:0/2593924200 conn(0x7f7b9c06a740 msgr2=0x7f7b9c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:09.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 -- 172.21.15.3:0/2593924200 shutdown_connections 2023-05-17T11:46:09.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 -- 172.21.15.3:0/2593924200 wait complete. 2023-05-17T11:46:09.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 Processor -- start 2023-05-17T11:46:09.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.738+0000 7f7ba1d39640 1 -- start start 2023-05-17T11:46:09.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 0x7f7b9c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b9c0cd2c0 0x7f7b9c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c098a70 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0adba0 con 0x7f7b9c15d3d0 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c3170 con 0x7f7b9c0cd2c0 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 0x7f7b9c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 0x7f7b9c1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41478/0 (socket says 172.21.15.3:41478) 2023-05-17T11:46:09.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/3390522913 learned_addr learned my addr 172.21.15.3:0/3390522913 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:09.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b9c0cd2c0 msgr2=0x7f7b9c153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9bfff640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9affd640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b9c0cd2c0 0x7f7b9c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b9c0cd2c0 0x7f7b9c153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b9c15d3d0 msgr2=0x7f7b9c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 -- 172.21.15.3:0/3390522913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0094d0 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9bfff640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9affd640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b9c0cd2c0 0x7f7b9c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b9b7fe640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 0x7f7b9c1532d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c019080 tx=0x7f7b8c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c004230 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c004390 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c003820 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c070060 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c15d7a0 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0701f0 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.742+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b8c003980 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.746+0000 7f7b83fff640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b88066280 0x7f7b88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:09.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.746+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b8c11e410 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.746+0000 7f7b9affd640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b88066280 0x7f7b88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:09.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.746+0000 7f7b9affd640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b88066280 0x7f7b88068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c09b5e0 tx=0x7f7b90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:09.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.750+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7b8c0eb9b0 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.902+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b9c0ad970 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.902+0000 7f7b83fff640 1 -- 172.21.15.3:0/3390522913 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b9c0ad970 con 0x7f7b9c0b04c0 2023-05-17T11:46:09.913 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:09.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b88066280 msgr2=0x7f7b88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b88066280 0x7f7b88068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c09b5e0 tx=0x7f7b90009040 comp rx=0 tx=0).stop 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 msgr2=0x7f7b9c1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 0x7f7b9c1532d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c019080 tx=0x7f7b8c019210 comp rx=0 tx=0).stop 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 shutdown_connections 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b88066280 0x7f7b88068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b9c15d3d0 0x7f7b9c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b9c0cd2c0 0x7f7b9c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 --2- 172.21.15.3:0/3390522913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b9c0b04c0 0x7f7b9c1532d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:09.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 >> 172.21.15.3:0/3390522913 conn(0x7f7b9c06a740 msgr2=0x7f7b9c0b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:09.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 shutdown_connections 2023-05-17T11:46:09.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:09.906+0000 7f7ba1d39640 1 -- 172.21.15.3:0/3390522913 wait complete. 2023-05-17T11:46:09.934 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:10.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 Processor -- start 2023-05-17T11:46:10.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 -- start start 2023-05-17T11:46:10.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5e7415c340 0x7f5e740d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e740b40b0 0x7f5e740d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e74066f00 con 0x7f5e740b25e0 2023-05-17T11:46:10.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740b0250 con 0x7f5e7415c340 2023-05-17T11:46:10.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e7bb6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740af640 con 0x7f5e740b40b0 2023-05-17T11:46:10.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5e7415c340 0x7f5e740d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5e7415c340 0x7f5e740d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41490/0 (socket says 172.21.15.3:41490) 2023-05-17T11:46:10.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 -- 172.21.15.3:0/595574107 learned_addr learned my addr 172.21.15.3:0/595574107 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:10.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79108640 1 --2- 172.21.15.3:0/595574107 >> v2:172.21.15.60:3300/0 conn(0x7f5e740b40b0 0x7f5e740d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 -- 172.21.15.3:0/595574107 >> v2:172.21.15.60:3300/0 conn(0x7f5e740b40b0 msgr2=0x7f5e740d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:10.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 --2- 172.21.15.3:0/595574107 >> v2:172.21.15.60:3300/0 conn(0x7f5e740b40b0 0x7f5e740d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 -- 172.21.15.3:0/595574107 >> v1:172.21.15.60:6789/0 conn(0x7f5e740b25e0 legacy=0x7f5e740b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:10.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.066+0000 7f5e79909640 1 -- 172.21.15.3:0/595574107 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740af920 con 0x7f5e7415c340 2023-05-17T11:46:10.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e79909640 1 --2- 172.21.15.3:0/595574107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e7415c340 0x7f5e740d0280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e7408ca80 tx=0x7f5e7001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58d289e5699f2cc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e78907640 1 -- 172.21.15.3:0/595574107 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700a7070 con 0x7f5e7415c340 2023-05-17T11:46:10.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e78907640 1 -- 172.21.15.3:0/595574107 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e700ab430 con 0x7f5e7415c340 2023-05-17T11:46:10.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e78907640 1 -- 172.21.15.3:0/595574107 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700ab7c0 con 0x7f5e7415c340 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/595574107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e7415c340 msgr2=0x7f5e740d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/595574107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e7415c340 0x7f5e740d0280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e7408ca80 tx=0x7f5e7001c430 comp rx=0 tx=0).stop 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/595574107 shutdown_connections 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/595574107 >> v2:172.21.15.60:3300/0 conn(0x7f5e740b40b0 0x7f5e740d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/595574107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e7415c340 0x7f5e740d0280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/595574107 >> 172.21.15.3:0/595574107 conn(0x7f5e74071b00 msgr2=0x7f5e7409bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:10.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/595574107 shutdown_connections 2023-05-17T11:46:10.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.070+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/595574107 wait complete. 2023-05-17T11:46:10.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 Processor -- start 2023-05-17T11:46:10.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 -- start start 2023-05-17T11:46:10.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 0x7f5e740cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e740b40b0 0x7f5e740cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e7415c340 0x7f5e740c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74150400 con 0x7f5e740b25e0 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740cbc90 con 0x7f5e7415c340 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740cbf70 con 0x7f5e740b40b0 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 0x7f5e740cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 0x7f5e740cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41494/0 (socket says 172.21.15.3:41494) 2023-05-17T11:46:10.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 -- 172.21.15.3:0/3505714808 learned_addr learned my addr 172.21.15.3:0/3505714808 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79108640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e740b40b0 0x7f5e740cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7a10a640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e7415c340 0x7f5e740c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 -- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e740b40b0 msgr2=0x7f5e740cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e740b40b0 0x7f5e740cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 -- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e7415c340 msgr2=0x7f5e740c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e7415c340 0x7f5e740c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 -- 172.21.15.3:0/3505714808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009480 con 0x7f5e740b25e0 2023-05-17T11:46:10.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e79909640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 0x7f5e740cb5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e7001a060 tx=0x7f5e700191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70003c70 con 0x7f5e740b25e0 2023-05-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70003df0 con 0x7f5e740b25e0 2023-05-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70005be0 con 0x7f5e740b25e0 2023-05-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e740b1e00 con 0x7f5e740b25e0 2023-05-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.074+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e740af2d0 con 0x7f5e740b25e0 2023-05-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.078+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e740b1f90 con 0x7f5e740b25e0 2023-05-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.078+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e700ab5a0 con 0x7f5e740b25e0 2023-05-17T11:46:10.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.078+0000 7f5e6a7fc640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e58066280 0x7f5e58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.078+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e7011e070 con 0x7f5e740b25e0 2023-05-17T11:46:10.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.078+0000 7f5e79108640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e58066280 0x7f5e58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.078+0000 7f5e79108640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e58066280 0x7f5e58068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e74158790 tx=0x7f5e64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.082+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5e700eb5a0 con 0x7f5e740b25e0 2023-05-17T11:46:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.234+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e7404de80 con 0x7f5e740b25e0 2023-05-17T11:46:10.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e6a7fc640 1 -- 172.21.15.3:0/3505714808 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e700c10a0 con 0x7f5e740b25e0 2023-05-17T11:46:10.247 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e58066280 msgr2=0x7f5e58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e58066280 0x7f5e58068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e74158790 tx=0x7f5e64008040 comp rx=0 tx=0).stop 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 msgr2=0x7f5e740cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 0x7f5e740cb5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e7001a060 tx=0x7f5e700191d0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 shutdown_connections 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e58066280 0x7f5e58068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e7415c340 0x7f5e740c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e740b40b0 0x7f5e740cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 --2- 172.21.15.3:0/3505714808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e740b25e0 0x7f5e740cb5d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 >> 172.21.15.3:0/3505714808 conn(0x7f5e74071b00 msgr2=0x7f5e740b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:10.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 shutdown_connections 2023-05-17T11:46:10.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.238+0000 7f5e7bb6d640 1 -- 172.21.15.3:0/3505714808 wait complete. 2023-05-17T11:46:10.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:10.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932e9f0640 1 Processor -- start 2023-05-17T11:46:10.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932e9f0640 1 -- start start 2023-05-17T11:46:10.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932e9f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9328070310 0x7f93280cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932e9f0640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9328070780 con 0x7f93280cb0b0 2023-05-17T11:46:10.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932e9f0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932815fd30 con 0x7f932815c0b0 2023-05-17T11:46:10.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932e9f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932815d540 con 0x7f9328070310 2023-05-17T11:46:10.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932cf8d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f93280cb0b0 0x7f93281601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36960/0 (socket says 172.21.15.3:36960) 2023-05-17T11:46:10.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f932cf8d640 1 -- 172.21.15.3:0/1693124603 learned_addr learned my addr 172.21.15.3:0/1693124603 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:10.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f93277fe640 1 --2- 172.21.15.3:0/1693124603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9328070310 0x7f93280cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277998731 0 0) 0x7f93200014a0 con 0x7f93280cb0b0 2023-05-17T11:46:10.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9310003530 con 0x7f93280cb0b0 2023-05-17T11:46:10.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130946997 0 0) 0x7f932815fd30 con 0x7f932815c0b0 2023-05-17T11:46:10.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93200014a0 con 0x7f932815c0b0 2023-05-17T11:46:10.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f93277fe640 1 -- 172.21.15.3:0/1693124603 >> v1:172.21.15.60:6789/0 conn(0x7f932815c0b0 legacy=0x7f932815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f93277fe640 1 -- 172.21.15.3:0/1693124603 >> v1:172.21.15.3:6789/0 conn(0x7f93280cb0b0 legacy=0x7f93281601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.398+0000 7f93277fe640 1 -- 172.21.15.3:0/1693124603 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932815cca0 con 0x7f9328070310 2023-05-17T11:46:10.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f93277fe640 1 --2- 172.21.15.3:0/1693124603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9328070310 0x7f93280cab70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f931c0097f0 tx=0x7f931c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc92b922d750da7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0ac600 con 0x7f9328070310 2023-05-17T11:46:10.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0a8050 con 0x7f9328070310 2023-05-17T11:46:10.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f9326ffd640 1 -- 172.21.15.3:0/1693124603 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0ac980 con 0x7f9328070310 2023-05-17T11:46:10.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 -- 172.21.15.3:0/1693124603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9328070310 msgr2=0x7f93280cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1693124603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9328070310 0x7f93280cab70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f931c0097f0 tx=0x7f931c01c490 comp rx=0 tx=0).stop 2023-05-17T11:46:10.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 -- 172.21.15.3:0/1693124603 shutdown_connections 2023-05-17T11:46:10.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1693124603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9328070310 0x7f93280cab70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 -- 172.21.15.3:0/1693124603 >> 172.21.15.3:0/1693124603 conn(0x7f93280d05b0 msgr2=0x7f93280d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:10.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 -- 172.21.15.3:0/1693124603 shutdown_connections 2023-05-17T11:46:10.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.402+0000 7f932e9f0640 1 -- 172.21.15.3:0/1693124603 wait complete. 2023-05-17T11:46:10.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 Processor -- start 2023-05-17T11:46:10.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- start start 2023-05-17T11:46:10.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 0x7f932814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93280cb0b0 0x7f9328146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f932815c0b0 0x7f9328143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932815b280 con 0x7f9328070310 2023-05-17T11:46:10.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932815b4d0 con 0x7f932815c0b0 2023-05-17T11:46:10.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280b4c00 con 0x7f93280cb0b0 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 0x7f932814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 0x7f932814a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41504/0 (socket says 172.21.15.3:41504) 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 -- 172.21.15.3:0/1835012275 learned_addr learned my addr 172.21.15.3:0/1835012275 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932cf8d640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f932815c0b0 0x7f9328143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f93277fe640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93280cb0b0 0x7f9328146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 -- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93280cb0b0 msgr2=0x7f9328146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93280cb0b0 0x7f9328146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 -- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f932815c0b0 msgr2=0x7f9328143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f932815c0b0 0x7f9328143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 -- 172.21.15.3:0/1835012275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c009420 con 0x7f9328070310 2023-05-17T11:46:10.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f93277fe640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93280cb0b0 0x7f9328146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:10.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9327fff640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 0x7f932814a870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f931800c430 tx=0x7f931800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180052d0 con 0x7f9328070310 2023-05-17T11:46:10.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318005450 con 0x7f9328070310 2023-05-17T11:46:10.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318003840 con 0x7f9328070310 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9328160a60 con 0x7f9328070310 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93281608d0 con 0x7f9328070310 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.406+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9328169eb0 con 0x7f9328070310 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.410+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93180039a0 con 0x7f9328070310 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.410+0000 7f9324ff9640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9314066280 0x7f9314068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.410+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9318083350 con 0x7f9328070310 2023-05-17T11:46:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.410+0000 7f93277fe640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9314066280 0x7f9314068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.410+0000 7f93277fe640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9314066280 0x7f9314068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f931c0ae000 tx=0x7f931c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.414+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f93180507e0 con 0x7f9328070310 2023-05-17T11:46:10.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.566+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93280b4a60 con 0x7f9328070310 2023-05-17T11:46:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.566+0000 7f9324ff9640 1 -- 172.21.15.3:0/1835012275 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93280b4a60 con 0x7f9328070310 2023-05-17T11:46:10.578 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:10.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9314066280 msgr2=0x7f9314068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9314066280 0x7f9314068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f931c0ae000 tx=0x7f931c0a7000 comp rx=0 tx=0).stop 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 msgr2=0x7f932814a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 0x7f932814a870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f931800c430 tx=0x7f931800c8f0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 shutdown_connections 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9314066280 0x7f9314068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f932815c0b0 0x7f9328143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93280cb0b0 0x7f9328146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 --2- 172.21.15.3:0/1835012275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9328070310 0x7f932814a870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 >> 172.21.15.3:0/1835012275 conn(0x7f93280d05b0 msgr2=0x7f93281504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 shutdown_connections 2023-05-17T11:46:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.570+0000 7f932e9f0640 1 -- 172.21.15.3:0/1835012275 wait complete. 2023-05-17T11:46:10.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:10.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 Processor -- start 2023-05-17T11:46:10.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 -- start start 2023-05-17T11:46:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380cdcb0 0x7f27380cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27380c1a10 0x7f27380cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380adb90 con 0x7f2738160590 2023-05-17T11:46:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380b05a0 con 0x7f27380c1a10 2023-05-17T11:46:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f273d411640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738160960 con 0x7f27380cdcb0 2023-05-17T11:46:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f2736ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2738160590 0x7f27380c1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36970/0 (socket says 172.21.15.3:36970) 2023-05-17T11:46:10.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f2736ffd640 1 -- 172.21.15.3:0/2781068819 learned_addr learned my addr 172.21.15.3:0/2781068819 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210933916 0 0) 0x7f27380adb90 con 0x7f2738160590 2023-05-17T11:46:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2724003530 con 0x7f2738160590 2023-05-17T11:46:10.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f272ffff640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380cdcb0 0x7f27380cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27377fe640 1 --2- 172.21.15.3:0/2781068819 >> v2:172.21.15.60:3300/0 conn(0x7f27380c1a10 0x7f27380cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2631182843 0 0) 0x7f2724003530 con 0x7f2738160590 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380cdcb0 msgr2=0x7f27380cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380cdcb0 0x7f27380cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 >> v2:172.21.15.60:3300/0 conn(0x7f27380c1a10 msgr2=0x7f27380cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 --2- 172.21.15.3:0/2781068819 >> v2:172.21.15.60:3300/0 conn(0x7f27380c1a10 0x7f27380cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380ad8b0 con 0x7f2738160590 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f2728001680 con 0x7f2738160590 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 >> v1:172.21.15.3:6789/0 conn(0x7f2738160590 legacy=0x7f27380c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2724003980 0x7f2724003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27240047d0 0x7f2724004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2724005180 0x7f272400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380b05a0 con 0x7f27240047d0 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2738160960 con 0x7f2724003980 2023-05-17T11:46:10.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272400bed0 con 0x7f2724005180 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f272ffff640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27240047d0 0x7f2724004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.730+0000 7f2736ffd640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2724003980 0x7f2724003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f27377fe640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2724005180 0x7f272400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f272ffff640 1 -- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2724005180 msgr2=0x7f272400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f272ffff640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2724005180 0x7f272400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f272ffff640 1 -- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2724003980 msgr2=0x7f2724003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f272ffff640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2724003980 0x7f2724003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f272ffff640 1 -- 172.21.15.3:0/2781068819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724003530 con 0x7f27240047d0 2023-05-17T11:46:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f272ffff640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27240047d0 0x7f2724004c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2720009ae0 tx=0x7f272001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d50ae6e229aeb1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200a55f0 con 0x7f27240047d0 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27200a5750 con 0x7f27240047d0 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f27367fc640 1 -- 172.21.15.3:0/2781068819 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200a5b00 con 0x7f27240047d0 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f273d411640 1 -- 172.21.15.3:0/2781068819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27240047d0 msgr2=0x7f2724004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f273d411640 1 --2- 172.21.15.3:0/2781068819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27240047d0 0x7f2724004c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2720009ae0 tx=0x7f272001c9c0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.734+0000 7f27377fe640 1 -- 172.21.15.3:0/2781068819 reap_dead start 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- 172.21.15.3:0/2781068819 shutdown_connections 2023-05-17T11:46:10.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- 172.21.15.3:0/2781068819 >> 172.21.15.3:0/2781068819 conn(0x7f273806a740 msgr2=0x7f27380cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- 172.21.15.3:0/2781068819 shutdown_connections 2023-05-17T11:46:10.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- 172.21.15.3:0/2781068819 wait complete. 2023-05-17T11:46:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 Processor -- start 2023-05-17T11:46:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- start start 2023-05-17T11:46:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27240047d0 0x7f2738158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 0x7f27380adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380ae0d0 0x7f27380ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c8a00 con 0x7f2738165e50 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381662c0 con 0x7f27240047d0 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f273d411640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c8ca0 con 0x7f27380ae0d0 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 0x7f27380adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 0x7f27380adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41532/0 (socket says 172.21.15.3:41532) 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 -- 172.21.15.3:0/1059619147 learned_addr learned my addr 172.21.15.3:0/1059619147 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f27377fe640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380ae0d0 0x7f27380ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f2736ffd640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27240047d0 0x7f2738158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 -- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380ae0d0 msgr2=0x7f27380ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380ae0d0 0x7f27380ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 -- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27240047d0 msgr2=0x7f2738158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27240047d0 0x7f2738158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 -- 172.21.15.3:0/1059619147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380ccb10 con 0x7f2738165e50 2023-05-17T11:46:10.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.738+0000 7f272ffff640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 0x7f27380adb90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2720009a00 tx=0x7f2724005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200a55f0 con 0x7f2738165e50 2023-05-17T11:46:10.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720004020 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200043b0 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27380cc980 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27380ccca0 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273804de80 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27200b4040 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f272f7fe640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2718066280 0x7f2718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f272011d380 con 0x7f2738165e50 2023-05-17T11:46:10.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f2736ffd640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2718066280 0x7f2718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:10.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.742+0000 7f2736ffd640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2718066280 0x7f2718068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2728001ec0 tx=0x7f2728007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.746+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f27200ea810 con 0x7f2738165e50 2023-05-17T11:46:10.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27380acf80 con 0x7f2738165e50 2023-05-17T11:46:10.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f272f7fe640 1 -- 172.21.15.3:0/1059619147 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27200ede30 con 0x7f2738165e50 2023-05-17T11:46:10.912 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:10.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2718066280 msgr2=0x7f2718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2718066280 0x7f2718068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2728001ec0 tx=0x7f2728007900 comp rx=0 tx=0).stop 2023-05-17T11:46:10.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 msgr2=0x7f27380adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:10.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 0x7f27380adb90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2720009a00 tx=0x7f2724005800 comp rx=0 tx=0).stop 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 shutdown_connections 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2718066280 0x7f2718068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f27380ae0d0 0x7f27380ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2738165e50 0x7f27380adb90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 --2- 172.21.15.3:0/1059619147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27240047d0 0x7f2738158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 >> 172.21.15.3:0/1059619147 conn(0x7f273806a740 msgr2=0x7f273815f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 shutdown_connections 2023-05-17T11:46:10.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:10.902+0000 7f273d411640 1 -- 172.21.15.3:0/1059619147 wait complete. 2023-05-17T11:46:10.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:11.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 Processor -- start 2023-05-17T11:46:11.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 -- start start 2023-05-17T11:46:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 0x7f41540ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f41540b1d70 0x7f4154070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41540c8a30 con 0x7f41540b1230 2023-05-17T11:46:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540adc70 con 0x7f41540b1d70 2023-05-17T11:46:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415c796640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540cbcf0 con 0x7f41540ad8a0 2023-05-17T11:46:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415ad33640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f41540b1d70 0x7f4154070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 0x7f41540ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 0x7f41540ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:37784/0 (socket says 172.21.15.3:37784) 2023-05-17T11:46:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 -- 172.21.15.3:0/171517392 learned_addr learned my addr 172.21.15.3:0/171517392 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 -- 172.21.15.3:0/171517392 >> v2:172.21.15.60:3300/0 conn(0x7f41540b1d70 msgr2=0x7f4154070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 --2- 172.21.15.3:0/171517392 >> v2:172.21.15.60:3300/0 conn(0x7f41540b1d70 0x7f4154070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 -- 172.21.15.3:0/171517392 >> v1:172.21.15.60:6789/0 conn(0x7f41540b1230 legacy=0x7f41540b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.062+0000 7f415a532640 1 -- 172.21.15.3:0/171517392 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540c8c80 con 0x7f41540ad8a0 2023-05-17T11:46:11.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415a532640 1 --2- 172.21.15.3:0/171517392 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 0x7f41540ca710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4150006fd0 tx=0x7f415001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6dd5b3601e049f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f4159530640 1 -- 172.21.15.3:0/171517392 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41500aa650 con 0x7f41540ad8a0 2023-05-17T11:46:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f4159530640 1 -- 172.21.15.3:0/171517392 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41500aa7b0 con 0x7f41540ad8a0 2023-05-17T11:46:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f4159530640 1 -- 172.21.15.3:0/171517392 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41500aab40 con 0x7f41540ad8a0 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 -- 172.21.15.3:0/171517392 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 msgr2=0x7f41540ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 --2- 172.21.15.3:0/171517392 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 0x7f41540ca710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4150006fd0 tx=0x7f415001c4f0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 -- 172.21.15.3:0/171517392 shutdown_connections 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 --2- 172.21.15.3:0/171517392 >> v2:172.21.15.60:3300/0 conn(0x7f41540b1d70 0x7f4154070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 --2- 172.21.15.3:0/171517392 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540ad8a0 0x7f41540ca710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 -- 172.21.15.3:0/171517392 >> 172.21.15.3:0/171517392 conn(0x7f41540b0b20 msgr2=0x7f41540cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 -- 172.21.15.3:0/171517392 shutdown_connections 2023-05-17T11:46:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 -- 172.21.15.3:0/171517392 wait complete. 2023-05-17T11:46:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.066+0000 7f415c796640 1 Processor -- start 2023-05-17T11:46:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- start start 2023-05-17T11:46:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 0x7f41541543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540b1230 0x7f41540c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41540b1d70 0x7f41540c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154154910 con 0x7f41540ad8a0 2023-05-17T11:46:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c6b10 con 0x7f41540b1d70 2023-05-17T11:46:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c74e0 con 0x7f41540b1230 2023-05-17T11:46:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 0x7f41541543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 0x7f41541543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41538/0 (socket says 172.21.15.3:41538) 2023-05-17T11:46:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 -- 172.21.15.3:0/1001125116 learned_addr learned my addr 172.21.15.3:0/1001125116 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 -- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540b1230 msgr2=0x7f41540c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f4159d31640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540b1230 0x7f41540c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415ad33640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41540b1d70 0x7f41540c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540b1230 0x7f41540c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 -- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41540b1d70 msgr2=0x7f41540c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41540b1d70 0x7f41540c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 -- 172.21.15.3:0/1001125116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4150009480 con 0x7f41540ad8a0 2023-05-17T11:46:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f4159d31640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540b1230 0x7f41540c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415a532640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 0x7f41541543d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f415001aba0 tx=0x7f4150019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41500aab20 con 0x7f41540ad8a0 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41500aac80 con 0x7f41540ad8a0 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4154070f70 con 0x7f41540ad8a0 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150003620 con 0x7f41540ad8a0 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41540c9240 con 0x7f41540ad8a0 2023-05-17T11:46:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.070+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4154071100 con 0x7f41540ad8a0 2023-05-17T11:46:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.074+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4150003780 con 0x7f41540ad8a0 2023-05-17T11:46:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.074+0000 7f414affd640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4138066280 0x7f4138068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.074+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f415011e8b0 con 0x7f41540ad8a0 2023-05-17T11:46:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.074+0000 7f4159d31640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4138066280 0x7f4138068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.074+0000 7f4159d31640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4138066280 0x7f4138068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41540aca10 tx=0x7f4144009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.078+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f41500ebee0 con 0x7f41540ad8a0 2023-05-17T11:46:11.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.242+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4154071f20 con 0x7f41540ad8a0 2023-05-17T11:46:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.242+0000 7f414affd640 1 -- 172.21.15.3:0/1001125116 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41500ef500 con 0x7f41540ad8a0 2023-05-17T11:46:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4138066280 msgr2=0x7f4138068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4138066280 0x7f4138068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41540aca10 tx=0x7f4144009040 comp rx=0 tx=0).stop 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 msgr2=0x7f41541543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 0x7f41541543d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f415001aba0 tx=0x7f4150019290 comp rx=0 tx=0).stop 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 shutdown_connections 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4138066280 0x7f4138068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41540b1d70 0x7f41540c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f41540b1230 0x7f41540c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 --2- 172.21.15.3:0/1001125116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41540ad8a0 0x7f41541543d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 >> 172.21.15.3:0/1001125116 conn(0x7f41540b0b20 msgr2=0x7f41540ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:11.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 shutdown_connections 2023-05-17T11:46:11.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.246+0000 7f415c796640 1 -- 172.21.15.3:0/1001125116 wait complete. 2023-05-17T11:46:11.273 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:46:11.273 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:11.281 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:11.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 Processor -- start 2023-05-17T11:46:11.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 -- start start 2023-05-17T11:46:11.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb406a1c0 0x7fcdb406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcdb40c8a00 0x7fcdb40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb415fd00 con 0x7fcdb415c270 2023-05-17T11:46:11.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb40c91a0 con 0x7fcdb40c8a00 2023-05-17T11:46:11.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.446+0000 7fcdbb8f2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb415c640 con 0x7fcdb406a1c0 2023-05-17T11:46:11.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcdb40c8a00 0x7fcdb40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcdb40c8a00 0x7fcdb40cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:37194/0 (socket says 172.21.15.3:37194) 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 -- 172.21.15.3:0/172072523 learned_addr learned my addr 172.21.15.3:0/172072523 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb8e8d640 1 --2- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb406a1c0 0x7fcdb406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 -- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb406a1c0 msgr2=0x7fcdb406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 --2- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb406a1c0 0x7fcdb406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 -- 172.21.15.3:0/172072523 >> v1:172.21.15.60:6789/0 conn(0x7fcdb415c270 legacy=0x7fcdb4069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.450+0000 7fcdb9e8f640 1 -- 172.21.15.3:0/172072523 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40c8ec0 con 0x7fcdb40c8a00 2023-05-17T11:46:11.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdb9e8f640 1 --2- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb40cd1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009e50 tx=0x7fcdac01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d613d7f889440369 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdabfff640 1 -- 172.21.15.3:0/172072523 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0a64e0 con 0x7fcdb40c8a00 2023-05-17T11:46:11.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdabfff640 1 -- 172.21.15.3:0/172072523 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac0a6640 con 0x7fcdb40c8a00 2023-05-17T11:46:11.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdabfff640 1 -- 172.21.15.3:0/172072523 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0a69d0 con 0x7fcdb40c8a00 2023-05-17T11:46:11.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 msgr2=0x7fcdb40cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb40cd1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009e50 tx=0x7fcdac01c9e0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/172072523 shutdown_connections 2023-05-17T11:46:11.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb40cd1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/172072523 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb406a1c0 0x7fcdb406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/172072523 >> 172.21.15.3:0/172072523 conn(0x7fcdb40b0b30 msgr2=0x7fcdb40cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:11.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/172072523 shutdown_connections 2023-05-17T11:46:11.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/172072523 wait complete. 2023-05-17T11:46:11.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 Processor -- start 2023-05-17T11:46:11.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- start start 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 0x7fcdb40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb415c270 0x7fcdb4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40b1eb0 con 0x7fcdb406a1c0 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4155fe0 con 0x7fcdb40c8a00 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdbb8f2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40c5a60 con 0x7fcdb415c270 2023-05-17T11:46:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdb968e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 0x7fcdb40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.454+0000 7fcdb968e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 0x7fcdb40c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41554/0 (socket says 172.21.15.3:41554) 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 -- 172.21.15.3:0/1296763931 learned_addr learned my addr 172.21.15.3:0/1296763931 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb8e8d640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb9e8f640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb415c270 0x7fcdb4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 -- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb415c270 msgr2=0x7fcdb4071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb415c270 0x7fcdb4071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 -- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 msgr2=0x7fcdb4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 -- 172.21.15.3:0/1296763931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac009b30 con 0x7fcdb406a1c0 2023-05-17T11:46:11.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdb968e640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 0x7fcdb40c5480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000c3c0 tx=0x7fcdb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00052d0 con 0x7fcdb406a1c0 2023-05-17T11:46:11.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0005430 con 0x7fcdb406a1c0 2023-05-17T11:46:11.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0003840 con 0x7fcdb406a1c0 2023-05-17T11:46:11.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb40ca850 con 0x7fcdb406a1c0 2023-05-17T11:46:11.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb4160510 con 0x7fcdb406a1c0 2023-05-17T11:46:11.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb4160a30 con 0x7fcdb406a1c0 2023-05-17T11:46:11.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.458+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdb00039a0 con 0x7fcdb406a1c0 2023-05-17T11:46:11.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.462+0000 7fcda9ffb640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcd98066280 0x7fcd98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.462+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcdb00831d0 con 0x7fcdb406a1c0 2023-05-17T11:46:11.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.462+0000 7fcdb8e8d640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcd98066280 0x7fcd98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.462+0000 7fcdb8e8d640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcd98066280 0x7fcd98068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40c6c30 tx=0x7fcda4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.462+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcdb00506f0 con 0x7fcdb406a1c0 2023-05-17T11:46:11.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.618+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdb404de80 con 0x7fcdb406a1c0 2023-05-17T11:46:11.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcda9ffb640 1 -- 172.21.15.3:0/1296763931 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7fcdb0053d10 con 0x7fcdb406a1c0 2023-05-17T11:46:11.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:11.631 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:11.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcd98066280 msgr2=0x7fcd98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcd98066280 0x7fcd98068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40c6c30 tx=0x7fcda4009190 comp rx=0 tx=0).stop 2023-05-17T11:46:11.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 msgr2=0x7fcdb40c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 0x7fcdb40c5480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000c3c0 tx=0x7fcdb000c880 comp rx=0 tx=0).stop 2023-05-17T11:46:11.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 shutdown_connections 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcd98066280 0x7fcd98068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcdb415c270 0x7fcdb4071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb40c8a00 0x7fcdb4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 --2- 172.21.15.3:0/1296763931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb406a1c0 0x7fcdb40c5480 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 >> 172.21.15.3:0/1296763931 conn(0x7fcdb40b0b30 msgr2=0x7fcdb40ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 shutdown_connections 2023-05-17T11:46:11.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.622+0000 7fcdbb8f2640 1 -- 172.21.15.3:0/1296763931 wait complete. 2023-05-17T11:46:11.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:11.653 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.782+0000 7fc63cda2640 1 Processor -- start 2023-05-17T11:46:11.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.782+0000 7fc63cda2640 1 -- start start 2023-05-17T11:46:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc63cda2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc6380d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc63cda2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc6380ceac0 0x7fc6380d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc63cda2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63806abb0 con 0x7fc6380b1dc0 2023-05-17T11:46:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc63cda2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cdbd0 con 0x7fc6380ceac0 2023-05-17T11:46:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc63cda2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380cdeb0 con 0x7fc6380b19f0 2023-05-17T11:46:11.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc6380ceac0 0x7fc6380d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc6380ceac0 0x7fc6380d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41558/0 (socket says 172.21.15.3:41558) 2023-05-17T11:46:11.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 -- 172.21.15.3:0/1608688746 learned_addr learned my addr 172.21.15.3:0/1608688746 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc6377fe640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc6380d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 -- 172.21.15.3:0/1608688746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 msgr2=0x7fc6380d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc6380d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 -- 172.21.15.3:0/1608688746 >> v1:172.21.15.60:6789/0 conn(0x7fc6380b1dc0 legacy=0x7fc6380cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 -- 172.21.15.3:0/1608688746 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380ce190 con 0x7fc6380ceac0 2023-05-17T11:46:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc6377fe640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc6380d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.786+0000 7fc636ffd640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380ceac0 0x7fc6380d08e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2286434f2f41888c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc6367fc640 1 -- 172.21.15.3:0/1608688746 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0ab600 con 0x7fc6380ceac0 2023-05-17T11:46:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc6367fc640 1 -- 172.21.15.3:0/1608688746 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0a7050 con 0x7fc6380ceac0 2023-05-17T11:46:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc6367fc640 1 -- 172.21.15.3:0/1608688746 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0ab980 con 0x7fc6380ceac0 2023-05-17T11:46:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- 172.21.15.3:0/1608688746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380ceac0 msgr2=0x7fc6380d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380ceac0 0x7fc6380d08e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c01c3f0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- 172.21.15.3:0/1608688746 shutdown_connections 2023-05-17T11:46:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380ceac0 0x7fc6380d08e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 --2- 172.21.15.3:0/1608688746 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc6380d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- 172.21.15.3:0/1608688746 >> 172.21.15.3:0/1608688746 conn(0x7fc63809bb20 msgr2=0x7fc6380d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- 172.21.15.3:0/1608688746 shutdown_connections 2023-05-17T11:46:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- 172.21.15.3:0/1608688746 wait complete. 2023-05-17T11:46:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 Processor -- start 2023-05-17T11:46:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- start start 2023-05-17T11:46:11.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc638154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 0x7fc6380b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6380ceac0 0x7fc638154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380b39c0 con 0x7fc6380b1dc0 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638155ae0 con 0x7fc6380ceac0 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc63cda2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc638154ed0 con 0x7fc6380b19f0 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.790+0000 7fc636ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 0x7fc6380b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 0x7fc6380b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41560/0 (socket says 172.21.15.3:41560) 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 -- 172.21.15.3:0/2026401466 learned_addr learned my addr 172.21.15.3:0/2026401466 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc6377fe640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc638154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc637fff640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6380ceac0 0x7fc638154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 -- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 msgr2=0x7fc638154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc638154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 -- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6380ceac0 msgr2=0x7fc638154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6380ceac0 0x7fc638154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 -- 172.21.15.3:0/2026401466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0094d0 con 0x7fc6380b1dc0 2023-05-17T11:46:11.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc6377fe640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc638154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:11.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc636ffd640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 0x7fc6380b3480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01aaa0 tx=0x7fc62c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b4420 con 0x7fc6380b1dc0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0b4580 con 0x7fc6380b1dc0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b4930 con 0x7fc6380b1dc0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6381693c0 con 0x7fc6380b1dc0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc638169230 con 0x7fc6380b1dc0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc638169550 con 0x7fc6380b1dc0 2023-05-17T11:46:11.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.794+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc62c0b2070 con 0x7fc6380b1dc0 2023-05-17T11:46:11.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.798+0000 7fc61ffff640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc624066280 0x7fc624068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:11.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.798+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc62c11d8f0 con 0x7fc6380b1dc0 2023-05-17T11:46:11.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.798+0000 7fc6377fe640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc624066280 0x7fc624068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:11.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.798+0000 7fc6377fe640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc624066280 0x7fc624068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6381573b0 tx=0x7fc628008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:11.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.802+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc62c0ead70 con 0x7fc6380b1dc0 2023-05-17T11:46:11.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.954+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6380616e0 con 0x7fc6380b1dc0 2023-05-17T11:46:11.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.954+0000 7fc61ffff640 1 -- 172.21.15.3:0/2026401466 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc62c0ee390 con 0x7fc6380b1dc0 2023-05-17T11:46:11.966 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc624066280 msgr2=0x7fc624068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc624066280 0x7fc624068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6381573b0 tx=0x7fc628008040 comp rx=0 tx=0).stop 2023-05-17T11:46:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 msgr2=0x7fc6380b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 0x7fc6380b3480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01aaa0 tx=0x7fc62c019190 comp rx=0 tx=0).stop 2023-05-17T11:46:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 shutdown_connections 2023-05-17T11:46:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc624066280 0x7fc624068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6380ceac0 0x7fc638154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6380b1dc0 0x7fc6380b3480 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 --2- 172.21.15.3:0/2026401466 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc6380b19f0 0x7fc638154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 >> 172.21.15.3:0/2026401466 conn(0x7fc63809bb20 msgr2=0x7fc6380b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 shutdown_connections 2023-05-17T11:46:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:11.958+0000 7fc63cda2640 1 -- 172.21.15.3:0/2026401466 wait complete. 2023-05-17T11:46:11.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:12.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.114+0000 7f93ffdf3640 1 Processor -- start 2023-05-17T11:46:12.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.114+0000 7f93ffdf3640 1 -- start start 2023-05-17T11:46:12.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93ffdf3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f93f8156460 0x7f93f815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93ffdf3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f815cb00 con 0x7f93f806cef0 2023-05-17T11:46:12.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93ffdf3640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f815cde0 con 0x7f93f806e7d0 2023-05-17T11:46:12.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93ffdf3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f815d0c0 con 0x7f93f8156460 2023-05-17T11:46:12.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fdb8f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f93f8156460 0x7f93f815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fdb8f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f93f8156460 0x7f93f815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41566/0 (socket says 172.21.15.3:41566) 2023-05-17T11:46:12.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1963377341 learned_addr learned my addr 172.21.15.3:0/1963377341 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:12.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fe390640 1 --1- 172.21.15.3:0/1963377341 >> v1:172.21.15.3:6789/0 conn(0x7f93f806cef0 0x7f93f80ac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36974/0 (socket says 172.21.15.3:36974) 2023-05-17T11:46:12.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1963377341 >> v1:172.21.15.60:6789/0 conn(0x7f93f806e7d0 legacy=0x7f93f806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:12.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1963377341 >> v1:172.21.15.3:6789/0 conn(0x7f93f806cef0 legacy=0x7f93f80ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.118+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1963377341 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f815d3a0 con 0x7f93f8156460 2023-05-17T11:46:12.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93fdb8f640 1 --2- 172.21.15.3:0/1963377341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f8156460 0x7f93f815c4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93f40098a0 tx=0x7f93f401cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d0d1099557b301 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93fcb8d640 1 -- 172.21.15.3:0/1963377341 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40aa660 con 0x7f93f8156460 2023-05-17T11:46:12.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93fcb8d640 1 -- 172.21.15.3:0/1963377341 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f40aa7c0 con 0x7f93f8156460 2023-05-17T11:46:12.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93fcb8d640 1 -- 172.21.15.3:0/1963377341 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40aab50 con 0x7f93f8156460 2023-05-17T11:46:12.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1963377341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f8156460 msgr2=0x7f93f815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1963377341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f8156460 0x7f93f815c4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93f40098a0 tx=0x7f93f401cf40 comp rx=0 tx=0).stop 2023-05-17T11:46:12.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1963377341 shutdown_connections 2023-05-17T11:46:12.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1963377341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f8156460 0x7f93f815c4b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1963377341 >> 172.21.15.3:0/1963377341 conn(0x7f93f80b14a0 msgr2=0x7f93f80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:12.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1963377341 shutdown_connections 2023-05-17T11:46:12.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1963377341 wait complete. 2023-05-17T11:46:12.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 Processor -- start 2023-05-17T11:46:12.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.122+0000 7f93ffdf3640 1 -- start start 2023-05-17T11:46:12.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 0x7f93f81478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93f806e7d0 0x7f93f815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f8156460 0x7f93f80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815fc20 con 0x7f93f806cef0 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815efa0 con 0x7f93f8156460 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815f280 con 0x7f93f806e7d0 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 0x7f93f81478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 0x7f93f81478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41568/0 (socket says 172.21.15.3:41568) 2023-05-17T11:46:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1628346895 learned_addr learned my addr 172.21.15.3:0/1628346895 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93f806e7d0 msgr2=0x7f93f815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93f806e7d0 0x7f93f815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f8156460 msgr2=0x7f93f80afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fe390640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f8156460 0x7f93f80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f8156460 0x7f93f80afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 -- 172.21.15.3:0/1628346895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40094d0 con 0x7f93f806cef0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fe390640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f8156460 0x7f93f80afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93fdb8f640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 0x7f93f81478c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ac040 tx=0x7f93f401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40b38c0 con 0x7f93f806cef0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f40b3a20 con 0x7f93f806cef0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40b3dd0 con 0x7f93f806cef0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f81569c0 con 0x7f93f806cef0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f8156830 con 0x7f93f806cef0 2023-05-17T11:46:12.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f80ae440 con 0x7f93f806cef0 2023-05-17T11:46:12.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.126+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93f40b2380 con 0x7f93f806cef0 2023-05-17T11:46:12.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.130+0000 7f93ee7fc640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f93dc066280 0x7f93dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.130+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93f40a6040 con 0x7f93f806cef0 2023-05-17T11:46:12.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.130+0000 7f93fd38e640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f93dc066280 0x7f93dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.130+0000 7f93fd38e640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f93dc066280 0x7f93dc068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93f8155410 tx=0x7f93e80079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.134+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f93f40ebc90 con 0x7f93f806cef0 2023-05-17T11:46:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93f804de80 con 0x7f93f806cef0 2023-05-17T11:46:12.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ee7fc640 1 -- 172.21.15.3:0/1628346895 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93f40ef2b0 con 0x7f93f806cef0 2023-05-17T11:46:12.296 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:12.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f93dc066280 msgr2=0x7f93dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f93dc066280 0x7f93dc068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93f8155410 tx=0x7f93e80079c0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 msgr2=0x7f93f81478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 0x7f93f81478c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ac040 tx=0x7f93f401ad20 comp rx=0 tx=0).stop 2023-05-17T11:46:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 shutdown_connections 2023-05-17T11:46:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f93dc066280 0x7f93dc068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f8156460 0x7f93f80afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f93f806e7d0 0x7f93f815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 --2- 172.21.15.3:0/1628346895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93f806cef0 0x7f93f81478c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 >> 172.21.15.3:0/1628346895 conn(0x7f93f80b14a0 msgr2=0x7f93f8151520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 shutdown_connections 2023-05-17T11:46:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.286+0000 7f93ffdf3640 1 -- 172.21.15.3:0/1628346895 wait complete. 2023-05-17T11:46:12.316 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 Processor -- start 2023-05-17T11:46:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 -- start start 2023-05-17T11:46:12.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcee80ad440 0x7fcee80afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80cb4c0 0x7fcee80b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee809bcb0 con 0x7fcee815d3d0 2023-05-17T11:46:12.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee80cdf90 con 0x7fcee80ad440 2023-05-17T11:46:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fceeda8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80ca130 con 0x7fcee80cb4c0 2023-05-17T11:46:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcee80ad440 0x7fcee80afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcee80ad440 0x7fcee80afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41576/0 (socket says 172.21.15.3:41576) 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 -- 172.21.15.3:0/1056073753 learned_addr learned my addr 172.21.15.3:0/1056073753 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee77fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcee815d3d0 0x7fcee80ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36988/0 (socket says 172.21.15.3:36988) 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee7fff640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80cb4c0 0x7fcee80b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 -- 172.21.15.3:0/1056073753 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80cb4c0 msgr2=0x7fcee80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80cb4c0 0x7fcee80b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 -- 172.21.15.3:0/1056073753 >> v1:172.21.15.3:6789/0 conn(0x7fcee815d3d0 legacy=0x7fcee80ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee6ffd640 1 -- 172.21.15.3:0/1056073753 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee80cd490 con 0x7fcee80ad440 2023-05-17T11:46:12.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.446+0000 7fcee7fff640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80cb4c0 0x7fcee80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:12.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fcee6ffd640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80ad440 0x7fcee80afdb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009870 tx=0x7fcedc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e311b245b43cdc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fcee67fc640 1 -- 172.21.15.3:0/1056073753 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0ac640 con 0x7fcee80ad440 2023-05-17T11:46:12.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fcee67fc640 1 -- 172.21.15.3:0/1056073753 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc0ac7a0 con 0x7fcee80ad440 2023-05-17T11:46:12.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fcee67fc640 1 -- 172.21.15.3:0/1056073753 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0acb30 con 0x7fcee80ad440 2023-05-17T11:46:12.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 -- 172.21.15.3:0/1056073753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80ad440 msgr2=0x7fcee80afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80ad440 0x7fcee80afdb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009870 tx=0x7fcedc01c420 comp rx=0 tx=0).stop 2023-05-17T11:46:12.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 -- 172.21.15.3:0/1056073753 shutdown_connections 2023-05-17T11:46:12.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80cb4c0 0x7fcee80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 --2- 172.21.15.3:0/1056073753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80ad440 0x7fcee80afdb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 -- 172.21.15.3:0/1056073753 >> 172.21.15.3:0/1056073753 conn(0x7fcee806a740 msgr2=0x7fcee80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 -- 172.21.15.3:0/1056073753 shutdown_connections 2023-05-17T11:46:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.450+0000 7fceeda8c640 1 -- 172.21.15.3:0/1056073753 wait complete. 2023-05-17T11:46:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 Processor -- start 2023-05-17T11:46:12.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 -- start start 2023-05-17T11:46:12.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80ad440 0x7fcee815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 0x7fcee8158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee815d3d0 0x7fcee80ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80ab6b0 con 0x7fcee80cb4c0 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8158da0 con 0x7fcee815d3d0 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80ab890 con 0x7fcee80ad440 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 0x7fcee8158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 0x7fcee8158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41582/0 (socket says 172.21.15.3:41582) 2023-05-17T11:46:12.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 -- 172.21.15.3:0/3916531475 learned_addr learned my addr 172.21.15.3:0/3916531475 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:12.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee77fe640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80ad440 0x7fcee815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee7fff640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee815d3d0 0x7fcee80ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 -- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80ad440 msgr2=0x7fcee815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80ad440 0x7fcee815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 -- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee815d3d0 msgr2=0x7fcee80ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee815d3d0 0x7fcee80ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 -- 172.21.15.3:0/3916531475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0094d0 con 0x7fcee80cb4c0 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcee6ffd640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 0x7fcee8158860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0af040 tx=0x7fcedc0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0b5850 con 0x7fcee80cb4c0 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc0b59b0 con 0x7fcee80cb4c0 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0b5d40 con 0x7fcee80cb4c0 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee815d7a0 con 0x7fcee80cb4c0 2023-05-17T11:46:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.454+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee80ca6b0 con 0x7fcee80cb4c0 2023-05-17T11:46:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.458+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee8166b30 con 0x7fcee80cb4c0 2023-05-17T11:46:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.458+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcedc0b3070 con 0x7fcee80cb4c0 2023-05-17T11:46:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.458+0000 7fcecffff640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fced4066280 0x7fced4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.458+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcedc11de60 con 0x7fcee80cb4c0 2023-05-17T11:46:12.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.458+0000 7fcee77fe640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fced4066280 0x7fced4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.458+0000 7fcee77fe640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fced4066280 0x7fced4068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fced8000f70 tx=0x7fced8007c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.462+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcedc0eb370 con 0x7fcee80cb4c0 2023-05-17T11:46:12.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.614+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcee804de80 con 0x7fcee80cb4c0 2023-05-17T11:46:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.614+0000 7fcecffff640 1 -- 172.21.15.3:0/3916531475 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcedc0b1020 con 0x7fcee80cb4c0 2023-05-17T11:46:12.626 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:12.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fced4066280 msgr2=0x7fced4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fced4066280 0x7fced4068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fced8000f70 tx=0x7fced8007c90 comp rx=0 tx=0).stop 2023-05-17T11:46:12.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 msgr2=0x7fcee8158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 0x7fcee8158860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0af040 tx=0x7fcedc0191c0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 shutdown_connections 2023-05-17T11:46:12.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fced4066280 0x7fced4068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee815d3d0 0x7fcee80ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcee80cb4c0 0x7fcee8158860 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 --2- 172.21.15.3:0/3916531475 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcee80ad440 0x7fcee815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 >> 172.21.15.3:0/3916531475 conn(0x7fcee806a740 msgr2=0x7fcee806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:12.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 shutdown_connections 2023-05-17T11:46:12.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.618+0000 7fceeda8c640 1 -- 172.21.15.3:0/3916531475 wait complete. 2023-05-17T11:46:12.646 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:12.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.778+0000 7f5d3d3a2640 1 Processor -- start 2023-05-17T11:46:12.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.778+0000 7f5d3d3a2640 1 -- start start 2023-05-17T11:46:12.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d3d3a2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5d380b19f0 0x7f5d380d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d3d3a2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d3d3a2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3806abb0 con 0x7f5d380b1dc0 2023-05-17T11:46:12.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d3d3a2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380cdbd0 con 0x7f5d380b19f0 2023-05-17T11:46:12.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d3d3a2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380cdeb0 con 0x7f5d380ceac0 2023-05-17T11:46:12.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5d380b19f0 0x7f5d380d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5d380b19f0 0x7f5d380d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41598/0 (socket says 172.21.15.3:41598) 2023-05-17T11:46:12.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 -- 172.21.15.3:0/1648052513 learned_addr learned my addr 172.21.15.3:0/1648052513 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:12.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 -- 172.21.15.3:0/1648052513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 msgr2=0x7f5d380d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:12.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 --2- 172.21.15.3:0/1648052513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 -- 172.21.15.3:0/1648052513 >> v1:172.21.15.60:6789/0 conn(0x7f5d380b1dc0 legacy=0x7f5d380cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:12.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 -- 172.21.15.3:0/1648052513 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380ce190 con 0x7f5d380b19f0 2023-05-17T11:46:12.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.782+0000 7f5d37fff640 1 --2- 172.21.15.3:0/1648052513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380d03a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009870 tx=0x7f5d2801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db165503c208f6a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d36ffd640 1 -- 172.21.15.3:0/1648052513 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280ab600 con 0x7f5d380b19f0 2023-05-17T11:46:12.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d36ffd640 1 -- 172.21.15.3:0/1648052513 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d280a7050 con 0x7f5d380b19f0 2023-05-17T11:46:12.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d36ffd640 1 -- 172.21.15.3:0/1648052513 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280ab980 con 0x7f5d380b19f0 2023-05-17T11:46:12.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1648052513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 msgr2=0x7f5d380d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1648052513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380d03a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009870 tx=0x7f5d2801c3b0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1648052513 shutdown_connections 2023-05-17T11:46:12.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1648052513 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1648052513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380d03a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1648052513 >> 172.21.15.3:0/1648052513 conn(0x7f5d3809bb20 msgr2=0x7f5d380d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:12.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1648052513 shutdown_connections 2023-05-17T11:46:12.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1648052513 wait complete. 2023-05-17T11:46:12.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 Processor -- start 2023-05-17T11:46:12.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- start start 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380b1dc0 0x7f5d38154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c6fa0 con 0x7f5d380b19f0 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380b3eb0 con 0x7f5d380b1dc0 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.786+0000 7f5d3d3a2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c9de0 con 0x7f5d380ceac0 2023-05-17T11:46:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41612/0 (socket says 172.21.15.3:41612) 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 -- 172.21.15.3:0/1172670498 learned_addr learned my addr 172.21.15.3:0/1172670498 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d3cba1640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d377fe640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380b1dc0 0x7f5d38154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 -- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 msgr2=0x7f5d380b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 -- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380b1dc0 msgr2=0x7f5d38154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380b1dc0 0x7f5d38154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 -- 172.21.15.3:0/1172670498 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280094d0 con 0x7f5d380b19f0 2023-05-17T11:46:12.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d37fff640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380c98a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5d2801aa60 tx=0x7f5d28019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280b3890 con 0x7f5d380b19f0 2023-05-17T11:46:12.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d280b39f0 con 0x7f5d380b19f0 2023-05-17T11:46:12.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280b3d80 con 0x7f5d380b19f0 2023-05-17T11:46:12.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d381693c0 con 0x7f5d380b19f0 2023-05-17T11:46:12.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38169230 con 0x7f5d380b19f0 2023-05-17T11:46:12.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38169550 con 0x7f5d380b19f0 2023-05-17T11:46:12.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.790+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d280b2070 con 0x7f5d380b19f0 2023-05-17T11:46:12.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.794+0000 7f5d34ff9640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5d24066280 0x7f5d24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:12.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.794+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d2811e1d0 con 0x7f5d380b19f0 2023-05-17T11:46:12.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.794+0000 7f5d377fe640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5d24066280 0x7f5d24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:12.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.794+0000 7f5d377fe640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5d24066280 0x7f5d24068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c006fd0 tx=0x7f5d2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:12.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.798+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5d280eb5b0 con 0x7f5d380b19f0 2023-05-17T11:46:12.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d380616e0 con 0x7f5d380b19f0 2023-05-17T11:46:12.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d34ff9640 1 -- 172.21.15.3:0/1172670498 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d280eebd0 con 0x7f5d380b19f0 2023-05-17T11:46:12.961 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5d24066280 msgr2=0x7f5d24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5d24066280 0x7f5d24068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c006fd0 tx=0x7f5d2c008040 comp rx=0 tx=0).stop 2023-05-17T11:46:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 msgr2=0x7f5d380c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380c98a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5d2801aa60 tx=0x7f5d28019150 comp rx=0 tx=0).stop 2023-05-17T11:46:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 shutdown_connections 2023-05-17T11:46:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5d24066280 0x7f5d24068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5d380ceac0 0x7f5d380b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380b1dc0 0x7f5d38154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 --2- 172.21.15.3:0/1172670498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d380b19f0 0x7f5d380c98a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 >> 172.21.15.3:0/1172670498 conn(0x7f5d3809bb20 msgr2=0x7f5d3815bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 shutdown_connections 2023-05-17T11:46:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:12.950+0000 7f5d3d3a2640 1 -- 172.21.15.3:0/1172670498 wait complete. 2023-05-17T11:46:12.981 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:13.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 Processor -- start 2023-05-17T11:46:13.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 -- start start 2023-05-17T11:46:13.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80d0ae0 0x7f84f80d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f84f80b2710 0x7f84f80b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80b3440 con 0x7f84f80b1e00 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f80d27f0 con 0x7f84f80b2710 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84fca41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80d2ad0 con 0x7f84f80d0ae0 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f84f80b2710 0x7f84f80b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f84f80b2710 0x7f84f80b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41618/0 (socket says 172.21.15.3:41618) 2023-05-17T11:46:13.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3129289532 learned_addr learned my addr 172.21.15.3:0/3129289532 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:13.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84effff640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80d0ae0 0x7f84f80d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3129289532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80d0ae0 msgr2=0x7f84f80d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:13.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80d0ae0 0x7f84f80d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3129289532 >> v1:172.21.15.60:6789/0 conn(0x7f84f80b1e00 legacy=0x7f84f80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3129289532 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80d2db0 con 0x7f84f80b2710 2023-05-17T11:46:13.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.110+0000 7f84effff640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80d0ae0 0x7f84f80d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84f6d9d640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80b2710 0x7f84f80b2b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009e50 tx=0x7f84f001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5246e84f1160eed4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84f5d9b640 1 -- 172.21.15.3:0/3129289532 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00a56c0 con 0x7f84f80b2710 2023-05-17T11:46:13.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84f5d9b640 1 -- 172.21.15.3:0/3129289532 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f00a5820 con 0x7f84f80b2710 2023-05-17T11:46:13.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84f5d9b640 1 -- 172.21.15.3:0/3129289532 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00a5bb0 con 0x7f84f80b2710 2023-05-17T11:46:13.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 -- 172.21.15.3:0/3129289532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80b2710 msgr2=0x7f84f80b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80b2710 0x7f84f80b2b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009e50 tx=0x7f84f001c8f0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 -- 172.21.15.3:0/3129289532 shutdown_connections 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80b2710 0x7f84f80b2b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 --2- 172.21.15.3:0/3129289532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80d0ae0 0x7f84f80d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 -- 172.21.15.3:0/3129289532 >> 172.21.15.3:0/3129289532 conn(0x7f84f8071b00 msgr2=0x7f84f809bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 -- 172.21.15.3:0/3129289532 shutdown_connections 2023-05-17T11:46:13.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.114+0000 7f84fca41640 1 -- 172.21.15.3:0/3129289532 wait complete. 2023-05-17T11:46:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 Processor -- start 2023-05-17T11:46:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- start start 2023-05-17T11:46:13.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f80b1e00 0x7f84f8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80b2710 0x7f84f815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 0x7f84f815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80caa20 con 0x7f84f80d0ae0 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f815b640 con 0x7f84f80b1e00 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80ca410 con 0x7f84f80b2710 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 0x7f84f815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 0x7f84f815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41634/0 (socket says 172.21.15.3:41634) 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3868882438 learned_addr learned my addr 172.21.15.3:0/3868882438 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:13.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f659c640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f80b1e00 0x7f84f8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84effff640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80b2710 0x7f84f815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80b2710 msgr2=0x7f84f815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80b2710 0x7f84f815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f80b1e00 msgr2=0x7f84f8154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f80b1e00 0x7f84f8154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 -- 172.21.15.3:0/3868882438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0009b30 con 0x7f84f80d0ae0 2023-05-17T11:46:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84f6d9d640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 0x7f84f815ce30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84f001a520 tx=0x7f84f0019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00b8670 con 0x7f84f80d0ae0 2023-05-17T11:46:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f00b87f0 con 0x7f84f80d0ae0 2023-05-17T11:46:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00b8ba0 con 0x7f84f80d0ae0 2023-05-17T11:46:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f80cd7f0 con 0x7f84f80d0ae0 2023-05-17T11:46:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f80cd660 con 0x7f84f80d0ae0 2023-05-17T11:46:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.118+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f80cd980 con 0x7f84f80d0ae0 2023-05-17T11:46:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.122+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84f00b8d00 con 0x7f84f80d0ae0 2023-05-17T11:46:13.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.122+0000 7f84eeffd640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d8066280 0x7f84d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.122+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84f011ef50 con 0x7f84f80d0ae0 2023-05-17T11:46:13.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.122+0000 7f84f659c640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d8066280 0x7f84d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.122+0000 7f84f659c640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d8066280 0x7f84d8068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84f815f500 tx=0x7f84e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.126+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f84f00ec5d0 con 0x7f84f80d0ae0 2023-05-17T11:46:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.290+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84f804de80 con 0x7f84f80d0ae0 2023-05-17T11:46:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.290+0000 7f84eeffd640 1 -- 172.21.15.3:0/3868882438 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f84f00efbf0 con 0x7f84f80d0ae0 2023-05-17T11:46:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d8066280 msgr2=0x7f84d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d8066280 0x7f84d8068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84f815f500 tx=0x7f84e8009040 comp rx=0 tx=0).stop 2023-05-17T11:46:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 msgr2=0x7f84f815ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 0x7f84f815ce30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84f001a520 tx=0x7f84f0019690 comp rx=0 tx=0).stop 2023-05-17T11:46:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 shutdown_connections 2023-05-17T11:46:13.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84d8066280 0x7f84d8068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f80d0ae0 0x7f84f815ce30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84f80b2710 0x7f84f815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 --2- 172.21.15.3:0/3868882438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f80b1e00 0x7f84f8154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 >> 172.21.15.3:0/3868882438 conn(0x7f84f8071b00 msgr2=0x7f84f806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 shutdown_connections 2023-05-17T11:46:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.294+0000 7f84fca41640 1 -- 172.21.15.3:0/3868882438 wait complete. 2023-05-17T11:46:13.322 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-05-17T11:46:13.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:13.323 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:13.348 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:13.348 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:46:13.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:13.349 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T11:46:13.406 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:46:13.407 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:13.416 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:46:13.416 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:13.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:13.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce9525640 1 Processor -- start 2023-05-17T11:46:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce9525640 1 -- start start 2023-05-17T11:46:13.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce9525640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5ce406c6e0 0x7f5ce40cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce9525640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce406bb40 con 0x7f5ce406db60 2023-05-17T11:46:13.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce9525640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce40c9f80 con 0x7f5ce4159a20 2023-05-17T11:46:13.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce9525640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce406fd00 con 0x7f5ce406c6e0 2023-05-17T11:46:13.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce27fc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5ce406db60 0x7f5ce406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36994/0 (socket says 172.21.15.3:36994) 2023-05-17T11:46:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce27fc640 1 -- 172.21.15.3:0/3711482801 learned_addr learned my addr 172.21.15.3:0/3711482801 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce37fe640 1 --2- 172.21.15.3:0/3711482801 >> v2:172.21.15.3:3300/0 conn(0x7f5ce406c6e0 0x7f5ce40cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce37fe640 1 -- 172.21.15.3:0/3711482801 >> v1:172.21.15.60:6789/0 conn(0x7f5ce4159a20 legacy=0x7f5ce415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce37fe640 1 -- 172.21.15.3:0/3711482801 >> v1:172.21.15.3:6789/0 conn(0x7f5ce406db60 legacy=0x7f5ce406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce37fe640 1 -- 172.21.15.3:0/3711482801 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40ca260 con 0x7f5ce406c6e0 2023-05-17T11:46:13.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.594+0000 7f5ce1ffb640 1 -- 172.21.15.3:0/3711482801 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869420197 0 0) 0x7f5ce406bb40 con 0x7f5ce406db60 2023-05-17T11:46:13.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce37fe640 1 --2- 172.21.15.3:0/3711482801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce406c6e0 0x7f5ce40cac60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009d90 tx=0x7f5cdc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58045412a8476760 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce1ffb640 1 -- 172.21.15.3:0/3711482801 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a5950 con 0x7f5ce406c6e0 2023-05-17T11:46:13.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce1ffb640 1 -- 172.21.15.3:0/3711482801 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0a5ab0 con 0x7f5ce406c6e0 2023-05-17T11:46:13.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce1ffb640 1 -- 172.21.15.3:0/3711482801 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a5e40 con 0x7f5ce406c6e0 2023-05-17T11:46:13.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 -- 172.21.15.3:0/3711482801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce406c6e0 msgr2=0x7f5ce40cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 --2- 172.21.15.3:0/3711482801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce406c6e0 0x7f5ce40cac60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009d90 tx=0x7f5cdc01c890 comp rx=0 tx=0).stop 2023-05-17T11:46:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 -- 172.21.15.3:0/3711482801 shutdown_connections 2023-05-17T11:46:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 --2- 172.21.15.3:0/3711482801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce406c6e0 0x7f5ce40cac60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 -- 172.21.15.3:0/3711482801 >> 172.21.15.3:0/3711482801 conn(0x7f5ce40afd60 msgr2=0x7f5ce40b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 -- 172.21.15.3:0/3711482801 shutdown_connections 2023-05-17T11:46:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 -- 172.21.15.3:0/3711482801 wait complete. 2023-05-17T11:46:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 Processor -- start 2023-05-17T11:46:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.598+0000 7f5ce9525640 1 -- start start 2023-05-17T11:46:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5ce406c6e0 0x7f5ce40cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce406db60 0x7f5ce41f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 0x7f5ce40ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4155d90 con 0x7f5ce4159a20 2023-05-17T11:46:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40cc4b0 con 0x7f5ce406db60 2023-05-17T11:46:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40cc770 con 0x7f5ce406c6e0 2023-05-17T11:46:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 0x7f5ce40ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 0x7f5ce40ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41644/0 (socket says 172.21.15.3:41644) 2023-05-17T11:46:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 -- 172.21.15.3:0/1296361847 learned_addr learned my addr 172.21.15.3:0/1296361847 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:13.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce27fc640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce406db60 0x7f5ce41f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce2ffd640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5ce406c6e0 0x7f5ce40cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 -- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5ce406c6e0 msgr2=0x7f5ce40cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5ce406c6e0 0x7f5ce40cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 -- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce406db60 msgr2=0x7f5ce41f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce406db60 0x7f5ce41f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 -- 172.21.15.3:0/1296361847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc009a70 con 0x7f5ce4159a20 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce2ffd640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5ce406c6e0 0x7f5ce40cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce37fe640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 0x7f5ce40ce1e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc01a4c0 tx=0x7f5cdc019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0ade40 con 0x7f5ce4159a20 2023-05-17T11:46:13.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0b9450 con 0x7f5ce4159a20 2023-05-17T11:46:13.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0b97e0 con 0x7f5ce4159a20 2023-05-17T11:46:13.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce4071c80 con 0x7f5ce4159a20 2023-05-17T11:46:13.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce415df20 con 0x7f5ce4159a20 2023-05-17T11:46:13.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.602+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce40cb1a0 con 0x7f5ce4159a20 2023-05-17T11:46:13.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.606+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5cdc0b9940 con 0x7f5ce4159a20 2023-05-17T11:46:13.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.606+0000 7f5ccb7fe640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.606+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5cdc11f690 con 0x7f5ce4159a20 2023-05-17T11:46:13.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.606+0000 7f5ce2ffd640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.606+0000 7f5ce2ffd640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ce415dc70 tx=0x7f5cd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.610+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5cdc0ecc50 con 0x7f5ce4159a20 2023-05-17T11:46:13.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.766+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ce4067130 con 0x7f5ce4159a20 2023-05-17T11:46:13.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ccb7fe640 1 -- 172.21.15.3:0/1296361847 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f5cdc0f0270 con 0x7f5ce4159a20 2023-05-17T11:46:13.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:13.780 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:45:36.511247+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:13.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 msgr2=0x7f5cd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ce415dc70 tx=0x7f5cd4009040 comp rx=0 tx=0).stop 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 msgr2=0x7f5ce40ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 0x7f5ce40ce1e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc01a4c0 tx=0x7f5cdc019630 comp rx=0 tx=0).stop 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 shutdown_connections 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce4159a20 0x7f5ce40ce1e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce406db60 0x7f5ce41f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 --2- 172.21.15.3:0/1296361847 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5ce406c6e0 0x7f5ce40cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 >> 172.21.15.3:0/1296361847 conn(0x7f5ce40afd60 msgr2=0x7f5ce40b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:13.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 shutdown_connections 2023-05-17T11:46:13.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.770+0000 7f5ce9525640 1 -- 172.21.15.3:0/1296361847 wait complete. 2023-05-17T11:46:13.800 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:13.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:13.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 Processor -- start 2023-05-17T11:46:13.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 -- start start 2023-05-17T11:46:13.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb64015d3d0 0x7fb6400ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6400cd2c0 0x7fb6400afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6400ad440 0x7fb6400b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400cdf90 con 0x7fb6400ad440 2023-05-17T11:46:13.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64009bcb0 con 0x7fb64015d3d0 2023-05-17T11:46:13.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb646e8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64009bf00 con 0x7fb6400cd2c0 2023-05-17T11:46:13.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb645429640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6400ad440 0x7fb6400b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb645429640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6400ad440 0x7fb6400b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41652/0 (socket says 172.21.15.3:41652) 2023-05-17T11:46:13.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.930+0000 7fb645429640 1 -- 172.21.15.3:0/2322138067 learned_addr learned my addr 172.21.15.3:0/2322138067 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:13.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb63ffff640 1 --2- 172.21.15.3:0/2322138067 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6400cd2c0 0x7fb6400afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb644c28640 1 --2- 172.21.15.3:0/2322138067 >> v2:172.21.15.60:3300/0 conn(0x7fb64015d3d0 0x7fb6400ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb645429640 1 -- 172.21.15.3:0/2322138067 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6400cd2c0 msgr2=0x7fb6400afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:13.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb645429640 1 --2- 172.21.15.3:0/2322138067 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6400cd2c0 0x7fb6400afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb645429640 1 -- 172.21.15.3:0/2322138067 >> v2:172.21.15.60:3300/0 conn(0x7fb64015d3d0 msgr2=0x7fb6400ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:13.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb645429640 1 --2- 172.21.15.3:0/2322138067 >> v2:172.21.15.60:3300/0 conn(0x7fb64015d3d0 0x7fb6400ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb645429640 1 -- 172.21.15.3:0/2322138067 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400ca3d0 con 0x7fb6400ad440 2023-05-17T11:46:13.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb645429640 1 --2- 172.21.15.3:0/2322138067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb6400b02f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb640078e50 tx=0x7fb63801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ba1edcc7996ec0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb63f7fe640 1 -- 172.21.15.3:0/2322138067 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380a5610 con 0x7fb6400ad440 2023-05-17T11:46:13.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb63f7fe640 1 -- 172.21.15.3:0/2322138067 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6380a5770 con 0x7fb6400ad440 2023-05-17T11:46:13.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb63f7fe640 1 -- 172.21.15.3:0/2322138067 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380a5b00 con 0x7fb6400ad440 2023-05-17T11:46:13.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 -- 172.21.15.3:0/2322138067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 msgr2=0x7fb6400b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 --2- 172.21.15.3:0/2322138067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb6400b02f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb640078e50 tx=0x7fb63801c940 comp rx=0 tx=0).stop 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 -- 172.21.15.3:0/2322138067 shutdown_connections 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 --2- 172.21.15.3:0/2322138067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb6400b02f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 --2- 172.21.15.3:0/2322138067 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6400cd2c0 0x7fb6400afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 --2- 172.21.15.3:0/2322138067 >> v2:172.21.15.60:3300/0 conn(0x7fb64015d3d0 0x7fb6400ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 -- 172.21.15.3:0/2322138067 >> 172.21.15.3:0/2322138067 conn(0x7fb64006a740 msgr2=0x7fb6400cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:13.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 -- 172.21.15.3:0/2322138067 shutdown_connections 2023-05-17T11:46:13.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.934+0000 7fb646e8c640 1 -- 172.21.15.3:0/2322138067 wait complete. 2023-05-17T11:46:13.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 Processor -- start 2023-05-17T11:46:13.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 -- start start 2023-05-17T11:46:13.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb640142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6400cd2c0 0x7fb6401537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb64015d3d0 0x7fb640153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400afe20 con 0x7fb6400ad440 2023-05-17T11:46:13.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640142bb0 con 0x7fb6400cd2c0 2023-05-17T11:46:13.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb646e8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64014f8e0 con 0x7fb64015d3d0 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb640142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb640142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41658/0 (socket says 172.21.15.3:41658) 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 -- 172.21.15.3:0/3738411334 learned_addr learned my addr 172.21.15.3:0/3738411334 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb63ffff640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6400cd2c0 0x7fb6401537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb645429640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb64015d3d0 0x7fb640153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 -- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb64015d3d0 msgr2=0x7fb640153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb64015d3d0 0x7fb640153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 -- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6400cd2c0 msgr2=0x7fb6401537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:13.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6400cd2c0 0x7fb6401537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:13.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 -- 172.21.15.3:0/3738411334 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb638009b30 con 0x7fb6400ad440 2023-05-17T11:46:13.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb644c28640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb640142670 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d5f0 tx=0x7fb63400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.938+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340125f0 con 0x7fb6400ad440 2023-05-17T11:46:13.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634012750 con 0x7fb6400ad440 2023-05-17T11:46:13.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634012ae0 con 0x7fb6400ad440 2023-05-17T11:46:13.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400c92b0 con 0x7fb6400ad440 2023-05-17T11:46:13.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400c9120 con 0x7fb6400ad440 2023-05-17T11:46:13.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6400c9440 con 0x7fb6400ad440 2023-05-17T11:46:13.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb634012c40 con 0x7fb6400ad440 2023-05-17T11:46:13.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63d7fa640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb624066280 0x7fb624068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:13.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6340840b0 con 0x7fb6400ad440 2023-05-17T11:46:13.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63ffff640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb624066280 0x7fb624068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:13.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.942+0000 7fb63ffff640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb624066280 0x7fb624068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ccea0 tx=0x7fb62c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:13.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:13.946+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb634051540 con 0x7fb6400ad440 2023-05-17T11:46:14.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb64004de80 con 0x7fb6400ad440 2023-05-17T11:46:14.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb63d7fa640 1 -- 172.21.15.3:0/3738411334 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb634007380 con 0x7fb6400ad440 2023-05-17T11:46:14.111 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:14.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb624066280 msgr2=0x7fb624068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb624066280 0x7fb624068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ccea0 tx=0x7fb62c008040 comp rx=0 tx=0).stop 2023-05-17T11:46:14.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 msgr2=0x7fb640142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb640142670 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d5f0 tx=0x7fb63400dab0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 shutdown_connections 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb624066280 0x7fb624068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb64015d3d0 0x7fb640153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6400cd2c0 0x7fb6401537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 --2- 172.21.15.3:0/3738411334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6400ad440 0x7fb640142670 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 >> 172.21.15.3:0/3738411334 conn(0x7fb64006a740 msgr2=0x7fb6400b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:14.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 shutdown_connections 2023-05-17T11:46:14.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.102+0000 7fb646e8c640 1 -- 172.21.15.3:0/3738411334 wait complete. 2023-05-17T11:46:14.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:14.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c1528c640 1 Processor -- start 2023-05-17T11:46:14.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c1528c640 1 -- start start 2023-05-17T11:46:14.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c1528c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1c1006d940 0x7f1c1006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c1528c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1015c760 con 0x7f1c100cec30 2023-05-17T11:46:14.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c1528c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100ccd40 con 0x7f1c100cf090 2023-05-17T11:46:14.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c1528c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100cdf60 con 0x7f1c1006d940 2023-05-17T11:46:14.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c0effd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1c1006d940 0x7f1c1006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c0effd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1c1006d940 0x7f1c1006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41672/0 (socket says 172.21.15.3:41672) 2023-05-17T11:46:14.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c07fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1c100cec30 0x7f1c100cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36996/0 (socket says 172.21.15.3:36996) 2023-05-17T11:46:14.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.262+0000 7f1c0effd640 1 -- 172.21.15.3:0/1374742147 learned_addr learned my addr 172.21.15.3:0/1374742147 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:14.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0effd640 1 -- 172.21.15.3:0/1374742147 >> v1:172.21.15.60:6789/0 conn(0x7f1c100cf090 legacy=0x7f1c100c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0effd640 1 -- 172.21.15.3:0/1374742147 >> v1:172.21.15.3:6789/0 conn(0x7f1c100cec30 legacy=0x7f1c100cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0effd640 1 -- 172.21.15.3:0/1374742147 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1006e250 con 0x7f1c1006d940 2023-05-17T11:46:14.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0effd640 1 --2- 172.21.15.3:0/1374742147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c1006d940 0x7f1c1006dd10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009870 tx=0x7f1c0001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a429dd16e1f3d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0e7fc640 1 -- 172.21.15.3:0/1374742147 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000aa670 con 0x7f1c1006d940 2023-05-17T11:46:14.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0e7fc640 1 -- 172.21.15.3:0/1374742147 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c000aa7d0 con 0x7f1c1006d940 2023-05-17T11:46:14.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c0e7fc640 1 -- 172.21.15.3:0/1374742147 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000aab60 con 0x7f1c1006d940 2023-05-17T11:46:14.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c1528c640 1 -- 172.21.15.3:0/1374742147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c1006d940 msgr2=0x7f1c1006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1374742147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c1006d940 0x7f1c1006dd10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009870 tx=0x7f1c0001c510 comp rx=0 tx=0).stop 2023-05-17T11:46:14.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c1528c640 1 -- 172.21.15.3:0/1374742147 shutdown_connections 2023-05-17T11:46:14.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1374742147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c1006d940 0x7f1c1006dd10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.266+0000 7f1c1528c640 1 -- 172.21.15.3:0/1374742147 >> 172.21.15.3:0/1374742147 conn(0x7f1c1006b4e0 msgr2=0x7f1c100cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:14.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- 172.21.15.3:0/1374742147 shutdown_connections 2023-05-17T11:46:14.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- 172.21.15.3:0/1374742147 wait complete. 2023-05-17T11:46:14.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 Processor -- start 2023-05-17T11:46:14.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- start start 2023-05-17T11:46:14.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c1006d940 0x7f1c10156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 0x7f1c101517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1c100cf090 0x7f1c101588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100b4fd0 con 0x7f1c100cec30 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100b4330 con 0x7f1c1006d940 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100b3d70 con 0x7f1c100cf090 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 0x7f1c101517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 0x7f1c101517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41674/0 (socket says 172.21.15.3:41674) 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 -- 172.21.15.3:0/1304313256 learned_addr learned my addr 172.21.15.3:0/1304313256 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:14.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c0effd640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c1006d940 0x7f1c10156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c0f7fe640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1c100cf090 0x7f1c101588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 -- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1c100cf090 msgr2=0x7f1c101588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1c100cf090 0x7f1c101588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 -- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c1006d940 msgr2=0x7f1c10156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c1006d940 0x7f1c10156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 -- 172.21.15.3:0/1304313256 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000094d0 con 0x7f1c100cec30 2023-05-17T11:46:14.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c07fff640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 0x7f1c101517f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c490 tx=0x7f1bf800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8007480 con 0x7f1c100cec30 2023-05-17T11:46:14.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf80075e0 con 0x7f1c100cec30 2023-05-17T11:46:14.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8004a10 con 0x7f1c100cec30 2023-05-17T11:46:14.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.270+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c100ce710 con 0x7f1c100cec30 2023-05-17T11:46:14.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100ce430 con 0x7f1c100cec30 2023-05-17T11:46:14.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c100aeb70 con 0x7f1c100cec30 2023-05-17T11:46:14.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bf8004b70 con 0x7f1c100cec30 2023-05-17T11:46:14.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c077fe640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1bf0066280 0x7f1bf0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bf8082e30 con 0x7f1c100cec30 2023-05-17T11:46:14.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c0effd640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1bf0066280 0x7f1bf0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.274+0000 7f1c0effd640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1bf0066280 0x7f1bf0068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1c000ae000 tx=0x7f1c000b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.278+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1bf8050350 con 0x7f1c100cec30 2023-05-17T11:46:14.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c100b5110 con 0x7f1c100cec30 2023-05-17T11:46:14.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c077fe640 1 -- 172.21.15.3:0/1304313256 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c100b5110 con 0x7f1c100cec30 2023-05-17T11:46:14.443 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:14.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1bf0066280 msgr2=0x7f1bf0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1bf0066280 0x7f1bf0068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1c000ae000 tx=0x7f1c000b5040 comp rx=0 tx=0).stop 2023-05-17T11:46:14.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 msgr2=0x7f1c101517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 0x7f1c101517f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c490 tx=0x7f1bf800c950 comp rx=0 tx=0).stop 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 shutdown_connections 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f1bf0066280 0x7f1bf0068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f1c100cf090 0x7f1c101588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c100cec30 0x7f1c101517f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 --2- 172.21.15.3:0/1304313256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c1006d940 0x7f1c10156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 >> 172.21.15.3:0/1304313256 conn(0x7f1c1006b4e0 msgr2=0x7f1c100b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:14.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 shutdown_connections 2023-05-17T11:46:14.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.434+0000 7f1c1528c640 1 -- 172.21.15.3:0/1304313256 wait complete. 2023-05-17T11:46:14.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:14.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 Processor -- start 2023-05-17T11:46:14.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 -- start start 2023-05-17T11:46:14.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc0815c340 0x7fcc080d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc080d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc08066f00 con 0x7fcc080b25e0 2023-05-17T11:46:14.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc080b0250 con 0x7fcc0815c340 2023-05-17T11:46:14.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0ca12640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080af640 con 0x7fcc080b40b0 2023-05-17T11:46:14.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc0815c340 0x7fcc080d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc0815c340 0x7fcc080d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41686/0 (socket says 172.21.15.3:41686) 2023-05-17T11:46:14.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 -- 172.21.15.3:0/3301970643 learned_addr learned my addr 172.21.15.3:0/3301970643 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:14.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc05d9b640 1 --2- 172.21.15.3:0/3301970643 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc080d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 -- 172.21.15.3:0/3301970643 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 msgr2=0x7fcc080d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:14.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 --2- 172.21.15.3:0/3301970643 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc080d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 -- 172.21.15.3:0/3301970643 >> v1:172.21.15.60:6789/0 conn(0x7fcc080b25e0 legacy=0x7fcc080b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.598+0000 7fcc0659c640 1 -- 172.21.15.3:0/3301970643 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080af920 con 0x7fcc0815c340 2023-05-17T11:46:14.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0659c640 1 --2- 172.21.15.3:0/3301970643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc0815c340 0x7fcc080d0280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8006fd0 tx=0x7fcbf801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44679074c4dcabf0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0559a640 1 -- 172.21.15.3:0/3301970643 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80aa5f0 con 0x7fcc0815c340 2023-05-17T11:46:14.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0559a640 1 -- 172.21.15.3:0/3301970643 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf80aa750 con 0x7fcc0815c340 2023-05-17T11:46:14.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0559a640 1 -- 172.21.15.3:0/3301970643 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80aaae0 con 0x7fcc0815c340 2023-05-17T11:46:14.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 -- 172.21.15.3:0/3301970643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc0815c340 msgr2=0x7fcc080d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/3301970643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc0815c340 0x7fcc080d0280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8006fd0 tx=0x7fcbf801c490 comp rx=0 tx=0).stop 2023-05-17T11:46:14.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 -- 172.21.15.3:0/3301970643 shutdown_connections 2023-05-17T11:46:14.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/3301970643 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc080d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/3301970643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc0815c340 0x7fcc080d0280 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 -- 172.21.15.3:0/3301970643 >> 172.21.15.3:0/3301970643 conn(0x7fcc08071b00 msgr2=0x7fcc0809bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:14.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 -- 172.21.15.3:0/3301970643 shutdown_connections 2023-05-17T11:46:14.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.602+0000 7fcc0ca12640 1 -- 172.21.15.3:0/3301970643 wait complete. 2023-05-17T11:46:14.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 Processor -- start 2023-05-17T11:46:14.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- start start 2023-05-17T11:46:14.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 0x7fcc08151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc0806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc0815c340 0x7fcc0806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080cfcb0 con 0x7fcc080b25e0 2023-05-17T11:46:14.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0815cd80 con 0x7fcc0815c340 2023-05-17T11:46:14.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08152520 con 0x7fcc080b40b0 2023-05-17T11:46:14.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 0x7fcc08151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 0x7fcc08151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41694/0 (socket says 172.21.15.3:41694) 2023-05-17T11:46:14.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 -- 172.21.15.3:0/2681082238 learned_addr learned my addr 172.21.15.3:0/2681082238 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:14.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc05d9b640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc0806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc06d9d640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc0815c340 0x7fcc0806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 -- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 msgr2=0x7fcc0806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc0806ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 -- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc0815c340 msgr2=0x7fcc0806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc0815c340 0x7fcc0806b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 -- 172.21.15.3:0/2681082238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009480 con 0x7fcc080b25e0 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0659c640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 0x7fcc08151fe0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcbf801a0c0 tx=0x7fcbf8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80aacd0 con 0x7fcc080b25e0 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf80aae30 con 0x7fcc080b25e0 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8003840 con 0x7fcc080b25e0 2023-05-17T11:46:14.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc080b1e00 con 0x7fcc080b25e0 2023-05-17T11:46:14.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc080af2d0 con 0x7fcc080b25e0 2023-05-17T11:46:14.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.606+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc080b1f90 con 0x7fcc080b25e0 2023-05-17T11:46:14.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.610+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcbf80039a0 con 0x7fcc080b25e0 2023-05-17T11:46:14.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.610+0000 7fcbf6ffd640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcbe80662b0 0x7fcbe8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.610+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbf80a7070 con 0x7fcc080b25e0 2023-05-17T11:46:14.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.610+0000 7fcc05d9b640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcbe80662b0 0x7fcbe8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.610+0000 7fcc05d9b640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcbe80662b0 0x7fcbe8068760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc08155c90 tx=0x7fcbfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.614+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcbf80eb7b0 con 0x7fcc080b25e0 2023-05-17T11:46:14.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.774+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc0804de80 con 0x7fcc080b25e0 2023-05-17T11:46:14.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.774+0000 7fcbf6ffd640 1 -- 172.21.15.3:0/2681082238 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbf80eedd0 con 0x7fcc080b25e0 2023-05-17T11:46:14.786 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:14.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcbe80662b0 msgr2=0x7fcbe8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcbe80662b0 0x7fcbe8068760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc08155c90 tx=0x7fcbfc008040 comp rx=0 tx=0).stop 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 msgr2=0x7fcc08151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 0x7fcc08151fe0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcbf801a0c0 tx=0x7fcbf8019230 comp rx=0 tx=0).stop 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 shutdown_connections 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcbe80662b0 0x7fcbe8068760 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc0815c340 0x7fcc0806b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcc080b40b0 0x7fcc0806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 --2- 172.21.15.3:0/2681082238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc080b25e0 0x7fcc08151fe0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 >> 172.21.15.3:0/2681082238 conn(0x7fcc08071b00 msgr2=0x7fcc0806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:14.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 shutdown_connections 2023-05-17T11:46:14.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.778+0000 7fcc0ca12640 1 -- 172.21.15.3:0/2681082238 wait complete. 2023-05-17T11:46:14.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:14.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.934+0000 7fd005598640 1 Processor -- start 2023-05-17T11:46:14.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fd005598640 1 -- start start 2023-05-17T11:46:14.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fd005598640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd0000ad440 0x7fd0000afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fd005598640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd0000cb4c0 0x7fd0000b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fd005598640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00009bcb0 con 0x7fd00015d3d0 2023-05-17T11:46:14.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fd005598640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000cdf90 con 0x7fd0000cb4c0 2023-05-17T11:46:14.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fd005598640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000ca130 con 0x7fd0000ad440 2023-05-17T11:46:14.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcfff7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd0000cb4c0 0x7fd0000b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcffeffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd00015d3d0 0x7fd0000ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37008/0 (socket says 172.21.15.3:37008) 2023-05-17T11:46:14.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcffeffd640 1 -- 172.21.15.3:0/3901162901 learned_addr learned my addr 172.21.15.3:0/3901162901 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcff7fff640 1 --2- 172.21.15.3:0/3901162901 >> v2:172.21.15.60:3300/0 conn(0x7fd0000ad440 0x7fd0000afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3901162901 >> v2:172.21.15.60:3300/0 conn(0x7fd0000ad440 msgr2=0x7fd0000afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcfff7fe640 1 --2- 172.21.15.3:0/3901162901 >> v2:172.21.15.60:3300/0 conn(0x7fd0000ad440 0x7fd0000afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3901162901 >> v1:172.21.15.3:6789/0 conn(0x7fd00015d3d0 legacy=0x7fd0000ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3901162901 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000cd490 con 0x7fd0000cb4c0 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.938+0000 7fcffe7fc640 1 -- 172.21.15.3:0/3901162901 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134715715 0 0) 0x7fd00009bcb0 con 0x7fd00015d3d0 2023-05-17T11:46:14.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fcfff7fe640 1 --2- 172.21.15.3:0/3901162901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0000cb4c0 0x7fd0000b02f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd000071b10 tx=0x7fcff801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bdb483bc37cd3d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fcffe7fc640 1 -- 172.21.15.3:0/3901162901 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a57a0 con 0x7fd0000cb4c0 2023-05-17T11:46:14.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fcffe7fc640 1 -- 172.21.15.3:0/3901162901 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff80a5900 con 0x7fd0000cb4c0 2023-05-17T11:46:14.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fcffe7fc640 1 -- 172.21.15.3:0/3901162901 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a5c90 con 0x7fd0000cb4c0 2023-05-17T11:46:14.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 -- 172.21.15.3:0/3901162901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0000cb4c0 msgr2=0x7fd0000b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 --2- 172.21.15.3:0/3901162901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0000cb4c0 0x7fd0000b02f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd000071b10 tx=0x7fcff801c7f0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 -- 172.21.15.3:0/3901162901 shutdown_connections 2023-05-17T11:46:14.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 --2- 172.21.15.3:0/3901162901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0000cb4c0 0x7fd0000b02f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 --2- 172.21.15.3:0/3901162901 >> v2:172.21.15.60:3300/0 conn(0x7fd0000ad440 0x7fd0000afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 -- 172.21.15.3:0/3901162901 >> 172.21.15.3:0/3901162901 conn(0x7fd00006a740 msgr2=0x7fd0000cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:14.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 -- 172.21.15.3:0/3901162901 shutdown_connections 2023-05-17T11:46:14.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 -- 172.21.15.3:0/3901162901 wait complete. 2023-05-17T11:46:14.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 Processor -- start 2023-05-17T11:46:14.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.942+0000 7fd005598640 1 -- start start 2023-05-17T11:46:14.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0000ad440 0x7fd0000c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0000cb4c0 0x7fd0000c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 0x7fd000150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c5940 con 0x7fd00015d3d0 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000150f40 con 0x7fd0000cb4c0 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c5ba0 con 0x7fd0000ad440 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 0x7fd000150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 0x7fd000150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41720/0 (socket says 172.21.15.3:41720) 2023-05-17T11:46:14.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3175268359 learned_addr learned my addr 172.21.15.3:0/3175268359 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcffeffd640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0000ad440 0x7fd0000c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0000ad440 msgr2=0x7fd0000c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0000ad440 0x7fd0000c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0000cb4c0 msgr2=0x7fd0000c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcff7fff640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0000cb4c0 0x7fd0000c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0000cb4c0 0x7fd0000c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 -- 172.21.15.3:0/3175268359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8009a70 con 0x7fd00015d3d0 2023-05-17T11:46:14.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcffeffd640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0000ad440 0x7fd0000c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcff7fff640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0000cb4c0 0x7fd0000c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcfff7fe640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 0x7fd000150a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcff8019400 tx=0x7fcff8019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80b9650 con 0x7fd00015d3d0 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff80b97b0 con 0x7fd00015d3d0 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80b9b60 con 0x7fd00015d3d0 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00015d7a0 con 0x7fd00015d3d0 2023-05-17T11:46:14.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0000ca6b0 con 0x7fd00015d3d0 2023-05-17T11:46:14.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd000166b30 con 0x7fd00015d3d0 2023-05-17T11:46:14.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.946+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcff80b9cc0 con 0x7fd00015d3d0 2023-05-17T11:46:14.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.950+0000 7fcff77fe640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcfe0066280 0x7fcfe0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:14.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.950+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcff811ef40 con 0x7fd00015d3d0 2023-05-17T11:46:14.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.950+0000 7fcffeffd640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcfe0066280 0x7fcfe0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:14.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.950+0000 7fcffeffd640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcfe0066280 0x7fcfe0068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcff0007fd0 tx=0x7fcff0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:14.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:14.954+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcff80ec570 con 0x7fd00015d3d0 2023-05-17T11:46:15.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd000073330 con 0x7fd00015d3d0 2023-05-17T11:46:15.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fcff77fe640 1 -- 172.21.15.3:0/3175268359 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcff80bd020 con 0x7fd00015d3d0 2023-05-17T11:46:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:15.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcfe0066280 msgr2=0x7fcfe0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcfe0066280 0x7fcfe0068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcff0007fd0 tx=0x7fcff0009040 comp rx=0 tx=0).stop 2023-05-17T11:46:15.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 msgr2=0x7fd000150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 0x7fd000150a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcff8019400 tx=0x7fcff8019590 comp rx=0 tx=0).stop 2023-05-17T11:46:15.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 shutdown_connections 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcfe0066280 0x7fcfe0068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd00015d3d0 0x7fd000150a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0000cb4c0 0x7fd0000c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 --2- 172.21.15.3:0/3175268359 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0000ad440 0x7fd0000c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 >> 172.21.15.3:0/3175268359 conn(0x7fd00006a740 msgr2=0x7fd0000aaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 shutdown_connections 2023-05-17T11:46:15.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.106+0000 7fd005598640 1 -- 172.21.15.3:0/3175268359 wait complete. 2023-05-17T11:46:15.136 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:15.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 Processor -- start 2023-05-17T11:46:15.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 -- start start 2023-05-17T11:46:15.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f23940b1e00 0x7f23940d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f23940d03d0 0x7f23940d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b2710 0x7f23940b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940d0d60 con 0x7f23940b1e00 2023-05-17T11:46:15.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940b3440 con 0x7f23940d03d0 2023-05-17T11:46:15.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2398e8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940d27f0 con 0x7f23940b2710 2023-05-17T11:46:15.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f23940b1e00 0x7f23940d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f23940b1e00 0x7f23940d32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41722/0 (socket says 172.21.15.3:41722) 2023-05-17T11:46:15.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 -- 172.21.15.3:0/1386377524 learned_addr learned my addr 172.21.15.3:0/1386377524 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f2392d9d640 1 --2- 172.21.15.3:0/1386377524 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b2710 0x7f23940b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f238bfff640 1 --2- 172.21.15.3:0/1386377524 >> v2:172.21.15.60:3300/0 conn(0x7f23940d03d0 0x7f23940d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 -- 172.21.15.3:0/1386377524 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b2710 msgr2=0x7f23940b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 --2- 172.21.15.3:0/1386377524 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b2710 0x7f23940b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 -- 172.21.15.3:0/1386377524 >> v2:172.21.15.60:3300/0 conn(0x7f23940d03d0 msgr2=0x7f23940d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 --2- 172.21.15.3:0/1386377524 >> v2:172.21.15.60:3300/0 conn(0x7f23940d03d0 0x7f23940d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.266+0000 7f239259c640 1 -- 172.21.15.3:0/1386377524 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940d2ad0 con 0x7f23940b1e00 2023-05-17T11:46:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f239259c640 1 --2- 172.21.15.3:0/1386377524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b1e00 0x7f23940d32d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f239408b2d0 tx=0x7f238401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9522f159fdca9a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2391d9b640 1 -- 172.21.15.3:0/1386377524 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840ab600 con 0x7f23940b1e00 2023-05-17T11:46:15.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2391d9b640 1 -- 172.21.15.3:0/1386377524 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23840a7050 con 0x7f23940b1e00 2023-05-17T11:46:15.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2391d9b640 1 -- 172.21.15.3:0/1386377524 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840ab980 con 0x7f23940b1e00 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 -- 172.21.15.3:0/1386377524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b1e00 msgr2=0x7f23940d32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 --2- 172.21.15.3:0/1386377524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b1e00 0x7f23940d32d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f239408b2d0 tx=0x7f238401c3e0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 -- 172.21.15.3:0/1386377524 shutdown_connections 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 --2- 172.21.15.3:0/1386377524 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b2710 0x7f23940b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 --2- 172.21.15.3:0/1386377524 >> v2:172.21.15.60:3300/0 conn(0x7f23940d03d0 0x7f23940d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 --2- 172.21.15.3:0/1386377524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b1e00 0x7f23940d32d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 -- 172.21.15.3:0/1386377524 >> 172.21.15.3:0/1386377524 conn(0x7f2394071b00 msgr2=0x7f239409bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:15.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 -- 172.21.15.3:0/1386377524 shutdown_connections 2023-05-17T11:46:15.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.270+0000 7f2398e8c640 1 -- 172.21.15.3:0/1386377524 wait complete. 2023-05-17T11:46:15.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 Processor -- start 2023-05-17T11:46:15.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 -- start start 2023-05-17T11:46:15.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b1e00 0x7f2394156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 0x7f23940b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23940d03d0 0x7f23940b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b6560 con 0x7f23940b2710 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23941565a0 con 0x7f23940d03d0 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b5fa0 con 0x7f23940b1e00 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 0x7f23940b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 0x7f23940b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41726/0 (socket says 172.21.15.3:41726) 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 -- 172.21.15.3:0/2040897787 learned_addr learned my addr 172.21.15.3:0/2040897787 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:15.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f239259c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b1e00 0x7f2394156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2392d9d640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23940d03d0 0x7f23940b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 -- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b1e00 msgr2=0x7f2394156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b1e00 0x7f2394156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 -- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23940d03d0 msgr2=0x7f23940b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23940d03d0 0x7f23940b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 -- 172.21.15.3:0/2040897787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009480 con 0x7f23940b2710 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2392d9d640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23940d03d0 0x7f23940b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238bfff640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 0x7f23940b77f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f237c00d620 tx=0x7f237c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00b620 con 0x7f23940b2710 2023-05-17T11:46:15.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00b780 con 0x7f23940b2710 2023-05-17T11:46:15.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23940cd660 con 0x7f23940b2710 2023-05-17T11:46:15.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00bb10 con 0x7f23940b2710 2023-05-17T11:46:15.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.274+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23940b30d0 con 0x7f23940b2710 2023-05-17T11:46:15.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.278+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940cd7f0 con 0x7f23940b2710 2023-05-17T11:46:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.278+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f237c00bc70 con 0x7f23940b2710 2023-05-17T11:46:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.278+0000 7f238affd640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2374066280 0x7f2374068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.278+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f237c0841a0 con 0x7f23940b2710 2023-05-17T11:46:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.278+0000 7f239259c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2374066280 0x7f2374068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.278+0000 7f239259c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2374066280 0x7f2374068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f23840ad000 tx=0x7f23840a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.282+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f237c051610 con 0x7f23940b2710 2023-05-17T11:46:15.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.454+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f239404de80 con 0x7f23940b2710 2023-05-17T11:46:15.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.454+0000 7f238affd640 1 -- 172.21.15.3:0/2040897787 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f237c007380 con 0x7f23940b2710 2023-05-17T11:46:15.466 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2374066280 msgr2=0x7f2374068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2374066280 0x7f2374068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f23840ad000 tx=0x7f23840a6000 comp rx=0 tx=0).stop 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 msgr2=0x7f23940b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 0x7f23940b77f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f237c00d620 tx=0x7f237c00dae0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 shutdown_connections 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2374066280 0x7f2374068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23940d03d0 0x7f23940b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23940b2710 0x7f23940b77f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 --2- 172.21.15.3:0/2040897787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f23940b1e00 0x7f2394156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 >> 172.21.15.3:0/2040897787 conn(0x7f2394071b00 msgr2=0x7f2394158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 shutdown_connections 2023-05-17T11:46:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.458+0000 7f2398e8c640 1 -- 172.21.15.3:0/2040897787 wait complete. 2023-05-17T11:46:15.486 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:46:15.486 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:15.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:15.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.622+0000 7f95de08c640 1 Processor -- start 2023-05-17T11:46:15.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.622+0000 7f95de08c640 1 -- start start 2023-05-17T11:46:15.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95de08c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d8158f10 0x7f95d8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95de08c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f95d8071c10 0x7f95d80cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95de08c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80c92f0 con 0x7f95d80cc4c0 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95de08c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d8071480 con 0x7f95d8071c10 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95de08c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c8a00 con 0x7f95d8158f10 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f95d8071c10 0x7f95d80cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f95d8071c10 0x7f95d80cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41734/0 (socket says 172.21.15.3:41734) 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 -- 172.21.15.3:0/4224142576 learned_addr learned my addr 172.21.15.3:0/4224142576 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:15.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d7fff640 1 --1- 172.21.15.3:0/4224142576 >> v1:172.21.15.3:6789/0 conn(0x7f95d80cc4c0 0x7f95d806bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37014/0 (socket says 172.21.15.3:37014) 2023-05-17T11:46:15.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d77fe640 1 --2- 172.21.15.3:0/4224142576 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d8158f10 0x7f95d8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 -- 172.21.15.3:0/4224142576 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d8158f10 msgr2=0x7f95d8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:15.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 --2- 172.21.15.3:0/4224142576 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d8158f10 0x7f95d8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 -- 172.21.15.3:0/4224142576 >> v1:172.21.15.3:6789/0 conn(0x7f95d80cc4c0 legacy=0x7f95d806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d6ffd640 1 -- 172.21.15.3:0/4224142576 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80716e0 con 0x7f95d8071c10 2023-05-17T11:46:15.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.626+0000 7f95d67fc640 1 -- 172.21.15.3:0/4224142576 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037410482 0 0) 0x7f95d80c92f0 con 0x7f95d80cc4c0 2023-05-17T11:46:15.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95d6ffd640 1 --2- 172.21.15.3:0/4224142576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80cbf80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009870 tx=0x7f95cc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66a9b044826e51b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95d67fc640 1 -- 172.21.15.3:0/4224142576 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0a7070 con 0x7f95d8071c10 2023-05-17T11:46:15.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95d67fc640 1 -- 172.21.15.3:0/4224142576 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0ab430 con 0x7f95d8071c10 2023-05-17T11:46:15.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95d67fc640 1 -- 172.21.15.3:0/4224142576 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0ab7c0 con 0x7f95d8071c10 2023-05-17T11:46:15.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 -- 172.21.15.3:0/4224142576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 msgr2=0x7f95d80cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 --2- 172.21.15.3:0/4224142576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80cbf80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009870 tx=0x7f95cc01c540 comp rx=0 tx=0).stop 2023-05-17T11:46:15.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 -- 172.21.15.3:0/4224142576 shutdown_connections 2023-05-17T11:46:15.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 --2- 172.21.15.3:0/4224142576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80cbf80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 --2- 172.21.15.3:0/4224142576 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d8158f10 0x7f95d8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 -- 172.21.15.3:0/4224142576 >> 172.21.15.3:0/4224142576 conn(0x7f95d80b0b30 msgr2=0x7f95d80cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:15.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 -- 172.21.15.3:0/4224142576 shutdown_connections 2023-05-17T11:46:15.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 -- 172.21.15.3:0/4224142576 wait complete. 2023-05-17T11:46:15.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 Processor -- start 2023-05-17T11:46:15.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.630+0000 7f95de08c640 1 -- start start 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d80cc4c0 0x7f95d80b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d8158f10 0x7f95d8147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815b020 con 0x7f95d8071c10 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80b1720 con 0x7f95d8158f10 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80b19c0 con 0x7f95d80cc4c0 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41744/0 (socket says 172.21.15.3:41744) 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 -- 172.21.15.3:0/2134337787 learned_addr learned my addr 172.21.15.3:0/2134337787 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 -- 172.21.15.3:0/2134337787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d80cc4c0 msgr2=0x7f95d80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d80cc4c0 0x7f95d80b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 -- 172.21.15.3:0/2134337787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d8158f10 msgr2=0x7f95d8147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d8158f10 0x7f95d8147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 -- 172.21.15.3:0/2134337787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0094d0 con 0x7f95d8071c10 2023-05-17T11:46:15.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95d77fe640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80b2e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95c800d800 tx=0x7f95c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800b6c0 con 0x7f95d8071c10 2023-05-17T11:46:15.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c800b820 con 0x7f95d8071c10 2023-05-17T11:46:15.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800bb90 con 0x7f95d8071c10 2023-05-17T11:46:15.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d80ca100 con 0x7f95d8071c10 2023-05-17T11:46:15.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d80c9f70 con 0x7f95d8071c10 2023-05-17T11:46:15.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d806c340 con 0x7f95d8071c10 2023-05-17T11:46:15.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.634+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95c800bcf0 con 0x7f95d8071c10 2023-05-17T11:46:15.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.638+0000 7f95bffff640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f95c4066280 0x7f95c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.638+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f95c8084380 con 0x7f95d8071c10 2023-05-17T11:46:15.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.638+0000 7f95d6ffd640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f95c4066280 0x7f95c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.638+0000 7f95d6ffd640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f95c4066280 0x7f95c4068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0af000 tx=0x7f95cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.642+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f95c80551b0 con 0x7f95d8071c10 2023-05-17T11:46:15.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.794+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95d804de80 con 0x7f95d8071c10 2023-05-17T11:46:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95bffff640 1 -- 172.21.15.3:0/2134337787 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18266 (secure 0 0 0) 0x7f95c8054d40 con 0x7f95d8071c10 2023-05-17T11:46:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:15.808 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":24,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:15.338938+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f95c4066280 msgr2=0x7f95c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f95c4066280 0x7f95c4068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0af000 tx=0x7f95cc008040 comp rx=0 tx=0).stop 2023-05-17T11:46:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 msgr2=0x7f95d80b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80b2e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95c800d800 tx=0x7f95c800dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 shutdown_connections 2023-05-17T11:46:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f95c4066280 0x7f95c4068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d8158f10 0x7f95d8147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f95d80cc4c0 0x7f95d80b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 --2- 172.21.15.3:0/2134337787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95d8071c10 0x7f95d80b2e10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 >> 172.21.15.3:0/2134337787 conn(0x7f95d80b0b30 msgr2=0x7f95d8151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 shutdown_connections 2023-05-17T11:46:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.798+0000 7f95de08c640 1 -- 172.21.15.3:0/2134337787 wait complete. 2023-05-17T11:46:15.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:15.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.958+0000 7f8e692fc640 1 Processor -- start 2023-05-17T11:46:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.958+0000 7f8e692fc640 1 -- start start 2023-05-17T11:46:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e692fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8e6415c0b0 0x7f8e64070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e692fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8e6415c480 0x7f8e640cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e692fc640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6415fd30 con 0x7f8e640cb0b0 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e692fc640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6415d540 con 0x7f8e6415c480 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e692fc640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6415cca0 con 0x7f8e6415c0b0 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e5bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8e6415c480 0x7f8e640cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e637fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8e640cb0b0 0x7f8e641601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37026/0 (socket says 172.21.15.3:37026) 2023-05-17T11:46:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e637fe640 1 -- 172.21.15.3:0/2733566434 learned_addr learned my addr 172.21.15.3:0/2733566434 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e62ffd640 1 --2- 172.21.15.3:0/2733566434 >> v2:172.21.15.60:3300/0 conn(0x7f8e6415c0b0 0x7f8e64070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e5bfff640 1 -- 172.21.15.3:0/2733566434 >> v2:172.21.15.60:3300/0 conn(0x7f8e6415c0b0 msgr2=0x7f8e64070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e5bfff640 1 --2- 172.21.15.3:0/2733566434 >> v2:172.21.15.60:3300/0 conn(0x7f8e6415c0b0 0x7f8e64070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e5bfff640 1 -- 172.21.15.3:0/2733566434 >> v1:172.21.15.3:6789/0 conn(0x7f8e640cb0b0 legacy=0x7f8e641601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e5bfff640 1 -- 172.21.15.3:0/2733566434 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6415cf80 con 0x7f8e6415c480 2023-05-17T11:46:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e62ffd640 1 --2- 172.21.15.3:0/2733566434 >> v2:172.21.15.60:3300/0 conn(0x7f8e6415c0b0 0x7f8e64070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e5bfff640 1 --2- 172.21.15.3:0/2733566434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c480 0x7f8e640cab70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e6406aa30 tx=0x7f8e4c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b6b67a1a34fd7e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e627fc640 1 -- 172.21.15.3:0/2733566434 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0ab600 con 0x7f8e6415c480 2023-05-17T11:46:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e627fc640 1 -- 172.21.15.3:0/2733566434 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c0a7050 con 0x7f8e6415c480 2023-05-17T11:46:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.962+0000 7f8e627fc640 1 -- 172.21.15.3:0/2733566434 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0ab980 con 0x7f8e6415c480 2023-05-17T11:46:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- 172.21.15.3:0/2733566434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c480 msgr2=0x7f8e640cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 --2- 172.21.15.3:0/2733566434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c480 0x7f8e640cab70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e6406aa30 tx=0x7f8e4c01c460 comp rx=0 tx=0).stop 2023-05-17T11:46:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- 172.21.15.3:0/2733566434 shutdown_connections 2023-05-17T11:46:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 --2- 172.21.15.3:0/2733566434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c480 0x7f8e640cab70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 --2- 172.21.15.3:0/2733566434 >> v2:172.21.15.60:3300/0 conn(0x7f8e6415c0b0 0x7f8e64070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- 172.21.15.3:0/2733566434 >> 172.21.15.3:0/2733566434 conn(0x7f8e640d05b0 msgr2=0x7f8e640d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- 172.21.15.3:0/2733566434 shutdown_connections 2023-05-17T11:46:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- 172.21.15.3:0/2733566434 wait complete. 2023-05-17T11:46:15.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 Processor -- start 2023-05-17T11:46:15.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- start start 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e640cb0b0 0x7f8e640c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 0x7f8e64149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8e6415c480 0x7f8e64149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6415ee70 con 0x7f8e6415c0b0 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6415e230 con 0x7f8e640cb0b0 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e692fc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6415e4d0 con 0x7f8e6415c480 2023-05-17T11:46:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 0x7f8e64149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 0x7f8e64149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41762/0 (socket says 172.21.15.3:41762) 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 -- 172.21.15.3:0/1176917273 learned_addr learned my addr 172.21.15.3:0/1176917273 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e62ffd640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e640cb0b0 0x7f8e640c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e637fe640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8e6415c480 0x7f8e64149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 -- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8e6415c480 msgr2=0x7f8e64149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8e6415c480 0x7f8e64149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 -- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e640cb0b0 msgr2=0x7f8e640c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e640cb0b0 0x7f8e640c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.966+0000 7f8e5bfff640 1 -- 172.21.15.3:0/1176917273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c009420 con 0x7f8e6415c0b0 2023-05-17T11:46:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e5bfff640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 0x7f8e64149a90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0ae040 tx=0x7f8e4c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0b4840 con 0x7f8e6415c0b0 2023-05-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c0b49c0 con 0x7f8e6415c0b0 2023-05-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0b4d70 con 0x7f8e6415c0b0 2023-05-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e64160a60 con 0x7f8e6415c0b0 2023-05-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e641608d0 con 0x7f8e6415c0b0 2023-05-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e64168ea0 con 0x7f8e6415c0b0 2023-05-17T11:46:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e4c0b2040 con 0x7f8e6415c0b0 2023-05-17T11:46:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.970+0000 7f8e5b7fe640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8e44066280 0x7f8e44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.974+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8e4c11e160 con 0x7f8e6415c0b0 2023-05-17T11:46:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.974+0000 7f8e62ffd640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8e44066280 0x7f8e44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.974+0000 7f8e62ffd640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8e44066280 0x7f8e44068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400d620 tx=0x7f8e54007810 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:15.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:15.974+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8e4c0eb500 con 0x7f8e6415c0b0 2023-05-17T11:46:16.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e6415efb0 con 0x7f8e6415c0b0 2023-05-17T11:46:16.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e5b7fe640 1 -- 172.21.15.3:0/1176917273 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e4c0eeb20 con 0x7f8e6415c0b0 2023-05-17T11:46:16.140 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:16.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8e44066280 msgr2=0x7f8e44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8e44066280 0x7f8e44068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400d620 tx=0x7f8e54007810 comp rx=0 tx=0).stop 2023-05-17T11:46:16.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 msgr2=0x7f8e64149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 0x7f8e64149a90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0ae040 tx=0x7f8e4c019200 comp rx=0 tx=0).stop 2023-05-17T11:46:16.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 shutdown_connections 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8e44066280 0x7f8e44068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8e6415c480 0x7f8e64149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e6415c0b0 0x7f8e64149a90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 --2- 172.21.15.3:0/1176917273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e640cb0b0 0x7f8e640c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 >> 172.21.15.3:0/1176917273 conn(0x7f8e640d05b0 msgr2=0x7f8e640cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 shutdown_connections 2023-05-17T11:46:16.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.130+0000 7f8e692fc640 1 -- 172.21.15.3:0/1176917273 wait complete. 2023-05-17T11:46:16.160 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 Processor -- start 2023-05-17T11:46:16.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 -- start start 2023-05-17T11:46:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b7415c220 0x7f5b740afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5b740ad1a0 0x7f5b740b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7406ca60 con 0x7f5b740cd9d0 2023-05-17T11:46:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7406beb0 con 0x7f5b740ad1a0 2023-05-17T11:46:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b7ab17640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7406c130 con 0x7f5b7415c220 2023-05-17T11:46:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.290+0000 7f5b73fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5b740ad1a0 0x7f5b740b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5b740ad1a0 0x7f5b740b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41768/0 (socket says 172.21.15.3:41768) 2023-05-17T11:46:16.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 -- 172.21.15.3:0/800612454 learned_addr learned my addr 172.21.15.3:0/800612454 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 -- 172.21.15.3:0/800612454 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b7415c220 msgr2=0x7f5b740afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 --2- 172.21.15.3:0/800612454 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b7415c220 0x7f5b740afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 -- 172.21.15.3:0/800612454 >> v1:172.21.15.60:6789/0 conn(0x7f5b740cd9d0 legacy=0x7f5b740cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:16.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 -- 172.21.15.3:0/800612454 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7406c410 con 0x7f5b740ad1a0 2023-05-17T11:46:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b73fff640 1 --2- 172.21.15.3:0/800612454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b740ad1a0 0x7f5b740b02f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb34e42f8e1207a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b737fe640 1 -- 172.21.15.3:0/800612454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600ac600 con 0x7f5b740ad1a0 2023-05-17T11:46:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b737fe640 1 -- 172.21.15.3:0/800612454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b600a8050 con 0x7f5b740ad1a0 2023-05-17T11:46:16.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b737fe640 1 -- 172.21.15.3:0/800612454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600ac980 con 0x7f5b740ad1a0 2023-05-17T11:46:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b7ab17640 1 -- 172.21.15.3:0/800612454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b740ad1a0 msgr2=0x7f5b740b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.294+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/800612454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b740ad1a0 0x7f5b740b02f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b6001c440 comp rx=0 tx=0).stop 2023-05-17T11:46:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- 172.21.15.3:0/800612454 shutdown_connections 2023-05-17T11:46:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/800612454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b740ad1a0 0x7f5b740b02f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/800612454 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b7415c220 0x7f5b740afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- 172.21.15.3:0/800612454 >> 172.21.15.3:0/800612454 conn(0x7f5b7406a740 msgr2=0x7f5b740cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- 172.21.15.3:0/800612454 shutdown_connections 2023-05-17T11:46:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- 172.21.15.3:0/800612454 wait complete. 2023-05-17T11:46:16.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 Processor -- start 2023-05-17T11:46:16.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- start start 2023-05-17T11:46:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b740ad1a0 0x7f5b74159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b740cd9d0 0x7f5b7415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 0x7f5b7413e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74152a00 con 0x7f5b7415c220 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74152ce0 con 0x7f5b740ad1a0 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b7ab17640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74152fc0 con 0x7f5b740cd9d0 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 0x7f5b7413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b788b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b740ad1a0 0x7f5b74159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 0x7f5b7413e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36718/0 (socket says 172.21.15.3:36718) 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b73fff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b740cd9d0 0x7f5b7415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 -- 172.21.15.3:0/1078940661 learned_addr learned my addr 172.21.15.3:0/1078940661 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:16.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 -- 172.21.15.3:0/1078940661 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b740cd9d0 msgr2=0x7f5b7415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b740cd9d0 0x7f5b7415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 -- 172.21.15.3:0/1078940661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b740ad1a0 msgr2=0x7f5b74159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b740ad1a0 0x7f5b74159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.298+0000 7f5b790b4640 1 -- 172.21.15.3:0/1078940661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600094d0 con 0x7f5b7415c220 2023-05-17T11:46:16.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b790b4640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 0x7f5b7413e450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c750 tx=0x7f5b6c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c003b90 con 0x7f5b7415c220 2023-05-17T11:46:16.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c003d10 con 0x7f5b7415c220 2023-05-17T11:46:16.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0052b0 con 0x7f5b7415c220 2023-05-17T11:46:16.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b74168dd0 con 0x7f5b7415c220 2023-05-17T11:46:16.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b740cd770 con 0x7f5b7415c220 2023-05-17T11:46:16.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b74168f60 con 0x7f5b7415c220 2023-05-17T11:46:16.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b6c005410 con 0x7f5b7415c220 2023-05-17T11:46:16.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b717fa640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5b580662b0 0x7f5b58068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5b6c083170 con 0x7f5b7415c220 2023-05-17T11:46:16.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b788b3640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5b580662b0 0x7f5b58068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.302+0000 7f5b788b3640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5b580662b0 0x7f5b58068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b680098f0 tx=0x7f5b68006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.306+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5b6c050640 con 0x7f5b7415c220 2023-05-17T11:46:16.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.466+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b7404de80 con 0x7f5b7415c220 2023-05-17T11:46:16.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.466+0000 7f5b717fa640 1 -- 172.21.15.3:0/1078940661 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b6c053c60 con 0x7f5b7415c220 2023-05-17T11:46:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5b580662b0 msgr2=0x7f5b58068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5b580662b0 0x7f5b58068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b680098f0 tx=0x7f5b68006f90 comp rx=0 tx=0).stop 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 msgr2=0x7f5b7413e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 0x7f5b7413e450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c750 tx=0x7f5b6c00cc10 comp rx=0 tx=0).stop 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 shutdown_connections 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5b580662b0 0x7f5b58068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b7415c220 0x7f5b7413e450 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5b740cd9d0 0x7f5b7415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 --2- 172.21.15.3:0/1078940661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b740ad1a0 0x7f5b74159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 >> 172.21.15.3:0/1078940661 conn(0x7f5b7406a740 msgr2=0x7f5b740ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:16.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 shutdown_connections 2023-05-17T11:46:16.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.470+0000 7f5b7ab17640 1 -- 172.21.15.3:0/1078940661 wait complete. 2023-05-17T11:46:16.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:16.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 Processor -- start 2023-05-17T11:46:16.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 -- start start 2023-05-17T11:46:16.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f47f40cec30 0x7f47f40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47f40cf090 0x7f47f40cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f415c760 con 0x7f47f406d940 2023-05-17T11:46:16.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40cdf60 con 0x7f47f40cec30 2023-05-17T11:46:16.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fbd25640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40cc860 con 0x7f47f40cf090 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f47f40cec30 0x7f47f40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f47f40cec30 0x7f47f40cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36720/0 (socket says 172.21.15.3:36720) 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 -- 172.21.15.3:0/3901108004 learned_addr learned my addr 172.21.15.3:0/3901108004 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47fa2c2640 1 --2- 172.21.15.3:0/3901108004 >> v2:172.21.15.60:3300/0 conn(0x7f47f40cf090 0x7f47f40cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 -- 172.21.15.3:0/3901108004 >> v2:172.21.15.60:3300/0 conn(0x7f47f40cf090 msgr2=0x7f47f40cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 --2- 172.21.15.3:0/3901108004 >> v2:172.21.15.60:3300/0 conn(0x7f47f40cf090 0x7f47f40cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 -- 172.21.15.3:0/3901108004 >> v1:172.21.15.60:6789/0 conn(0x7f47f406d940 legacy=0x7f47f406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.630+0000 7f47f92c0640 1 -- 172.21.15.3:0/3901108004 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40ccd40 con 0x7f47f40cec30 2023-05-17T11:46:16.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47f92c0640 1 --2- 172.21.15.3:0/3901108004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f40cec30 0x7f47f40cbde0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c2f60 tx=0x7f47e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5aea003c05ec2a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47f8abf640 1 -- 172.21.15.3:0/3901108004 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40aa430 con 0x7f47f40cec30 2023-05-17T11:46:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47f8abf640 1 -- 172.21.15.3:0/3901108004 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40aa590 con 0x7f47f40cec30 2023-05-17T11:46:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47f8abf640 1 -- 172.21.15.3:0/3901108004 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40aa920 con 0x7f47f40cec30 2023-05-17T11:46:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 -- 172.21.15.3:0/3901108004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f40cec30 msgr2=0x7f47f40cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 --2- 172.21.15.3:0/3901108004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f40cec30 0x7f47f40cbde0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c2f60 tx=0x7f47e401c4d0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 -- 172.21.15.3:0/3901108004 shutdown_connections 2023-05-17T11:46:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 --2- 172.21.15.3:0/3901108004 >> v2:172.21.15.60:3300/0 conn(0x7f47f40cf090 0x7f47f40cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 --2- 172.21.15.3:0/3901108004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f40cec30 0x7f47f40cbde0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 -- 172.21.15.3:0/3901108004 >> 172.21.15.3:0/3901108004 conn(0x7f47f406b4e0 msgr2=0x7f47f40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 -- 172.21.15.3:0/3901108004 shutdown_connections 2023-05-17T11:46:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.634+0000 7f47fbd25640 1 -- 172.21.15.3:0/3901108004 wait complete. 2023-05-17T11:46:16.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 Processor -- start 2023-05-17T11:46:16.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- start start 2023-05-17T11:46:16.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 0x7f47f40c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47f40cec30 0x7f47f41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f47f40cf090 0x7f47f40b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c8870 con 0x7f47f406d940 2023-05-17T11:46:16.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4156c60 con 0x7f47f40cec30 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c8aa0 con 0x7f47f40cf090 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 0x7f47f40c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 0x7f47f40c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36726/0 (socket says 172.21.15.3:36726) 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 -- 172.21.15.3:0/2556273947 learned_addr learned my addr 172.21.15.3:0/2556273947 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f92c0640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47f40cec30 0x7f47f41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fa2c2640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f47f40cf090 0x7f47f40b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 -- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f47f40cf090 msgr2=0x7f47f40b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f47f40cf090 0x7f47f40b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 -- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47f40cec30 msgr2=0x7f47f41559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47f40cec30 0x7f47f41559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 -- 172.21.15.3:0/2556273947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40094d0 con 0x7f47f406d940 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f92c0640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47f40cec30 0x7f47f41559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fa2c2640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f47f40cf090 0x7f47f40b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:16.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47f9ac1640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 0x7f47f40c8330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f47f000c500 tx=0x7f47f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0005220 con 0x7f47f406d940 2023-05-17T11:46:16.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0005380 con 0x7f47f406d940 2023-05-17T11:46:16.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f40ce710 con 0x7f47f406d940 2023-05-17T11:46:16.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0007270 con 0x7f47f406d940 2023-05-17T11:46:16.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40ce430 con 0x7f47f406d940 2023-05-17T11:46:16.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.638+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f40aeb70 con 0x7f47f406d940 2023-05-17T11:46:16.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.642+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47f00073d0 con 0x7f47f406d940 2023-05-17T11:46:16.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.642+0000 7f47ea7fc640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f47d8066280 0x7f47d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.642+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f47f00836e0 con 0x7f47f406d940 2023-05-17T11:46:16.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.642+0000 7f47f92c0640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f47d8066280 0x7f47d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.642+0000 7f47f92c0640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f47d8066280 0x7f47d8068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47e40ae000 tx=0x7f47e40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.646+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f47f0050a90 con 0x7f47f406d940 2023-05-17T11:46:16.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.802+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47f404de80 con 0x7f47f406d940 2023-05-17T11:46:16.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.802+0000 7f47ea7fc640 1 -- 172.21.15.3:0/2556273947 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47f00540b0 con 0x7f47f406d940 2023-05-17T11:46:16.813 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f47d8066280 msgr2=0x7f47d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f47d8066280 0x7f47d8068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47e40ae000 tx=0x7f47e40a7000 comp rx=0 tx=0).stop 2023-05-17T11:46:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 msgr2=0x7f47f40c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 0x7f47f40c8330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f47f000c500 tx=0x7f47f000c9c0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 shutdown_connections 2023-05-17T11:46:16.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f47d8066280 0x7f47d8068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f47f40cf090 0x7f47f40b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47f40cec30 0x7f47f41559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 --2- 172.21.15.3:0/2556273947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f406d940 0x7f47f40c8330 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 >> 172.21.15.3:0/2556273947 conn(0x7f47f406b4e0 msgr2=0x7f47f40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 shutdown_connections 2023-05-17T11:46:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.806+0000 7f47fbd25640 1 -- 172.21.15.3:0/2556273947 wait complete. 2023-05-17T11:46:16.833 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:16.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 Processor -- start 2023-05-17T11:46:16.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 -- start start 2023-05-17T11:46:16.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8040156460 0x7f804015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f804006e7d0 0x7f804006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006cd20 0x7f80400ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804006d1a0 con 0x7f8040156460 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804015cb00 con 0x7f804006e7d0 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f80471f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804015cde0 con 0x7f804006cd20 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f8044f8c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8040156460 0x7f804015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f8044f8c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8040156460 0x7f804015c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36736/0 (socket says 172.21.15.3:36736) 2023-05-17T11:46:16.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f8044f8c640 1 -- 172.21.15.3:0/4257820805 learned_addr learned my addr 172.21.15.3:0/4257820805 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:16.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f804578d640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006cd20 0x7f80400ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f803ffff640 1 --2- 172.21.15.3:0/4257820805 >> v2:172.21.15.60:3300/0 conn(0x7f804006e7d0 0x7f804006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.962+0000 7f8044f8c640 1 -- 172.21.15.3:0/4257820805 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006cd20 msgr2=0x7f80400ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:16.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f8044f8c640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006cd20 0x7f80400ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f8044f8c640 1 -- 172.21.15.3:0/4257820805 >> v2:172.21.15.60:3300/0 conn(0x7f804006e7d0 msgr2=0x7f804006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:16.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f8044f8c640 1 --2- 172.21.15.3:0/4257820805 >> v2:172.21.15.60:3300/0 conn(0x7f804006e7d0 0x7f804006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f8044f8c640 1 -- 172.21.15.3:0/4257820805 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804015d0c0 con 0x7f8040156460 2023-05-17T11:46:16.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f804578d640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006cd20 0x7f80400ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:16.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f8044f8c640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f804015c4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8034009870 tx=0x7f803401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fca18db7b575f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f803f7fe640 1 -- 172.21.15.3:0/4257820805 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340ab680 con 0x7f8040156460 2023-05-17T11:46:16.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f803f7fe640 1 -- 172.21.15.3:0/4257820805 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80340ab7e0 con 0x7f8040156460 2023-05-17T11:46:16.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f803f7fe640 1 -- 172.21.15.3:0/4257820805 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340abb70 con 0x7f8040156460 2023-05-17T11:46:16.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 -- 172.21.15.3:0/4257820805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 msgr2=0x7f804015c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f804015c4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8034009870 tx=0x7f803401c500 comp rx=0 tx=0).stop 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 -- 172.21.15.3:0/4257820805 shutdown_connections 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006cd20 0x7f80400ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 --2- 172.21.15.3:0/4257820805 >> v2:172.21.15.60:3300/0 conn(0x7f804006e7d0 0x7f804006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 --2- 172.21.15.3:0/4257820805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f804015c4b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.966+0000 7f80471f0640 1 -- 172.21.15.3:0/4257820805 >> 172.21.15.3:0/4257820805 conn(0x7f80400b14a0 msgr2=0x7f80400cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- 172.21.15.3:0/4257820805 shutdown_connections 2023-05-17T11:46:16.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- 172.21.15.3:0/4257820805 wait complete. 2023-05-17T11:46:16.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 Processor -- start 2023-05-17T11:46:16.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- start start 2023-05-17T11:46:16.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804006cd20 0x7f8040144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006e7d0 0x7f804015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f80401415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804014ce40 con 0x7f8040156460 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804015f9a0 con 0x7f804006cd20 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8040160490 con 0x7f804006e7d0 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f80401415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f80401415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36752/0 (socket says 172.21.15.3:36752) 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 -- 172.21.15.3:0/4126397327 learned_addr learned my addr 172.21.15.3:0/4126397327 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f8044f8c640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804006cd20 0x7f8040144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f803ffff640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006e7d0 0x7f804015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 -- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006e7d0 msgr2=0x7f804015fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006e7d0 0x7f804015fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 -- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804006cd20 msgr2=0x7f8040144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804006cd20 0x7f8040144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 -- 172.21.15.3:0/4126397327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340094d0 con 0x7f8040156460 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f803ffff640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006e7d0 0x7f804015fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f804578d640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f80401415d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8038007de0 tx=0x7f803800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80380039a0 con 0x7f8040156460 2023-05-17T11:46:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803800f040 con 0x7f8040156460 2023-05-17T11:46:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8038003d60 con 0x7f8040156460 2023-05-17T11:46:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.970+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80401569c0 con 0x7f8040156460 2023-05-17T11:46:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8040156830 con 0x7f8040156460 2023-05-17T11:46:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80400ae440 con 0x7f8040156460 2023-05-17T11:46:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8038004030 con 0x7f8040156460 2023-05-17T11:46:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f803d7fa640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8024066280 0x7f8024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8038084080 con 0x7f8040156460 2023-05-17T11:46:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f8044f8c640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8024066280 0x7f8024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.974+0000 7f8044f8c640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8024066280 0x7f8024068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80340af000 tx=0x7f80340b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:16.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:16.978+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f80380b46f0 con 0x7f8040156460 2023-05-17T11:46:17.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.134+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f804014cf80 con 0x7f8040156460 2023-05-17T11:46:17.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f803d7fa640 1 -- 172.21.15.3:0/4126397327 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f804014cf80 con 0x7f8040156460 2023-05-17T11:46:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8024066280 msgr2=0x7f8024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8024066280 0x7f8024068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80340af000 tx=0x7f80340b6040 comp rx=0 tx=0).stop 2023-05-17T11:46:17.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 msgr2=0x7f80401415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f80401415d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8038007de0 tx=0x7f803800d4a0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 shutdown_connections 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8024066280 0x7f8024068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8040156460 0x7f80401415d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f804006e7d0 0x7f804015fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 --2- 172.21.15.3:0/4126397327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804006cd20 0x7f8040144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 >> 172.21.15.3:0/4126397327 conn(0x7f80400b14a0 msgr2=0x7f80400ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:17.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 shutdown_connections 2023-05-17T11:46:17.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.138+0000 7f80471f0640 1 -- 172.21.15.3:0/4126397327 wait complete. 2023-05-17T11:46:17.167 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.294+0000 7feffecf2640 1 Processor -- start 2023-05-17T11:46:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.294+0000 7feffecf2640 1 -- start start 2023-05-17T11:46:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffecf2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feff80ca710 0x7feff80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffecf2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff8070220 0x7feff80706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffecf2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80c8a30 con 0x7feff80ad8a0 2023-05-17T11:46:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffecf2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff80adc70 con 0x7feff80ca710 2023-05-17T11:46:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffecf2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff80cab40 con 0x7feff8070220 2023-05-17T11:46:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffca8e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7feff80ad8a0 0x7feff80b1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50390/0 (socket says 172.21.15.3:50390) 2023-05-17T11:46:17.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffca8e640 1 -- 172.21.15.3:0/4232923062 learned_addr learned my addr 172.21.15.3:0/4232923062 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffd28f640 1 --2- 172.21.15.3:0/4232923062 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff8070220 0x7feff80706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feff7fff640 1 --2- 172.21.15.3:0/4232923062 >> v2:172.21.15.60:3300/0 conn(0x7feff80ca710 0x7feff80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feff77fe640 1 -- 172.21.15.3:0/4232923062 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693983320 0 0) 0x7feff80c8a30 con 0x7feff80ad8a0 2023-05-17T11:46:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feff77fe640 1 -- 172.21.15.3:0/4232923062 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe8003530 con 0x7feff80ad8a0 2023-05-17T11:46:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffd28f640 1 -- 172.21.15.3:0/4232923062 >> v2:172.21.15.60:3300/0 conn(0x7feff80ca710 msgr2=0x7feff80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffd28f640 1 --2- 172.21.15.3:0/4232923062 >> v2:172.21.15.60:3300/0 conn(0x7feff80ca710 0x7feff80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffd28f640 1 -- 172.21.15.3:0/4232923062 >> v1:172.21.15.3:6789/0 conn(0x7feff80ad8a0 legacy=0x7feff80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feff77fe640 1 -- 172.21.15.3:0/4232923062 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2016907484 0 0) 0x7fefe8003530 con 0x7feff80ad8a0 2023-05-17T11:46:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.298+0000 7feffd28f640 1 -- 172.21.15.3:0/4232923062 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80cbcf0 con 0x7feff8070220 2023-05-17T11:46:17.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffd28f640 1 --2- 172.21.15.3:0/4232923062 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff8070220 0x7feff80706a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feff0009d90 tx=0x7feff001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c34d3b1e79970b23 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:17.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feff77fe640 1 -- 172.21.15.3:0/4232923062 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec001800 con 0x7feff8070220 2023-05-17T11:46:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feff77fe640 1 -- 172.21.15.3:0/4232923062 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00a5640 con 0x7feff8070220 2023-05-17T11:46:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feff77fe640 1 -- 172.21.15.3:0/4232923062 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00a59b0 con 0x7feff8070220 2023-05-17T11:46:17.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 -- 172.21.15.3:0/4232923062 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff8070220 msgr2=0x7feff80706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 --2- 172.21.15.3:0/4232923062 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff8070220 0x7feff80706a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feff0009d90 tx=0x7feff001c840 comp rx=0 tx=0).stop 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 -- 172.21.15.3:0/4232923062 shutdown_connections 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 --2- 172.21.15.3:0/4232923062 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff8070220 0x7feff80706a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 --2- 172.21.15.3:0/4232923062 >> v2:172.21.15.60:3300/0 conn(0x7feff80ca710 0x7feff80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 -- 172.21.15.3:0/4232923062 >> 172.21.15.3:0/4232923062 conn(0x7feff80b0b20 msgr2=0x7feff80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 -- 172.21.15.3:0/4232923062 shutdown_connections 2023-05-17T11:46:17.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 -- 172.21.15.3:0/4232923062 wait complete. 2023-05-17T11:46:17.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 Processor -- start 2023-05-17T11:46:17.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.302+0000 7feffecf2640 1 -- start start 2023-05-17T11:46:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff8070220 0x7feff81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 0x7feff8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff80ca710 0x7feff80c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8157160 con 0x7feff80ad8a0 2023-05-17T11:46:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8156e80 con 0x7feff8070220 2023-05-17T11:46:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff8154e50 con 0x7feff80ca710 2023-05-17T11:46:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 0x7feff8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 0x7feff8155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36760/0 (socket says 172.21.15.3:36760) 2023-05-17T11:46:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 -- 172.21.15.3:0/3769299339 learned_addr learned my addr 172.21.15.3:0/3769299339 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 -- 172.21.15.3:0/3769299339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff80ca710 msgr2=0x7feff80c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff80ca710 0x7feff80c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 -- 172.21.15.3:0/3769299339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff8070220 msgr2=0x7feff81560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff8070220 0x7feff81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 -- 172.21.15.3:0/3769299339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009a70 con 0x7feff80ad8a0 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff7fff640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 0x7feff8155910 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fefe400e930 tx=0x7fefe400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4009690 con 0x7feff80ad8a0 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe400ca00 con 0x7feff80ad8a0 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff80c9240 con 0x7feff80ad8a0 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe400cd70 con 0x7feff80ad8a0 2023-05-17T11:46:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff806fd00 con 0x7feff80ad8a0 2023-05-17T11:46:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff80b1e80 con 0x7feff80ad8a0 2023-05-17T11:46:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.306+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefe4013470 con 0x7feff80ad8a0 2023-05-17T11:46:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.310+0000 7feff57fa640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefdc066280 0x7fefdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.310+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fefe4083fa0 con 0x7feff80ad8a0 2023-05-17T11:46:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.310+0000 7feffca8e640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefdc066280 0x7fefdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.310+0000 7feffca8e640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefdc066280 0x7fefdc068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fefec007820 tx=0x7fefec0012f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.314+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fefe4051490 con 0x7feff80ad8a0 2023-05-17T11:46:17.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feff8071f20 con 0x7feff80ad8a0 2023-05-17T11:46:17.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feff57fa640 1 -- 172.21.15.3:0/3769299339 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fefe4017080 con 0x7feff80ad8a0 2023-05-17T11:46:17.492 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:17.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefdc066280 msgr2=0x7fefdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefdc066280 0x7fefdc068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fefec007820 tx=0x7fefec0012f0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 msgr2=0x7feff8155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 0x7feff8155910 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fefe400e930 tx=0x7fefe400edf0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 shutdown_connections 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fefdc066280 0x7fefdc068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7feff80ca710 0x7feff80c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feff80ad8a0 0x7feff8155910 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 --2- 172.21.15.3:0/3769299339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff8070220 0x7feff81560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 >> 172.21.15.3:0/3769299339 conn(0x7feff80b0b20 msgr2=0x7feff80b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:17.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 shutdown_connections 2023-05-17T11:46:17.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.482+0000 7feffecf2640 1 -- 172.21.15.3:0/3769299339 wait complete. 2023-05-17T11:46:17.512 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi060.front.sepia.ceph.com... 2023-05-17T11:46:17.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:17.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-17T11:46:17.548 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:17.548 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:46:17.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:17.549 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-17T11:46:17.600 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:46:17.600 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:17.608 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:46:17.608 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:17.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 Processor -- start 2023-05-17T11:46:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 -- start start 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcde4158f10 0x7fcde4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4071c10 0x7fcde40cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcde40cc4c0 0x7fcde406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40c92f0 con 0x7fcde4158f10 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde4071480 con 0x7fcde40cc4c0 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde9f6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40c8a00 con 0x7fcde4071c10 2023-05-17T11:46:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde37fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcde4158f10 0x7fcde4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde37fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcde4158f10 0x7fcde4070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36774/0 (socket says 172.21.15.3:36774) 2023-05-17T11:46:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde37fe640 1 -- 172.21.15.3:0/3613793951 learned_addr learned my addr 172.21.15.3:0/3613793951 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde3fff640 1 --2- 172.21.15.3:0/3613793951 >> v2:172.21.15.60:3300/0 conn(0x7fcde40cc4c0 0x7fcde406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.826+0000 7fcde2ffd640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4071c10 0x7fcde40cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde37fe640 1 -- 172.21.15.3:0/3613793951 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4071c10 msgr2=0x7fcde40cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde37fe640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4071c10 0x7fcde40cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde37fe640 1 -- 172.21.15.3:0/3613793951 >> v2:172.21.15.60:3300/0 conn(0x7fcde40cc4c0 msgr2=0x7fcde406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde37fe640 1 --2- 172.21.15.3:0/3613793951 >> v2:172.21.15.60:3300/0 conn(0x7fcde40cc4c0 0x7fcde406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde37fe640 1 -- 172.21.15.3:0/3613793951 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40716e0 con 0x7fcde4158f10 2023-05-17T11:46:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde2ffd640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4071c10 0x7fcde40cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde37fe640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4158f10 0x7fcde4070f40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcde406e040 tx=0x7fcdd401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c760594befa51ec server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde27fc640 1 -- 172.21.15.3:0/3613793951 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40ab600 con 0x7fcde4158f10 2023-05-17T11:46:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde27fc640 1 -- 172.21.15.3:0/3613793951 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd40a7050 con 0x7fcde4158f10 2023-05-17T11:46:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde27fc640 1 -- 172.21.15.3:0/3613793951 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40ab980 con 0x7fcde4158f10 2023-05-17T11:46:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 -- 172.21.15.3:0/3613793951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4158f10 msgr2=0x7fcde4070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4158f10 0x7fcde4070f40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcde406e040 tx=0x7fcdd401c500 comp rx=0 tx=0).stop 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 -- 172.21.15.3:0/3613793951 shutdown_connections 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/3613793951 >> v2:172.21.15.60:3300/0 conn(0x7fcde40cc4c0 0x7fcde406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4071c10 0x7fcde40cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/3613793951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4158f10 0x7fcde4070f40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 -- 172.21.15.3:0/3613793951 >> 172.21.15.3:0/3613793951 conn(0x7fcde40b0b30 msgr2=0x7fcde40cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 -- 172.21.15.3:0/3613793951 shutdown_connections 2023-05-17T11:46:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.830+0000 7fcde9f6d640 1 -- 172.21.15.3:0/3613793951 wait complete. 2023-05-17T11:46:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 Processor -- start 2023-05-17T11:46:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 -- start start 2023-05-17T11:46:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 0x7fcde4143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40cc4c0 0x7fcde4150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4158f10 0x7fcde414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde414f360 con 0x7fcde4071c10 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde414f5b0 con 0x7fcde40cc4c0 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde414f890 con 0x7fcde4158f10 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 0x7fcde4143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 0x7fcde4143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36782/0 (socket says 172.21.15.3:36782) 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 -- 172.21.15.3:0/2915718621 learned_addr learned my addr 172.21.15.3:0/2915718621 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde2ffd640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40cc4c0 0x7fcde4150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde3fff640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4158f10 0x7fcde414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 -- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4158f10 msgr2=0x7fcde414b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4158f10 0x7fcde414b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 -- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40cc4c0 msgr2=0x7fcde4150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40cc4c0 0x7fcde4150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 -- 172.21.15.3:0/2915718621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40094d0 con 0x7fcde4071c10 2023-05-17T11:46:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde37fe640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 0x7fcde4143670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40ae040 tx=0x7fcdd40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40abb00 con 0x7fcde4071c10 2023-05-17T11:46:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd40abc80 con 0x7fcde4071c10 2023-05-17T11:46:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40b4440 con 0x7fcde4071c10 2023-05-17T11:46:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde415c920 con 0x7fcde4071c10 2023-05-17T11:46:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.834+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde406c580 con 0x7fcde4071c10 2023-05-17T11:46:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.838+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde415cab0 con 0x7fcde4071c10 2023-05-17T11:46:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.838+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdd40b2070 con 0x7fcde4071c10 2023-05-17T11:46:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.838+0000 7fcdcbfff640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcdd0066280 0x7fcdd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.838+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcdd411d810 con 0x7fcde4071c10 2023-05-17T11:46:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.838+0000 7fcde2ffd640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcdd0066280 0x7fcdd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.838+0000 7fcde2ffd640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcdd0066280 0x7fcdd0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcde40cdfc0 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.842+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcdd40eac40 con 0x7fcde4071c10 2023-05-17T11:46:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.998+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcde404de80 con 0x7fcde4071c10 2023-05-17T11:46:18.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:17.998+0000 7fcdcbfff640 1 -- 172.21.15.3:0/2915718621 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7fcdd40ee260 con 0x7fcde4071c10 2023-05-17T11:46:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:18.009 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:18.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcdd0066280 msgr2=0x7fcdd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcdd0066280 0x7fcdd0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcde40cdfc0 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2023-05-17T11:46:18.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 msgr2=0x7fcde4143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 0x7fcde4143670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40ae040 tx=0x7fcdd40192a0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 shutdown_connections 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcdd0066280 0x7fcdd0068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcde4158f10 0x7fcde414b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40cc4c0 0x7fcde4150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 --2- 172.21.15.3:0/2915718621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcde4071c10 0x7fcde4143670 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 >> 172.21.15.3:0/2915718621 conn(0x7fcde40b0b30 msgr2=0x7fcde40ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 shutdown_connections 2023-05-17T11:46:18.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.002+0000 7fcde9f6d640 1 -- 172.21.15.3:0/2915718621 wait complete. 2023-05-17T11:46:18.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:18.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:18.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 Processor -- start 2023-05-17T11:46:18.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 -- start start 2023-05-17T11:46:18.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6500b2950 0x7fb65009bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6500ad760 0x7fb6500cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500cddf0 0x7fb6500c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500adbc0 con 0x7fb6500b2950 2023-05-17T11:46:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65006d020 con 0x7fb6500ad760 2023-05-17T11:46:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb655020640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500b2d20 con 0x7fb6500cddf0 2023-05-17T11:46:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6500b2950 0x7fb65009bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6500b2950 0x7fb65009bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36798/0 (socket says 172.21.15.3:36798) 2023-05-17T11:46:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 -- 172.21.15.3:0/4217703975 learned_addr learned my addr 172.21.15.3:0/4217703975 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb647fff640 1 --2- 172.21.15.3:0/4217703975 >> v2:172.21.15.60:3300/0 conn(0x7fb6500ad760 0x7fb6500cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64f59e640 1 --2- 172.21.15.3:0/4217703975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500cddf0 0x7fb6500c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 -- 172.21.15.3:0/4217703975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500cddf0 msgr2=0x7fb6500c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 --2- 172.21.15.3:0/4217703975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500cddf0 0x7fb6500c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 -- 172.21.15.3:0/4217703975 >> v2:172.21.15.60:3300/0 conn(0x7fb6500ad760 msgr2=0x7fb6500cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 --2- 172.21.15.3:0/4217703975 >> v2:172.21.15.60:3300/0 conn(0x7fb6500ad760 0x7fb6500cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.162+0000 7fb64ed9d640 1 -- 172.21.15.3:0/4217703975 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6501591b0 con 0x7fb6500b2950 2023-05-17T11:46:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb64ed9d640 1 --2- 172.21.15.3:0/4217703975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb65009bd90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb65006f5d0 tx=0x7fb64001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd1c2b7c94a49bb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb64e59c640 1 -- 172.21.15.3:0/4217703975 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400ab600 con 0x7fb6500b2950 2023-05-17T11:46:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb64e59c640 1 -- 172.21.15.3:0/4217703975 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6400a7050 con 0x7fb6500b2950 2023-05-17T11:46:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb64e59c640 1 -- 172.21.15.3:0/4217703975 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400ab980 con 0x7fb6500b2950 2023-05-17T11:46:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 -- 172.21.15.3:0/4217703975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 msgr2=0x7fb65009bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 --2- 172.21.15.3:0/4217703975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb65009bd90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb65006f5d0 tx=0x7fb64001c210 comp rx=0 tx=0).stop 2023-05-17T11:46:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 -- 172.21.15.3:0/4217703975 shutdown_connections 2023-05-17T11:46:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 --2- 172.21.15.3:0/4217703975 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500cddf0 0x7fb6500c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 --2- 172.21.15.3:0/4217703975 >> v2:172.21.15.60:3300/0 conn(0x7fb6500ad760 0x7fb6500cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 --2- 172.21.15.3:0/4217703975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb65009bd90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 -- 172.21.15.3:0/4217703975 >> 172.21.15.3:0/4217703975 conn(0x7fb65006a740 msgr2=0x7fb6500cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 -- 172.21.15.3:0/4217703975 shutdown_connections 2023-05-17T11:46:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.166+0000 7fb655020640 1 -- 172.21.15.3:0/4217703975 wait complete. 2023-05-17T11:46:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 Processor -- start 2023-05-17T11:46:18.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 -- start start 2023-05-17T11:46:18.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500ad760 0x7fb65009af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb6500ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6500cddf0 0x7fb6501f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65009aab0 con 0x7fb6500b2950 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65009b480 con 0x7fb6500cddf0 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb650099ea0 con 0x7fb6500ad760 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb6500ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb6500ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36802/0 (socket says 172.21.15.3:36802) 2023-05-17T11:46:18.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 -- 172.21.15.3:0/3000236837 learned_addr learned my addr 172.21.15.3:0/3000236837 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:18.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 -- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500ad760 msgr2=0x7fb65009af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500ad760 0x7fb65009af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb64f59e640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6500cddf0 0x7fb6501f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 -- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6500cddf0 msgr2=0x7fb6501f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6500cddf0 0x7fb6501f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 -- 172.21.15.3:0/3000236837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400094d0 con 0x7fb6500b2950 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb64f59e640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6500cddf0 0x7fb6501f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:18.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb647fff640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb6500ae890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e930 tx=0x7fb63800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638009690 con 0x7fb6500b2950 2023-05-17T11:46:18.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800ca00 con 0x7fb6500b2950 2023-05-17T11:46:18.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800cd70 con 0x7fb6500b2950 2023-05-17T11:46:18.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6500cc380 con 0x7fb6500b2950 2023-05-17T11:46:18.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.170+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65006d4b0 con 0x7fb6500b2950 2023-05-17T11:46:18.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.174+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6500cb8d0 con 0x7fb6500b2950 2023-05-17T11:46:18.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.174+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb638013470 con 0x7fb6500b2950 2023-05-17T11:46:18.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.174+0000 7fb6477fe640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb6300662b0 0x7fb630068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.174+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb638083fe0 con 0x7fb6500b2950 2023-05-17T11:46:18.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.174+0000 7fb64ed9d640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb6300662b0 0x7fb630068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.174+0000 7fb64ed9d640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb6300662b0 0x7fb630068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ad000 tx=0x7fb640004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.178+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb6380514a0 con 0x7fb6500b2950 2023-05-17T11:46:18.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.334+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb65004de80 con 0x7fb6500b2950 2023-05-17T11:46:18.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.334+0000 7fb6477fe640 1 -- 172.21.15.3:0/3000236837 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb638054ac0 con 0x7fb6500b2950 2023-05-17T11:46:18.345 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:18.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb6300662b0 msgr2=0x7fb630068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb6300662b0 0x7fb630068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ad000 tx=0x7fb640004740 comp rx=0 tx=0).stop 2023-05-17T11:46:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 msgr2=0x7fb6500ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb6500ae890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e930 tx=0x7fb63800edf0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 shutdown_connections 2023-05-17T11:46:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb6300662b0 0x7fb630068760 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6500cddf0 0x7fb6501f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6500b2950 0x7fb6500ae890 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 --2- 172.21.15.3:0/3000236837 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb6500ad760 0x7fb65009af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 >> 172.21.15.3:0/3000236837 conn(0x7fb65006a740 msgr2=0x7fb6500ac090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 shutdown_connections 2023-05-17T11:46:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.338+0000 7fb655020640 1 -- 172.21.15.3:0/3000236837 wait complete. 2023-05-17T11:46:18.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:18.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.494+0000 7f6406f60640 1 Processor -- start 2023-05-17T11:46:18.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.494+0000 7f6406f60640 1 -- start start 2023-05-17T11:46:18.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f6406f60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f640009bd90 0x7f64000ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f6406f60640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640006d020 con 0x7f640006b4d0 2023-05-17T11:46:18.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f6406f60640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000b2d20 con 0x7f64000b2950 2023-05-17T11:46:18.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f6406f60640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64001591b0 con 0x7f640009bd90 2023-05-17T11:46:18.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f64054fd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f640006b4d0 0x7f640006b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50404/0 (socket says 172.21.15.3:50404) 2023-05-17T11:46:18.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f63fffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f640009bd90 0x7f64000ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f64054fd640 1 -- 172.21.15.3:0/351563203 learned_addr learned my addr 172.21.15.3:0/351563203 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:18.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f63fffff640 1 -- 172.21.15.3:0/351563203 >> v1:172.21.15.60:6789/0 conn(0x7f64000b2950 legacy=0x7f64000cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f63fffff640 1 -- 172.21.15.3:0/351563203 >> v1:172.21.15.3:6789/0 conn(0x7f640006b4d0 legacy=0x7f640006b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f63fffff640 1 -- 172.21.15.3:0/351563203 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000cc0a0 con 0x7f640009bd90 2023-05-17T11:46:18.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f63ff7fe640 1 -- 172.21.15.3:0/351563203 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188228006 0 0) 0x7f640006d020 con 0x7f640006b4d0 2023-05-17T11:46:18.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.498+0000 7f63fffff640 1 --2- 172.21.15.3:0/351563203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640009bd90 0x7f64000ad760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009740 tx=0x7f63ec01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed67aac2ac61ca6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f63ff7fe640 1 -- 172.21.15.3:0/351563203 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0ab600 con 0x7f640009bd90 2023-05-17T11:46:18.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f63ff7fe640 1 -- 172.21.15.3:0/351563203 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec0a7050 con 0x7f640009bd90 2023-05-17T11:46:18.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f63ff7fe640 1 -- 172.21.15.3:0/351563203 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0ab980 con 0x7f640009bd90 2023-05-17T11:46:18.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- 172.21.15.3:0/351563203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640009bd90 msgr2=0x7f64000ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 --2- 172.21.15.3:0/351563203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640009bd90 0x7f64000ad760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009740 tx=0x7f63ec01c280 comp rx=0 tx=0).stop 2023-05-17T11:46:18.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- 172.21.15.3:0/351563203 shutdown_connections 2023-05-17T11:46:18.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 --2- 172.21.15.3:0/351563203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640009bd90 0x7f64000ad760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- 172.21.15.3:0/351563203 >> 172.21.15.3:0/351563203 conn(0x7f640006a740 msgr2=0x7f64000cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:18.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- 172.21.15.3:0/351563203 shutdown_connections 2023-05-17T11:46:18.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- 172.21.15.3:0/351563203 wait complete. 2023-05-17T11:46:18.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 Processor -- start 2023-05-17T11:46:18.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- start start 2023-05-17T11:46:18.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 0x7f64000c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f640009bd90 0x7f640015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64000b2950 0x7f64001537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640015c160 con 0x7f640006b4d0 2023-05-17T11:46:18.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c34a0 con 0x7f64000b2950 2023-05-17T11:46:18.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.502+0000 7f6406f60640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c3780 con 0x7f640009bd90 2023-05-17T11:46:18.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 0x7f64000c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 0x7f64000c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36816/0 (socket says 172.21.15.3:36816) 2023-05-17T11:46:18.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 -- 172.21.15.3:0/3166002876 learned_addr learned my addr 172.21.15.3:0/3166002876 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:18.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f63fffff640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f640009bd90 0x7f640015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f64054fd640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64000b2950 0x7f64001537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 -- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f640009bd90 msgr2=0x7f640015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f640009bd90 0x7f640015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 -- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64000b2950 msgr2=0x7f64001537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64000b2950 0x7f64001537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 -- 172.21.15.3:0/3166002876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec009420 con 0x7f640006b4d0 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f64054fd640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64000b2950 0x7f64001537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:18.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6404cfc640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 0x7f64000c4540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c540 tx=0x7f63f400ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4005480 con 0x7f640006b4d0 2023-05-17T11:46:18.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4003600 con 0x7f640006b4d0 2023-05-17T11:46:18.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000cb8d0 con 0x7f640006b4d0 2023-05-17T11:46:18.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40039b0 con 0x7f640006b4d0 2023-05-17T11:46:18.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000cc380 con 0x7f640006b4d0 2023-05-17T11:46:18.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64000cdfc0 con 0x7f640006b4d0 2023-05-17T11:46:18.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.506+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63f4003b10 con 0x7f640006b4d0 2023-05-17T11:46:18.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.510+0000 7f63fd7fa640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f63e4066280 0x7f63e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.510+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f63f40833f0 con 0x7f640006b4d0 2023-05-17T11:46:18.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.510+0000 7f63fffff640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f63e4066280 0x7f63e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.510+0000 7f63fffff640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f63e4066280 0x7f63e4068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0ad000 tx=0x7f63ec0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.510+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f63f4050820 con 0x7f640006b4d0 2023-05-17T11:46:18.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f640004de80 con 0x7f640006b4d0 2023-05-17T11:46:18.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f63fd7fa640 1 -- 172.21.15.3:0/3166002876 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63f4001240 con 0x7f640006b4d0 2023-05-17T11:46:18.676 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:18.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f63e4066280 msgr2=0x7f63e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f63e4066280 0x7f63e4068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0ad000 tx=0x7f63ec0a6000 comp rx=0 tx=0).stop 2023-05-17T11:46:18.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 msgr2=0x7f64000c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 0x7f64000c4540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c540 tx=0x7f63f400ca00 comp rx=0 tx=0).stop 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 shutdown_connections 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f63e4066280 0x7f63e4068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64000b2950 0x7f64001537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f640009bd90 0x7f640015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 --2- 172.21.15.3:0/3166002876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f640006b4d0 0x7f64000c4540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 >> 172.21.15.3:0/3166002876 conn(0x7f640006a740 msgr2=0x7f6400155480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 shutdown_connections 2023-05-17T11:46:18.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.666+0000 7f6406f60640 1 -- 172.21.15.3:0/3166002876 wait complete. 2023-05-17T11:46:18.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.826+0000 7fd41b7c0640 1 Processor -- start 2023-05-17T11:46:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.826+0000 7fd41b7c0640 1 -- start start 2023-05-17T11:46:18.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41b7c0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd4140b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41b7c0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd4140b04c0 0x7fd4140b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41b7c0640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41406ca60 con 0x7fd41415c220 2023-05-17T11:46:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41b7c0640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41406beb0 con 0x7fd4140b04c0 2023-05-17T11:46:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41b7c0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41406c130 con 0x7fd4140ad1a0 2023-05-17T11:46:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41955c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd41415c220 0x7fd4140afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50420/0 (socket says 172.21.15.3:50420) 2023-05-17T11:46:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd41955c640 1 -- 172.21.15.3:0/3407799508 learned_addr learned my addr 172.21.15.3:0/3407799508 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd419d5d640 1 --2- 172.21.15.3:0/3407799508 >> v2:172.21.15.3:3300/0 conn(0x7fd4140b04c0 0x7fd4140b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd418d5b640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd4140b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd40bfff640 1 -- 172.21.15.3:0/3407799508 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071014120 0 0) 0x7fd41406ca60 con 0x7fd41415c220 2023-05-17T11:46:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd40bfff640 1 -- 172.21.15.3:0/3407799508 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd400003530 con 0x7fd41415c220 2023-05-17T11:46:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd419d5d640 1 -- 172.21.15.3:0/3407799508 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 msgr2=0x7fd4140b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd419d5d640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd4140b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd419d5d640 1 -- 172.21.15.3:0/3407799508 >> v1:172.21.15.3:6789/0 conn(0x7fd41415c220 legacy=0x7fd4140afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd419d5d640 1 -- 172.21.15.3:0/3407799508 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41406c410 con 0x7fd4140b04c0 2023-05-17T11:46:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.830+0000 7fd418d5b640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd4140b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd419d5d640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140b17c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009d90 tx=0x7fd40c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd5f4a7480c3630 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd40bfff640 1 -- 172.21.15.3:0/3407799508 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0a58f0 con 0x7fd4140b04c0 2023-05-17T11:46:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd40bfff640 1 -- 172.21.15.3:0/3407799508 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c0a5a50 con 0x7fd4140b04c0 2023-05-17T11:46:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd40bfff640 1 -- 172.21.15.3:0/3407799508 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0a5dc0 con 0x7fd4140b04c0 2023-05-17T11:46:18.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 -- 172.21.15.3:0/3407799508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 msgr2=0x7fd4140b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140b17c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009d90 tx=0x7fd40c01c890 comp rx=0 tx=0).stop 2023-05-17T11:46:18.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 -- 172.21.15.3:0/3407799508 shutdown_connections 2023-05-17T11:46:18.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140b17c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/3407799508 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd4140b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 -- 172.21.15.3:0/3407799508 >> 172.21.15.3:0/3407799508 conn(0x7fd41406a740 msgr2=0x7fd4140cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:18.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 -- 172.21.15.3:0/3407799508 shutdown_connections 2023-05-17T11:46:18.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 -- 172.21.15.3:0/3407799508 wait complete. 2023-05-17T11:46:18.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 Processor -- start 2023-05-17T11:46:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.834+0000 7fd41b7c0640 1 -- start start 2023-05-17T11:46:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd41415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd41415c220 0x7fd4141554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41415a540 con 0x7fd4140b04c0 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414159930 con 0x7fd41415c220 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd414159c10 con 0x7fd4140ad1a0 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36836/0 (socket says 172.21.15.3:36836) 2023-05-17T11:46:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 -- 172.21.15.3:0/2043544906 learned_addr learned my addr 172.21.15.3:0/2043544906 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 -- 172.21.15.3:0/2043544906 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 msgr2=0x7fd41415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd41415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 -- 172.21.15.3:0/2043544906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd41415c220 msgr2=0x7fd4141554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd41415c220 0x7fd4141554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 -- 172.21.15.3:0/2043544906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009a70 con 0x7fd4140b04c0 2023-05-17T11:46:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd418d5b640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140af060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd40400e810 tx=0x7fd40400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400c8d0 con 0x7fd4140b04c0 2023-05-17T11:46:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400ca30 con 0x7fd4140b04c0 2023-05-17T11:46:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd414168dd0 con 0x7fd4140b04c0 2023-05-17T11:46:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400cde0 con 0x7fd4140b04c0 2023-05-17T11:46:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140b2510 con 0x7fd4140b04c0 2023-05-17T11:46:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd414168f60 con 0x7fd4140b04c0 2023-05-17T11:46:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.838+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd404013410 con 0x7fd4140b04c0 2023-05-17T11:46:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.842+0000 7fd409ffb640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd3f8066280 0x7fd3f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.842+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd404083bf0 con 0x7fd4140b04c0 2023-05-17T11:46:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.842+0000 7fd41955c640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd3f8066280 0x7fd3f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:18.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.842+0000 7fd41955c640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd3f8066280 0x7fd3f8068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd410007fd0 tx=0x7fd410007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:18.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.846+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd404051030 con 0x7fd4140b04c0 2023-05-17T11:46:19.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.998+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd41404de80 con 0x7fd4140b04c0 2023-05-17T11:46:19.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:18.998+0000 7fd409ffb640 1 -- 172.21.15.3:0/2043544906 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd404054650 con 0x7fd4140b04c0 2023-05-17T11:46:19.009 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:19.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd3f8066280 msgr2=0x7fd3f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd3f8066280 0x7fd3f8068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd410007fd0 tx=0x7fd410007900 comp rx=0 tx=0).stop 2023-05-17T11:46:19.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 msgr2=0x7fd4140af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140af060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd40400e810 tx=0x7fd40400ecd0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 shutdown_connections 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd3f8066280 0x7fd3f8068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd41415c220 0x7fd4141554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4140b04c0 0x7fd4140af060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 --2- 172.21.15.3:0/2043544906 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd4140ad1a0 0x7fd41415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 >> 172.21.15.3:0/2043544906 conn(0x7fd41406a740 msgr2=0x7fd41415b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:19.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 shutdown_connections 2023-05-17T11:46:19.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.002+0000 7fd41b7c0640 1 -- 172.21.15.3:0/2043544906 wait complete. 2023-05-17T11:46:19.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:19.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.158+0000 7f7397f8f640 1 Processor -- start 2023-05-17T11:46:19.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.158+0000 7f7397f8f640 1 -- start start 2023-05-17T11:46:19.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7397f8f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7390158730 0x7f73900ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7397f8f640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739015c110 con 0x7f73900ca780 2023-05-17T11:46:19.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7397f8f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739015c3f0 con 0x7f73900b04c0 2023-05-17T11:46:19.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7397f8f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739015cd90 con 0x7f7390158730 2023-05-17T11:46:19.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f739552a640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f73900ca780 0x7f73900afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50422/0 (socket says 172.21.15.3:50422) 2023-05-17T11:46:19.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f739552a640 1 -- 172.21.15.3:0/3348424906 learned_addr learned my addr 172.21.15.3:0/3348424906 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:19.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7395d2b640 1 --2- 172.21.15.3:0/3348424906 >> v2:172.21.15.60:3300/0 conn(0x7f7390158730 0x7f73900ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273309553 0 0) 0x7f739015c110 con 0x7f73900ca780 2023-05-17T11:46:19.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f737c003530 con 0x7f73900ca780 2023-05-17T11:46:19.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660719069 0 0) 0x7f739015c3f0 con 0x7f73900b04c0 2023-05-17T11:46:19.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f739015c110 con 0x7f73900b04c0 2023-05-17T11:46:19.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7395d2b640 1 -- 172.21.15.3:0/3348424906 >> v1:172.21.15.60:6789/0 conn(0x7f73900b04c0 legacy=0x7f73900cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7395d2b640 1 -- 172.21.15.3:0/3348424906 >> v1:172.21.15.3:6789/0 conn(0x7f73900ca780 legacy=0x7f73900afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.162+0000 7f7395d2b640 1 -- 172.21.15.3:0/3348424906 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739015c6d0 con 0x7f7390158730 2023-05-17T11:46:19.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7395d2b640 1 --2- 172.21.15.3:0/3348424906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900ad420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f738c0097c0 tx=0x7f738c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e712b3065d0790e4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0ac640 con 0x7f7390158730 2023-05-17T11:46:19.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c0ac7a0 con 0x7f7390158730 2023-05-17T11:46:19.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7394d29640 1 -- 172.21.15.3:0/3348424906 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0acb30 con 0x7f7390158730 2023-05-17T11:46:19.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 -- 172.21.15.3:0/3348424906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 msgr2=0x7f73900ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 --2- 172.21.15.3:0/3348424906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900ad420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f738c0097c0 tx=0x7f738c01c480 comp rx=0 tx=0).stop 2023-05-17T11:46:19.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 -- 172.21.15.3:0/3348424906 shutdown_connections 2023-05-17T11:46:19.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 --2- 172.21.15.3:0/3348424906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900ad420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 -- 172.21.15.3:0/3348424906 >> 172.21.15.3:0/3348424906 conn(0x7f739006a740 msgr2=0x7f73900cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:19.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 -- 172.21.15.3:0/3348424906 shutdown_connections 2023-05-17T11:46:19.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 -- 172.21.15.3:0/3348424906 wait complete. 2023-05-17T11:46:19.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 Processor -- start 2023-05-17T11:46:19.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.166+0000 7f7397f8f640 1 -- start start 2023-05-17T11:46:19.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 0x7f739014c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f73900ca780 0x7f7390149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739014f210 con 0x7f73900b04c0 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390070f00 con 0x7f7390158730 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739014d1b0 con 0x7f73900ca780 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 0x7f739014c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 0x7f739014c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36852/0 (socket says 172.21.15.3:36852) 2023-05-17T11:46:19.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 -- 172.21.15.3:0/1979083477 learned_addr learned my addr 172.21.15.3:0/1979083477 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:19.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f739552a640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f73900ca780 0x7f7390149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f739652c640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 -- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f73900ca780 msgr2=0x7f7390149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f73900ca780 0x7f7390149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 -- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 msgr2=0x7f73900709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 -- 172.21.15.3:0/1979083477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c009420 con 0x7f73900b04c0 2023-05-17T11:46:19.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f739652c640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7395d2b640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 0x7f739014c370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f738c0af040 tx=0x7f738c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0b8650 con 0x7f73900b04c0 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c0b87b0 con 0x7f73900b04c0 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0b8b60 con 0x7f73900b04c0 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73900c8b10 con 0x7f73900b04c0 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73900c8980 con 0x7f73900b04c0 2023-05-17T11:46:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73900cd800 con 0x7f73900b04c0 2023-05-17T11:46:19.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.170+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f738c0b8cc0 con 0x7f73900b04c0 2023-05-17T11:46:19.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.174+0000 7f73867fc640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7374066280 0x7f7374068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.174+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f738c11e6e0 con 0x7f73900b04c0 2023-05-17T11:46:19.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.174+0000 7f739552a640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7374066280 0x7f7374068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.174+0000 7f739552a640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7374066280 0x7f7374068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73900ca680 tx=0x7f7380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.178+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f738c0ebc30 con 0x7f73900b04c0 2023-05-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.330+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f739004de80 con 0x7f73900b04c0 2023-05-17T11:46:19.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.330+0000 7f73867fc640 1 -- 172.21.15.3:0/1979083477 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f738c0ef250 con 0x7f73900b04c0 2023-05-17T11:46:19.342 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:19.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7374066280 msgr2=0x7f7374068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7374066280 0x7f7374068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73900ca680 tx=0x7f7380009040 comp rx=0 tx=0).stop 2023-05-17T11:46:19.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 msgr2=0x7f739014c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 0x7f739014c370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f738c0af040 tx=0x7f738c01acc0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 shutdown_connections 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7374066280 0x7f7374068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390158730 0x7f73900709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f73900ca780 0x7f7390149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 --2- 172.21.15.3:0/1979083477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73900b04c0 0x7f739014c370 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 >> 172.21.15.3:0/1979083477 conn(0x7f739006a740 msgr2=0x7f73900cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:19.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 shutdown_connections 2023-05-17T11:46:19.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.334+0000 7f7397f8f640 1 -- 172.21.15.3:0/1979083477 wait complete. 2023-05-17T11:46:19.363 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:19.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.490+0000 7fbadccfc640 1 Processor -- start 2023-05-17T11:46:19.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.490+0000 7fbadccfc640 1 -- start start 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbadccfc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbad815c360 0x7fbad81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbadccfc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbad8069ab0 0x7fbad8069f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbadccfc640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad806a440 con 0x7fbad815c730 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbadccfc640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad8160410 con 0x7fbad815c360 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbadccfc640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad806eb30 con 0x7fbad8069ab0 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbad815c360 0x7fbad81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbad815c360 0x7fbad81608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36868/0 (socket says 172.21.15.3:36868) 2023-05-17T11:46:19.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 -- 172.21.15.3:0/2925311088 learned_addr learned my addr 172.21.15.3:0/2925311088 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:19.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad5d9b640 1 --2- 172.21.15.3:0/2925311088 >> v2:172.21.15.60:3300/0 conn(0x7fbad8069ab0 0x7fbad8069f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 -- 172.21.15.3:0/2925311088 >> v2:172.21.15.60:3300/0 conn(0x7fbad8069ab0 msgr2=0x7fbad8069f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:19.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 --2- 172.21.15.3:0/2925311088 >> v2:172.21.15.60:3300/0 conn(0x7fbad8069ab0 0x7fbad8069f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 -- 172.21.15.3:0/2925311088 >> v1:172.21.15.60:6789/0 conn(0x7fbad815c730 legacy=0x7fbad806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:19.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 -- 172.21.15.3:0/2925311088 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad815d330 con 0x7fbad815c360 2023-05-17T11:46:19.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad659c640 1 --2- 172.21.15.3:0/2925311088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c360 0x7fbad81608a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbad806bf30 tx=0x7fbac801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a87c80ee6a49cc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad559a640 1 -- 172.21.15.3:0/2925311088 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ab600 con 0x7fbad815c360 2023-05-17T11:46:19.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.494+0000 7fbad559a640 1 -- 172.21.15.3:0/2925311088 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80ab760 con 0x7fbad815c360 2023-05-17T11:46:19.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbad559a640 1 -- 172.21.15.3:0/2925311088 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80abaf0 con 0x7fbad815c360 2023-05-17T11:46:19.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- 172.21.15.3:0/2925311088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c360 msgr2=0x7fbad81608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 --2- 172.21.15.3:0/2925311088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c360 0x7fbad81608a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbad806bf30 tx=0x7fbac801c400 comp rx=0 tx=0).stop 2023-05-17T11:46:19.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- 172.21.15.3:0/2925311088 shutdown_connections 2023-05-17T11:46:19.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 --2- 172.21.15.3:0/2925311088 >> v2:172.21.15.60:3300/0 conn(0x7fbad8069ab0 0x7fbad8069f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 --2- 172.21.15.3:0/2925311088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c360 0x7fbad81608a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- 172.21.15.3:0/2925311088 >> 172.21.15.3:0/2925311088 conn(0x7fbad80cea50 msgr2=0x7fbad80cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:19.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- 172.21.15.3:0/2925311088 shutdown_connections 2023-05-17T11:46:19.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- 172.21.15.3:0/2925311088 wait complete. 2023-05-17T11:46:19.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 Processor -- start 2023-05-17T11:46:19.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- start start 2023-05-17T11:46:19.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbad8069ab0 0x7fbad8148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad815c360 0x7fbad80b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 0x7fbad80b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8148cb0 con 0x7fbad815c730 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80c2720 con 0x7fbad815c360 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbadccfc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80c53e0 con 0x7fbad8069ab0 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbad6d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 0x7fbad80b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbad6d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 0x7fbad80b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36882/0 (socket says 172.21.15.3:36882) 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbad6d9d640 1 -- 172.21.15.3:0/3463654862 learned_addr learned my addr 172.21.15.3:0/3463654862 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbad659c640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbad8069ab0 0x7fbad8148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.498+0000 7fbad5d9b640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad815c360 0x7fbad80b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad6d9d640 1 -- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbad8069ab0 msgr2=0x7fbad8148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad6d9d640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbad8069ab0 0x7fbad8148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad6d9d640 1 -- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad815c360 msgr2=0x7fbad80b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad6d9d640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad815c360 0x7fbad80b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad6d9d640 1 -- 172.21.15.3:0/3463654862 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80094d0 con 0x7fbad815c730 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad5d9b640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad815c360 0x7fbad80b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad6d9d640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 0x7fbad80b1dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c780 tx=0x7fbad000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0004b70 con 0x7fbad815c730 2023-05-17T11:46:19.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad000ce90 con 0x7fbad815c730 2023-05-17T11:46:19.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000a850 con 0x7fbad815c730 2023-05-17T11:46:19.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad815cfc0 con 0x7fbad815c730 2023-05-17T11:46:19.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad815d610 con 0x7fbad815c730 2023-05-17T11:46:19.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad806cdc0 con 0x7fbad815c730 2023-05-17T11:46:19.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbad000a9b0 con 0x7fbad815c730 2023-05-17T11:46:19.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbac6ffd640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbab8066280 0x7fbab8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbad0083eb0 con 0x7fbad815c730 2023-05-17T11:46:19.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.502+0000 7fbad659c640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbab8066280 0x7fbab8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.506+0000 7fbad659c640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbab8066280 0x7fbab8068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbac80af000 tx=0x7fbac80b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.506+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbad0054d80 con 0x7fbad815c730 2023-05-17T11:46:19.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbad804de80 con 0x7fbad815c730 2023-05-17T11:46:19.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbac6ffd640 1 -- 172.21.15.3:0/3463654862 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbad0054910 con 0x7fbad815c730 2023-05-17T11:46:19.685 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:19.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbab8066280 msgr2=0x7fbab8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbab8066280 0x7fbab8068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbac80af000 tx=0x7fbac80b6040 comp rx=0 tx=0).stop 2023-05-17T11:46:19.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 msgr2=0x7fbad80b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 0x7fbad80b1dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c780 tx=0x7fbad000cc40 comp rx=0 tx=0).stop 2023-05-17T11:46:19.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 shutdown_connections 2023-05-17T11:46:19.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fbab8066280 0x7fbab8068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbad815c730 0x7fbad80b1dc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad815c360 0x7fbad80b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 --2- 172.21.15.3:0/3463654862 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fbad8069ab0 0x7fbad8148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 >> 172.21.15.3:0/3463654862 conn(0x7fbad80cea50 msgr2=0x7fbad8154900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:19.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 shutdown_connections 2023-05-17T11:46:19.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.674+0000 7fbadccfc640 1 -- 172.21.15.3:0/3463654862 wait complete. 2023-05-17T11:46:19.704 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:46:19.705 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:19.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:19.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b9fcb640 1 Processor -- start 2023-05-17T11:46:19.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b9fcb640 1 -- start start 2023-05-17T11:46:19.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b9fcb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31b415a2e0 0x7f31b4071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b9fcb640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40ca490 con 0x7f31b40716d0 2023-05-17T11:46:19.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b9fcb640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b4071fe0 con 0x7f31b40c9fd0 2023-05-17T11:46:19.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b9fcb640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b40cacf0 con 0x7f31b415a2e0 2023-05-17T11:46:19.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b37fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f31b40716d0 0x7f31b406fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50428/0 (socket says 172.21.15.3:50428) 2023-05-17T11:46:19.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b37fe640 1 -- 172.21.15.3:0/4075330210 learned_addr learned my addr 172.21.15.3:0/4075330210 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:19.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b2ffd640 1 --2- 172.21.15.3:0/4075330210 >> v2:172.21.15.60:3300/0 conn(0x7f31b415a2e0 0x7f31b4071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290144486 0 0) 0x7f31b40ca490 con 0x7f31b40716d0 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f319c003530 con 0x7f31b40716d0 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935474436 0 0) 0x7f319c003530 con 0x7f31b40716d0 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 >> v2:172.21.15.60:3300/0 conn(0x7f31b415a2e0 msgr2=0x7f31b4071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 --2- 172.21.15.3:0/4075330210 >> v2:172.21.15.60:3300/0 conn(0x7f31b415a2e0 0x7f31b4071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 >> v1:172.21.15.60:6789/0 conn(0x7f31b40c9fd0 legacy=0x7f31b40b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40ca730 con 0x7f31b40716d0 2023-05-17T11:46:19.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f31a4001680 con 0x7f31b40716d0 2023-05-17T11:46:19.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 >> v1:172.21.15.3:6789/0 conn(0x7f31b40716d0 legacy=0x7f31b406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f319c0039f0 0x7f319c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f319c0047d0 0x7f319c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f319c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40cacf0 con 0x7f319c005180 2023-05-17T11:46:19.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c00c060 con 0x7f319c0039f0 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c00c220 con 0x7f319c0047d0 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b3fff640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f319c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b37fe640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f319c0039f0 0x7f319c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b2ffd640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f319c0047d0 0x7f319c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b3fff640 1 -- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f319c0047d0 msgr2=0x7f319c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b3fff640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f319c0047d0 0x7f319c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b3fff640 1 -- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f319c0039f0 msgr2=0x7f319c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:19.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b3fff640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f319c0039f0 0x7f319c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.882+0000 7f31b3fff640 1 -- 172.21.15.3:0/4075330210 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c003530 con 0x7f319c005180 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b3fff640 1 -- 172.21.15.3:0/4075330210 reap_dead start 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b3fff640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f319c00b990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f31ac001e40 tx=0x7f31ac01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b5623c6fb5fdb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac003b80 con 0x7f319c005180 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac003ce0 con 0x7f319c005180 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b27fc640 1 -- 172.21.15.3:0/4075330210 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac005260 con 0x7f319c005180 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 -- 172.21.15.3:0/4075330210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 msgr2=0x7f319c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f319c00b990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f31ac001e40 tx=0x7f31ac01c740 comp rx=0 tx=0).stop 2023-05-17T11:46:19.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 -- 172.21.15.3:0/4075330210 shutdown_connections 2023-05-17T11:46:19.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/4075330210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f319c00b990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 -- 172.21.15.3:0/4075330210 >> 172.21.15.3:0/4075330210 conn(0x7f31b40b0b30 msgr2=0x7f31b40cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:19.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 -- 172.21.15.3:0/4075330210 shutdown_connections 2023-05-17T11:46:19.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.886+0000 7f31b9fcb640 1 -- 172.21.15.3:0/4075330210 wait complete. 2023-05-17T11:46:19.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 Processor -- start 2023-05-17T11:46:19.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 -- start start 2023-05-17T11:46:19.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f31b414a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b406bf60 0x7f31b406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f31b41548a0 0x7f31b4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4155250 con 0x7f319c005180 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b414acb0 con 0x7f31b406bf60 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b41f0740 con 0x7f31b41548a0 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f31b414a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f31b414a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36902/0 (socket says 172.21.15.3:36902) 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 -- 172.21.15.3:0/715884817 learned_addr learned my addr 172.21.15.3:0/715884817 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b2ffd640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b406bf60 0x7f31b406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b3fff640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f31b41548a0 0x7f31b4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 -- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f31b41548a0 msgr2=0x7f31b4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f31b41548a0 0x7f31b4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 -- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b406bf60 msgr2=0x7f31b406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b406bf60 0x7f31b406c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 -- 172.21.15.3:0/715884817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40c8ba0 con 0x7f319c005180 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b2ffd640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b406bf60 0x7f31b406c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:19.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b37fe640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f31b414a770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31a40072f0 tx=0x7f31a40076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400f940 con 0x7f319c005180 2023-05-17T11:46:19.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400faa0 con 0x7f319c005180 2023-05-17T11:46:19.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400fe30 con 0x7f319c005180 2023-05-17T11:46:19.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40caa10 con 0x7f319c005180 2023-05-17T11:46:19.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.890+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40c8e80 con 0x7f319c005180 2023-05-17T11:46:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.894+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b40cbee0 con 0x7f319c005180 2023-05-17T11:46:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.894+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31a401d460 con 0x7f319c005180 2023-05-17T11:46:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.894+0000 7f319bfff640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f31a0066270 0x7f31a0068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.894+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f31a4083f30 con 0x7f319c005180 2023-05-17T11:46:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.894+0000 7f31b2ffd640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f31a0066270 0x7f31a0068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.894+0000 7f31b2ffd640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f31a0066270 0x7f31a0068720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f31b40b3c60 tx=0x7f31a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:19.898+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f31a40512d0 con 0x7f319c005180 2023-05-17T11:46:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.054+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b404de80 con 0x7f319c005180 2023-05-17T11:46:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.054+0000 7f319bfff640 1 -- 172.21.15.3:0/715884817 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7f31a40548f0 con 0x7f319c005180 2023-05-17T11:46:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f31a0066270 msgr2=0x7f31a0068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f31a0066270 0x7f31a0068720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f31b40b3c60 tx=0x7f31a8008040 comp rx=0 tx=0).stop 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 msgr2=0x7f31b414a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f31b414a770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31a40072f0 tx=0x7f31a40076f0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 shutdown_connections 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f31a0066270 0x7f31a0068720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f31b41548a0 0x7f31b4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b406bf60 0x7f31b406c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 --2- 172.21.15.3:0/715884817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c005180 0x7f31b414a770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 >> 172.21.15.3:0/715884817 conn(0x7f31b40b0b30 msgr2=0x7f31b4159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 shutdown_connections 2023-05-17T11:46:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.058+0000 7f31b9fcb640 1 -- 172.21.15.3:0/715884817 wait complete. 2023-05-17T11:46:20.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:20.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:20.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd067998640 1 Processor -- start 2023-05-17T11:46:20.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd067998640 1 -- start start 2023-05-17T11:46:20.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd067998640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd06015c340 0x7fd0600d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd067998640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd060066f00 con 0x7fd0600b40b0 2023-05-17T11:46:20.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd067998640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600b0250 con 0x7fd0600b16f0 2023-05-17T11:46:20.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd067998640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b3400 con 0x7fd06015c340 2023-05-17T11:46:20.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd064f33640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd0600b40b0 0x7fd0600b25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50430/0 (socket says 172.21.15.3:50430) 2023-05-17T11:46:20.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd064f33640 1 -- 172.21.15.3:0/2333972438 learned_addr learned my addr 172.21.15.3:0/2333972438 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:20.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd065734640 1 --2- 172.21.15.3:0/2333972438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd06015c340 0x7fd0600d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261412933 0 0) 0x7fd060066f00 con 0x7fd0600b40b0 2023-05-17T11:46:20.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c003530 con 0x7fd0600b40b0 2023-05-17T11:46:20.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582602219 0 0) 0x7fd0600b0250 con 0x7fd0600b16f0 2023-05-17T11:46:20.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd060066f00 con 0x7fd0600b16f0 2023-05-17T11:46:20.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640227810 0 0) 0x7fd04c003530 con 0x7fd0600b40b0 2023-05-17T11:46:20.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd065734640 1 -- 172.21.15.3:0/2333972438 >> v1:172.21.15.60:6789/0 conn(0x7fd0600b16f0 legacy=0x7fd0600b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd065734640 1 -- 172.21.15.3:0/2333972438 >> v1:172.21.15.3:6789/0 conn(0x7fd0600b40b0 legacy=0x7fd0600b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.218+0000 7fd065734640 1 -- 172.21.15.3:0/2333972438 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600af640 con 0x7fd06015c340 2023-05-17T11:46:20.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd065734640 1 --2- 172.21.15.3:0/2333972438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd06015c340 0x7fd0600d0280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0097d0 tx=0x7fd05c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe78db52e72eb627 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050001680 con 0x7fd06015c340 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c0a7050 con 0x7fd06015c340 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd057fff640 1 -- 172.21.15.3:0/2333972438 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0ab620 con 0x7fd06015c340 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 -- 172.21.15.3:0/2333972438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd06015c340 msgr2=0x7fd0600d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 --2- 172.21.15.3:0/2333972438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd06015c340 0x7fd0600d0280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0097d0 tx=0x7fd05c01c330 comp rx=0 tx=0).stop 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 -- 172.21.15.3:0/2333972438 shutdown_connections 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 --2- 172.21.15.3:0/2333972438 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd06015c340 0x7fd0600d0280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 -- 172.21.15.3:0/2333972438 >> 172.21.15.3:0/2333972438 conn(0x7fd060071b00 msgr2=0x7fd06009bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:20.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 -- 172.21.15.3:0/2333972438 shutdown_connections 2023-05-17T11:46:20.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.222+0000 7fd067998640 1 -- 172.21.15.3:0/2333972438 wait complete. 2023-05-17T11:46:20.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 Processor -- start 2023-05-17T11:46:20.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 -- start start 2023-05-17T11:46:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 0x7fd0600c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0600b40b0 0x7fd0601476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd06015c340 0x7fd06014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060151460 con 0x7fd0600b16f0 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c8810 con 0x7fd06015c340 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600cd3d0 con 0x7fd0600b40b0 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 0x7fd0600c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 0x7fd0600c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36916/0 (socket says 172.21.15.3:36916) 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 -- 172.21.15.3:0/1498210595 learned_addr learned my addr 172.21.15.3:0/1498210595 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd064f33640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0600b40b0 0x7fd0601476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065f35640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd06015c340 0x7fd06014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 -- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0600b40b0 msgr2=0x7fd0601476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0600b40b0 0x7fd0601476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 -- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd06015c340 msgr2=0x7fd06014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd06015c340 0x7fd06014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 -- 172.21.15.3:0/1498210595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c0093b0 con 0x7fd0600b16f0 2023-05-17T11:46:20.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd065734640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 0x7fd0600c8ca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0097d0 tx=0x7fd05c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0059a0 con 0x7fd0600b16f0 2023-05-17T11:46:20.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c005b00 con 0x7fd0600b16f0 2023-05-17T11:46:20.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c006030 con 0x7fd0600b16f0 2023-05-17T11:46:20.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.226+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600af2d0 con 0x7fd0600b16f0 2023-05-17T11:46:20.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600afee0 con 0x7fd0600b16f0 2023-05-17T11:46:20.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0600b1e00 con 0x7fd0600b16f0 2023-05-17T11:46:20.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd05c0b2040 con 0x7fd0600b16f0 2023-05-17T11:46:20.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd055ffb640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd044066280 0x7fd044068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd05c11da90 con 0x7fd0600b16f0 2023-05-17T11:46:20.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd064f33640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd044066280 0x7fd044068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.230+0000 7fd064f33640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd044066280 0x7fd044068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd060159db0 tx=0x7fd05000f5a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.234+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd05c0eaf70 con 0x7fd0600b16f0 2023-05-17T11:46:20.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.390+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd06004de80 con 0x7fd0600b16f0 2023-05-17T11:46:20.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.390+0000 7fd055ffb640 1 -- 172.21.15.3:0/1498210595 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd05c0c1020 con 0x7fd0600b16f0 2023-05-17T11:46:20.401 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:20.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd044066280 msgr2=0x7fd044068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd044066280 0x7fd044068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd060159db0 tx=0x7fd05000f5a0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 msgr2=0x7fd0600c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 0x7fd0600c8ca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0097d0 tx=0x7fd05c0190d0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 shutdown_connections 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd044066280 0x7fd044068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd06015c340 0x7fd06014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd0600b40b0 0x7fd0601476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 --2- 172.21.15.3:0/1498210595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0600b16f0 0x7fd0600c8ca0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 >> 172.21.15.3:0/1498210595 conn(0x7fd060071b00 msgr2=0x7fd06006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 shutdown_connections 2023-05-17T11:46:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.394+0000 7fd067998640 1 -- 172.21.15.3:0/1498210595 wait complete. 2023-05-17T11:46:20.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:20.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.550+0000 7f3b255f3640 1 Processor -- start 2023-05-17T11:46:20.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.550+0000 7f3b255f3640 1 -- start start 2023-05-17T11:46:20.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b255f3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b20156460 0x7f3b2015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b255f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b2006e7d0 0x7f3b2006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b255f3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2015cb00 con 0x7f3b2006cd20 2023-05-17T11:46:20.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b255f3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2006ec40 con 0x7f3b20156460 2023-05-17T11:46:20.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b255f3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2006d1a0 con 0x7f3b2006e7d0 2023-05-17T11:46:20.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1f7fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3b2006cd20 0x7f3b200ac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50432/0 (socket says 172.21.15.3:50432) 2023-05-17T11:46:20.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1f7fe640 1 -- 172.21.15.3:0/1131181144 learned_addr learned my addr 172.21.15.3:0/1131181144 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:20.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1effd640 1 --2- 172.21.15.3:0/1131181144 >> v2:172.21.15.60:3300/0 conn(0x7f3b20156460 0x7f3b2015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b17fff640 1 --2- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b2006e7d0 0x7f3b2006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1e7fc640 1 -- 172.21.15.3:0/1131181144 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611024543 0 0) 0x7f3b2015cb00 con 0x7f3b2006cd20 2023-05-17T11:46:20.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1e7fc640 1 -- 172.21.15.3:0/1131181144 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b0c003530 con 0x7f3b2006cd20 2023-05-17T11:46:20.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1effd640 1 -- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b2006e7d0 msgr2=0x7f3b2006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:20.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1effd640 1 --2- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b2006e7d0 0x7f3b2006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1effd640 1 -- 172.21.15.3:0/1131181144 >> v1:172.21.15.3:6789/0 conn(0x7f3b2006cd20 legacy=0x7f3b200ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1e7fc640 1 -- 172.21.15.3:0/1131181144 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564396188 0 0) 0x7f3b0c003530 con 0x7f3b2006cd20 2023-05-17T11:46:20.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.554+0000 7f3b1effd640 1 -- 172.21.15.3:0/1131181144 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2015cde0 con 0x7f3b20156460 2023-05-17T11:46:20.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b1effd640 1 --2- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b20156460 0x7f3b2015c4b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b100097c0 tx=0x7f3b1001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333bf9df803450f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b1e7fc640 1 -- 172.21.15.3:0/1131181144 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18001a00 con 0x7f3b20156460 2023-05-17T11:46:20.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b1e7fc640 1 -- 172.21.15.3:0/1131181144 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b100a7050 con 0x7f3b20156460 2023-05-17T11:46:20.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b1e7fc640 1 -- 172.21.15.3:0/1131181144 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ab620 con 0x7f3b20156460 2023-05-17T11:46:20.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 -- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b20156460 msgr2=0x7f3b2015c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 --2- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b20156460 0x7f3b2015c4b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b100097c0 tx=0x7f3b1001c370 comp rx=0 tx=0).stop 2023-05-17T11:46:20.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 -- 172.21.15.3:0/1131181144 shutdown_connections 2023-05-17T11:46:20.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 --2- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b2006e7d0 0x7f3b2006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 --2- 172.21.15.3:0/1131181144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b20156460 0x7f3b2015c4b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 -- 172.21.15.3:0/1131181144 >> 172.21.15.3:0/1131181144 conn(0x7f3b200b14a0 msgr2=0x7f3b200cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:20.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 -- 172.21.15.3:0/1131181144 shutdown_connections 2023-05-17T11:46:20.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 -- 172.21.15.3:0/1131181144 wait complete. 2023-05-17T11:46:20.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 Processor -- start 2023-05-17T11:46:20.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.558+0000 7f3b255f3640 1 -- start start 2023-05-17T11:46:20.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b2006cd20 0x7f3b20146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 0x7f3b200ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b20156460 0x7f3b200af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201479f0 con 0x7f3b2006e7d0 2023-05-17T11:46:20.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20152b40 con 0x7f3b2006cd20 2023-05-17T11:46:20.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200ce600 con 0x7f3b20156460 2023-05-17T11:46:20.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 0x7f3b200ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 0x7f3b200ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36932/0 (socket says 172.21.15.3:36932) 2023-05-17T11:46:20.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 -- 172.21.15.3:0/2661664992 learned_addr learned my addr 172.21.15.3:0/2661664992 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:20.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b1effd640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b2006cd20 0x7f3b20146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b1f7fe640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b20156460 0x7f3b200af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 -- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b20156460 msgr2=0x7f3b200af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b20156460 0x7f3b200af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 -- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b2006cd20 msgr2=0x7f3b20146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b2006cd20 0x7f3b20146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 -- 172.21.15.3:0/2661664992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10009420 con 0x7f3b2006e7d0 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b1f7fe640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b20156460 0x7f3b200af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b17fff640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 0x7f3b200ce0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800e960 tx=0x7f3b0800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08009690 con 0x7f3b2006e7d0 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800c9a0 con 0x7f3b2006e7d0 2023-05-17T11:46:20.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b200ad410 con 0x7f3b2006e7d0 2023-05-17T11:46:20.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800cd10 con 0x7f3b2006e7d0 2023-05-17T11:46:20.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b200b1fa0 con 0x7f3b2006e7d0 2023-05-17T11:46:20.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20156830 con 0x7f3b2006e7d0 2023-05-17T11:46:20.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.562+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b08013470 con 0x7f3b2006e7d0 2023-05-17T11:46:20.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.566+0000 7f3b177fe640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b00066280 0x7f3b00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.566+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3b08083f80 con 0x7f3b2006e7d0 2023-05-17T11:46:20.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.566+0000 7f3b1effd640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b00066280 0x7f3b00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.566+0000 7f3b1effd640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b00066280 0x7f3b00068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b100ad000 tx=0x7f3b100a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.570+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3b080513b0 con 0x7f3b2006e7d0 2023-05-17T11:46:20.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b2004de80 con 0x7f3b2006e7d0 2023-05-17T11:46:20.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b177fe640 1 -- 172.21.15.3:0/2661664992 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b080170a0 con 0x7f3b2006e7d0 2023-05-17T11:46:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b00066280 msgr2=0x7f3b00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b00066280 0x7f3b00068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b100ad000 tx=0x7f3b100a6000 comp rx=0 tx=0).stop 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 msgr2=0x7f3b200ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 0x7f3b200ce0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800e960 tx=0x7f3b0800ee20 comp rx=0 tx=0).stop 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 shutdown_connections 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3b00066280 0x7f3b00068730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3b20156460 0x7f3b200af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3b2006e7d0 0x7f3b200ce0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 --2- 172.21.15.3:0/2661664992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b2006cd20 0x7f3b20146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 >> 172.21.15.3:0/2661664992 conn(0x7f3b200b14a0 msgr2=0x7f3b200ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:20.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 shutdown_connections 2023-05-17T11:46:20.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.722+0000 7f3b255f3640 1 -- 172.21.15.3:0/2661664992 wait complete. 2023-05-17T11:46:20.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:20.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f0642d640 1 Processor -- start 2023-05-17T11:46:20.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f0642d640 1 -- start start 2023-05-17T11:46:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f0642d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4f00143210 0x7f4f000cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f0642d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f000cd1d0 con 0x7f4f0015a8d0 2023-05-17T11:46:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f0642d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0006d540 con 0x7f4f0006eb10 2023-05-17T11:46:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f0642d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f001435e0 con 0x7f4f00143210 2023-05-17T11:46:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4efffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4f00143210 0x7f4f000cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f049ca640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4f0015a8d0 0x7f4f000cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50436/0 (socket says 172.21.15.3:50436) 2023-05-17T11:46:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4f049ca640 1 -- 172.21.15.3:0/4150140174 learned_addr learned my addr 172.21.15.3:0/4150140174 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4efffff640 1 -- 172.21.15.3:0/4150140174 >> v1:172.21.15.60:6789/0 conn(0x7f4f0006eb10 legacy=0x7f4f0015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4efffff640 1 -- 172.21.15.3:0/4150140174 >> v1:172.21.15.3:6789/0 conn(0x7f4f0015a8d0 legacy=0x7f4f000cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4efffff640 1 -- 172.21.15.3:0/4150140174 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0006d820 con 0x7f4f00143210 2023-05-17T11:46:20.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.882+0000 7f4efeffd640 1 -- 172.21.15.3:0/4150140174 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426093289 0 0) 0x7f4f000cd1d0 con 0x7f4f0015a8d0 2023-05-17T11:46:20.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4efffff640 1 --2- 172.21.15.3:0/4150140174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f00143210 0x7f4f000cb610 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00097c0 tx=0x7f4ef001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e6bc1eb2f74890 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4efeffd640 1 -- 172.21.15.3:0/4150140174 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00ac600 con 0x7f4f00143210 2023-05-17T11:46:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4efeffd640 1 -- 172.21.15.3:0/4150140174 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef00a8050 con 0x7f4f00143210 2023-05-17T11:46:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4efeffd640 1 -- 172.21.15.3:0/4150140174 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00ac980 con 0x7f4f00143210 2023-05-17T11:46:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 -- 172.21.15.3:0/4150140174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f00143210 msgr2=0x7f4f000cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 --2- 172.21.15.3:0/4150140174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f00143210 0x7f4f000cb610 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00097c0 tx=0x7f4ef001c380 comp rx=0 tx=0).stop 2023-05-17T11:46:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 -- 172.21.15.3:0/4150140174 shutdown_connections 2023-05-17T11:46:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 --2- 172.21.15.3:0/4150140174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f00143210 0x7f4f000cb610 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 -- 172.21.15.3:0/4150140174 >> 172.21.15.3:0/4150140174 conn(0x7f4f000b14a0 msgr2=0x7f4f000cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 -- 172.21.15.3:0/4150140174 shutdown_connections 2023-05-17T11:46:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.886+0000 7f4f0642d640 1 -- 172.21.15.3:0/4150140174 wait complete. 2023-05-17T11:46:20.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 Processor -- start 2023-05-17T11:46:20.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 -- start start 2023-05-17T11:46:20.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 0x7f4f0015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f00143210 0x7f4f000b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4f0015a8d0 0x7f4f00141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000b3c50 con 0x7f4f0006eb10 2023-05-17T11:46:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000b2fd0 con 0x7f4f00143210 2023-05-17T11:46:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000b32b0 con 0x7f4f0015a8d0 2023-05-17T11:46:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 0x7f4f0015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 0x7f4f0015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36954/0 (socket says 172.21.15.3:36954) 2023-05-17T11:46:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 -- 172.21.15.3:0/2138338436 learned_addr learned my addr 172.21.15.3:0/2138338436 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f049ca640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4f0015a8d0 0x7f4f00141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4eff7fe640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f00143210 0x7f4f000b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 -- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4f0015a8d0 msgr2=0x7f4f00141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4f0015a8d0 0x7f4f00141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 -- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f00143210 msgr2=0x7f4f000b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f00143210 0x7f4f000b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 -- 172.21.15.3:0/2138338436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0009420 con 0x7f4f0006eb10 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4eff7fe640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f00143210 0x7f4f000b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f049ca640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4f0015a8d0 0x7f4f00141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:20.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efffff640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 0x7f4f0015a0f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0018f90 tx=0x7f4ef001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004220 con 0x7f4f0006eb10 2023-05-17T11:46:20.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0004380 con 0x7f4f0006eb10 2023-05-17T11:46:20.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0003820 con 0x7f4f0006eb10 2023-05-17T11:46:20.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f000ce5f0 con 0x7f4f0006eb10 2023-05-17T11:46:20.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.890+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f000cbb50 con 0x7f4f0006eb10 2023-05-17T11:46:20.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.894+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f000ce780 con 0x7f4f0006eb10 2023-05-17T11:46:20.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.894+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ef00b3050 con 0x7f4f0006eb10 2023-05-17T11:46:20.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.894+0000 7f4efcff9640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4eec0662b0 0x7f4eec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:20.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.894+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4ef011e140 con 0x7f4f0006eb10 2023-05-17T11:46:20.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.894+0000 7f4eff7fe640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4eec0662b0 0x7f4eec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:20.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.894+0000 7f4eff7fe640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4eec0662b0 0x7f4eec068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4f000cabd0 tx=0x7f4ef4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:20.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:20.898+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4ef00eb570 con 0x7f4f0006eb10 2023-05-17T11:46:21.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f0004de80 con 0x7f4f0006eb10 2023-05-17T11:46:21.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4efcff9640 1 -- 172.21.15.3:0/2138338436 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ef00044f0 con 0x7f4f0006eb10 2023-05-17T11:46:21.060 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:21.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4eec0662b0 msgr2=0x7f4eec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4eec0662b0 0x7f4eec068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4f000cabd0 tx=0x7f4ef4009040 comp rx=0 tx=0).stop 2023-05-17T11:46:21.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 msgr2=0x7f4f0015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 0x7f4f0015a0f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0018f90 tx=0x7f4ef001abc0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 shutdown_connections 2023-05-17T11:46:21.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4eec0662b0 0x7f4eec068760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4f0015a8d0 0x7f4f00141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f00143210 0x7f4f000b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 --2- 172.21.15.3:0/2138338436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f0006eb10 0x7f4f0015a0f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 >> 172.21.15.3:0/2138338436 conn(0x7f4f000b14a0 msgr2=0x7f4f0015cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 shutdown_connections 2023-05-17T11:46:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.050+0000 7f4f0642d640 1 -- 172.21.15.3:0/2138338436 wait complete. 2023-05-17T11:46:21.081 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:21.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 Processor -- start 2023-05-17T11:46:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 -- start start 2023-05-17T11:46:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a08156460 0x7f6a0815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6a0806cef0 0x7f6a080ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0815cb00 con 0x7f6a0806e7d0 2023-05-17T11:46:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0815cde0 con 0x7f6a0806cef0 2023-05-17T11:46:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0fd18640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0815d0c0 con 0x7f6a08156460 2023-05-17T11:46:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0e2b5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6a0806cef0 0x7f6a080ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0e2b5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6a0806cef0 0x7f6a080ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36968/0 (socket says 172.21.15.3:36968) 2023-05-17T11:46:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0e2b5640 1 -- 172.21.15.3:0/2503061210 learned_addr learned my addr 172.21.15.3:0/2503061210 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.210+0000 7f6a0dab4640 1 --2- 172.21.15.3:0/2503061210 >> v2:172.21.15.60:3300/0 conn(0x7f6a08156460 0x7f6a0815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0e2b5640 1 -- 172.21.15.3:0/2503061210 >> v2:172.21.15.60:3300/0 conn(0x7f6a08156460 msgr2=0x7f6a0815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0e2b5640 1 --2- 172.21.15.3:0/2503061210 >> v2:172.21.15.60:3300/0 conn(0x7f6a08156460 0x7f6a0815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0e2b5640 1 -- 172.21.15.3:0/2503061210 >> v1:172.21.15.60:6789/0 conn(0x7f6a0806e7d0 legacy=0x7f6a0806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0e2b5640 1 -- 172.21.15.3:0/2503061210 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0815d3a0 con 0x7f6a0806cef0 2023-05-17T11:46:21.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0e2b5640 1 --2- 172.21.15.3:0/2503061210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806cef0 0x7f6a080ac8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009e50 tx=0x7f6a0001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c24bb23ee956e5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:21.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0cab2640 1 -- 172.21.15.3:0/2503061210 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000a58b0 con 0x7f6a0806cef0 2023-05-17T11:46:21.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0cab2640 1 -- 172.21.15.3:0/2503061210 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000a5a10 con 0x7f6a0806cef0 2023-05-17T11:46:21.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0cab2640 1 -- 172.21.15.3:0/2503061210 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000a5da0 con 0x7f6a0806cef0 2023-05-17T11:46:21.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0fd18640 1 -- 172.21.15.3:0/2503061210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806cef0 msgr2=0x7f6a080ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/2503061210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806cef0 0x7f6a080ac8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009e50 tx=0x7f6a0001c9d0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0fd18640 1 -- 172.21.15.3:0/2503061210 shutdown_connections 2023-05-17T11:46:21.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/2503061210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806cef0 0x7f6a080ac8f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/2503061210 >> v2:172.21.15.60:3300/0 conn(0x7f6a08156460 0x7f6a0815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.214+0000 7f6a0fd18640 1 -- 172.21.15.3:0/2503061210 >> 172.21.15.3:0/2503061210 conn(0x7f6a080b14a0 msgr2=0x7f6a080cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:21.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 -- 172.21.15.3:0/2503061210 shutdown_connections 2023-05-17T11:46:21.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 -- 172.21.15.3:0/2503061210 wait complete. 2023-05-17T11:46:21.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 Processor -- start 2023-05-17T11:46:21.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 -- start start 2023-05-17T11:46:21.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6a0806cef0 0x7f6a0814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 0x7f6a0815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a08156460 0x7f6a081529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08152f30 con 0x7f6a0806e7d0 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815f510 con 0x7f6a08156460 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0fd18640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815ec70 con 0x7f6a0806cef0 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 0x7f6a0815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 0x7f6a0815e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36974/0 (socket says 172.21.15.3:36974) 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 -- 172.21.15.3:0/3793964667 learned_addr learned my addr 172.21.15.3:0/3793964667 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0dab4640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6a0806cef0 0x7f6a0814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0e2b5640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a08156460 0x7f6a081529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 -- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6a0806cef0 msgr2=0x7f6a0814d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6a0806cef0 0x7f6a0814d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 -- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a08156460 msgr2=0x7f6a081529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a08156460 0x7f6a081529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 -- 172.21.15.3:0/3793964667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009b30 con 0x7f6a0806e7d0 2023-05-17T11:46:21.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.218+0000 7f6a0d2b3640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 0x7f6a0815e5e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f69f800c450 tx=0x7f69f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:21.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80052d0 con 0x7f6a0806e7d0 2023-05-17T11:46:21.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f8005450 con 0x7f6a0806e7d0 2023-05-17T11:46:21.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8012870 con 0x7f6a0806e7d0 2023-05-17T11:46:21.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a080ae5d0 con 0x7f6a0806e7d0 2023-05-17T11:46:21.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a080ae440 con 0x7f6a0806e7d0 2023-05-17T11:46:21.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a080b24c0 con 0x7f6a0806e7d0 2023-05-17T11:46:21.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69f80129d0 con 0x7f6a0806e7d0 2023-05-17T11:46:21.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f69fe7fc640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f69ec066280 0x7f69ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f69f8083750 con 0x7f6a0806e7d0 2023-05-17T11:46:21.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f6a0dab4640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f69ec066280 0x7f69ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.222+0000 7f6a0dab4640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f69ec066280 0x7f69ec068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a0814e520 tx=0x7f6a04009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:21.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.226+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f69f8050c30 con 0x7f6a0806e7d0 2023-05-17T11:46:21.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.378+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a0804de80 con 0x7f6a0806e7d0 2023-05-17T11:46:21.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.378+0000 7f69fe7fc640 1 -- 172.21.15.3:0/3793964667 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69f8081e60 con 0x7f6a0806e7d0 2023-05-17T11:46:21.390 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:21.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f69ec066280 msgr2=0x7f69ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f69ec066280 0x7f69ec068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a0814e520 tx=0x7f6a04009190 comp rx=0 tx=0).stop 2023-05-17T11:46:21.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 msgr2=0x7f6a0815e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 0x7f6a0815e5e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f69f800c450 tx=0x7f69f800c910 comp rx=0 tx=0).stop 2023-05-17T11:46:21.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 shutdown_connections 2023-05-17T11:46:21.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f69ec066280 0x7f69ec068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a08156460 0x7f6a081529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a0806e7d0 0x7f6a0815e5e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 --2- 172.21.15.3:0/3793964667 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6a0806cef0 0x7f6a0814d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 >> 172.21.15.3:0/3793964667 conn(0x7f6a080b14a0 msgr2=0x7f6a080cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:21.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 shutdown_connections 2023-05-17T11:46:21.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.382+0000 7f6a0fd18640 1 -- 172.21.15.3:0/3793964667 wait complete. 2023-05-17T11:46:21.410 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 Processor -- start 2023-05-17T11:46:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 -- start start 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f84bc06fbd0 0x7f84bc15db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc15e040 0x7f84bc06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc06c450 con 0x7f84bc069ab0 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc15eaa0 con 0x7f84bc06fbd0 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84c20d1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15a410 con 0x7f84bc15e040 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f84bc06fbd0 0x7f84bc15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f84bc06fbd0 0x7f84bc15db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36978/0 (socket says 172.21.15.3:36978) 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 -- 172.21.15.3:0/102474905 learned_addr learned my addr 172.21.15.3:0/102474905 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84bbfff640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc15e040 0x7f84bc06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 -- 172.21.15.3:0/102474905 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc15e040 msgr2=0x7f84bc06c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc15e040 0x7f84bc06c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 -- 172.21.15.3:0/102474905 >> v1:172.21.15.60:6789/0 conn(0x7f84bc069ab0 legacy=0x7f84bc069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84baffd640 1 -- 172.21.15.3:0/102474905 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc06be40 con 0x7f84bc06fbd0 2023-05-17T11:46:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.538+0000 7f84bbfff640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc15e040 0x7f84bc06c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:21.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84baffd640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc06fbd0 0x7f84bc15db00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009870 tx=0x7f84b001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4588a26d04d5efd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:21.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84ba7fc640 1 -- 172.21.15.3:0/102474905 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00a89b0 con 0x7f84bc06fbd0 2023-05-17T11:46:21.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84ba7fc640 1 -- 172.21.15.3:0/102474905 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00a8b10 con 0x7f84bc06fbd0 2023-05-17T11:46:21.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84ba7fc640 1 -- 172.21.15.3:0/102474905 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00a8ea0 con 0x7f84bc06fbd0 2023-05-17T11:46:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 -- 172.21.15.3:0/102474905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc06fbd0 msgr2=0x7f84bc15db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc06fbd0 0x7f84bc15db00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009870 tx=0x7f84b001ecf0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 -- 172.21.15.3:0/102474905 shutdown_connections 2023-05-17T11:46:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc15e040 0x7f84bc06c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 --2- 172.21.15.3:0/102474905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc06fbd0 0x7f84bc15db00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 -- 172.21.15.3:0/102474905 >> 172.21.15.3:0/102474905 conn(0x7f84bc0b0b20 msgr2=0x7f84bc0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 -- 172.21.15.3:0/102474905 shutdown_connections 2023-05-17T11:46:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.542+0000 7f84c20d1640 1 -- 172.21.15.3:0/102474905 wait complete. 2023-05-17T11:46:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 Processor -- start 2023-05-17T11:46:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 -- start start 2023-05-17T11:46:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 0x7f84bc1eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc06fbd0 0x7f84bc0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc15e040 0x7f84bc0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc155e40 con 0x7f84bc069ab0 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc070fe0 con 0x7f84bc15e040 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0712c0 con 0x7f84bc06fbd0 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 0x7f84bc1eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 0x7f84bc1eeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36994/0 (socket says 172.21.15.3:36994) 2023-05-17T11:46:21.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 -- 172.21.15.3:0/2394337763 learned_addr learned my addr 172.21.15.3:0/2394337763 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:21.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bbfff640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc15e040 0x7f84bc0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84baffd640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc06fbd0 0x7f84bc0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 -- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc06fbd0 msgr2=0x7f84bc0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc06fbd0 0x7f84bc0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 -- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc15e040 msgr2=0x7f84bc0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc15e040 0x7f84bc0c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 -- 172.21.15.3:0/2394337763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00094d0 con 0x7f84bc069ab0 2023-05-17T11:46:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84bb7fe640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 0x7f84bc1eeff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c430 tx=0x7f84ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:21.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011790 con 0x7f84bc069ab0 2023-05-17T11:46:21.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac0118f0 con 0x7f84bc069ab0 2023-05-17T11:46:21.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011ce0 con 0x7f84bc069ab0 2023-05-17T11:46:21.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc15e7c0 con 0x7f84bc069ab0 2023-05-17T11:46:21.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.546+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc15e4e0 con 0x7f84bc069ab0 2023-05-17T11:46:21.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.550+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc06c0e0 con 0x7f84bc069ab0 2023-05-17T11:46:21.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.550+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84ac01c460 con 0x7f84bc069ab0 2023-05-17T11:46:21.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.550+0000 7f84a3fff640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84a8066280 0x7f84a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:21.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.550+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f84ac083bf0 con 0x7f84bc069ab0 2023-05-17T11:46:21.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.550+0000 7f84baffd640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84a8066280 0x7f84a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:21.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.550+0000 7f84baffd640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84a8066280 0x7f84a8068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84b00b2000 tx=0x7f84b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:21.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.554+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f84ac0510c0 con 0x7f84bc069ab0 2023-05-17T11:46:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84bc04de80 con 0x7f84bc069ab0 2023-05-17T11:46:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84a3fff640 1 -- 172.21.15.3:0/2394337763 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f84ac0546e0 con 0x7f84bc069ab0 2023-05-17T11:46:21.732 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:21.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84a8066280 msgr2=0x7f84a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84a8066280 0x7f84a8068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84b00b2000 tx=0x7f84b0009040 comp rx=0 tx=0).stop 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 msgr2=0x7f84bc1eeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 0x7f84bc1eeff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c430 tx=0x7f84ac00c8f0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 shutdown_connections 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f84a8066280 0x7f84a8068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc15e040 0x7f84bc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f84bc06fbd0 0x7f84bc0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 --2- 172.21.15.3:0/2394337763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84bc069ab0 0x7f84bc1eeff0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:21.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 >> 172.21.15.3:0/2394337763 conn(0x7f84bc0b0b20 msgr2=0x7f84bc070090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:21.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 shutdown_connections 2023-05-17T11:46:21.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:21.722+0000 7f84c20d1640 1 -- 172.21.15.3:0/2394337763 wait complete. 2023-05-17T11:46:21.752 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-05-17T11:46:21.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:21.753 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-17T11:46:21.773 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:21.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-05-17T11:46:21.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:21.774 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-17T11:46:21.822 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:46:21.822 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:21.832 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:46:21.832 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:21.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:22.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.006+0000 7f4fdd1bc640 1 Processor -- start 2023-05-17T11:46:22.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.006+0000 7f4fdd1bc640 1 -- start start 2023-05-17T11:46:22.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fdd1bc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0430 0x7f4fd80ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fdd1bc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd80ce9e0 0x7f4fd80d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fdd1bc640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80d0d40 con 0x7f4fd80d0fd0 2023-05-17T11:46:22.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fdd1bc640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd8160c20 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fdd1bc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8160f00 con 0x7f4fd80d0430 2023-05-17T11:46:22.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd659c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4fd80d0fd0 0x7f4fd815d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50450/0 (socket says 172.21.15.3:50450) 2023-05-17T11:46:22.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd659c640 1 -- 172.21.15.3:0/1530438280 learned_addr learned my addr 172.21.15.3:0/1530438280 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:22.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd6d9d640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0430 0x7f4fd80ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd759e640 1 --2- 172.21.15.3:0/1530438280 >> v2:172.21.15.60:3300/0 conn(0x7f4fd80ce9e0 0x7f4fd80d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd5d9b640 1 -- 172.21.15.3:0/1530438280 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483825667 0 0) 0x7f4fd80d0d40 con 0x7f4fd80d0fd0 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd5d9b640 1 -- 172.21.15.3:0/1530438280 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc0003530 con 0x7f4fd80d0fd0 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd759e640 1 -- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0430 msgr2=0x7f4fd80ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd5d9b640 1 -- 172.21.15.3:0/1530438280 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2941353469 0 0) 0x7f4fc0003530 con 0x7f4fd80d0fd0 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd759e640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0430 0x7f4fd80ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd759e640 1 -- 172.21.15.3:0/1530438280 >> v1:172.21.15.3:6789/0 conn(0x7f4fd80d0fd0 legacy=0x7f4fd815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd759e640 1 -- 172.21.15.3:0/1530438280 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd815ce10 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.010+0000 7f4fd6d9d640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0430 0x7f4fd80ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:22.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fd759e640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd80d0800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009d90 tx=0x7f4fd001c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3cdb0bebb0403a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fd5d9b640 1 -- 172.21.15.3:0/1530438280 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc001680 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fd5d9b640 1 -- 172.21.15.3:0/1530438280 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd00a55d0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fd5d9b640 1 -- 172.21.15.3:0/1530438280 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a5940 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80ce9e0 msgr2=0x7f4fd80d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd80d0800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009d90 tx=0x7f4fd001c7b0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/1530438280 shutdown_connections 2023-05-17T11:46:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd80d0800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/1530438280 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0430 0x7f4fd80ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/1530438280 >> 172.21.15.3:0/1530438280 conn(0x7f4fd809bb70 msgr2=0x7f4fd80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/1530438280 shutdown_connections 2023-05-17T11:46:22.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/1530438280 wait complete. 2023-05-17T11:46:22.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 Processor -- start 2023-05-17T11:46:22.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- start start 2023-05-17T11:46:22.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd81f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80d0430 0x7f4fd815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0fd0 0x7f4fd80d2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd815ff90 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd815f380 con 0x7f4fd80d0430 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.014+0000 7f4fdd1bc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd815f660 con 0x7f4fd80d0fd0 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd81f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd81f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36996/0 (socket says 172.21.15.3:36996) 2023-05-17T11:46:22.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 -- 172.21.15.3:0/2989719246 learned_addr learned my addr 172.21.15.3:0/2989719246 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:22.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 -- 172.21.15.3:0/2989719246 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0fd0 msgr2=0x7f4fd80d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0fd0 0x7f4fd80d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 -- 172.21.15.3:0/2989719246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80d0430 msgr2=0x7f4fd815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80d0430 0x7f4fd815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 -- 172.21.15.3:0/2989719246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8009420 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fd6d9d640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd81f86f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800ebe0 tx=0x7f4fc800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800eee0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800cc30 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd0009a70 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8013470 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80b41a0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd80b4010 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fc80135d0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fbf7fe640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4fc4066280 0x7f4fc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.018+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4fc80840f0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.022+0000 7f4fd659c640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4fc4066280 0x7f4fc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.022+0000 7f4fd659c640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4fc4066280 0x7f4fc4068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc001ec0 tx=0x7f4fcc001990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.022+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4fc8054f20 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.178+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fd80cd6c0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.178+0000 7f4fbf7fe640 1 -- 172.21.15.3:0/2989719246 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7f4fc8054ab0 con 0x7f4fd80ce9e0 2023-05-17T11:46:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:22.190 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4fc4066280 msgr2=0x7f4fc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4fc4066280 0x7f4fc4068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc001ec0 tx=0x7f4fcc001990 comp rx=0 tx=0).stop 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 msgr2=0x7f4fd81f86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd81f86f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800ebe0 tx=0x7f4fc800c520 comp rx=0 tx=0).stop 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 shutdown_connections 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f4fc4066280 0x7f4fc4068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f4fd80d0fd0 0x7f4fd80d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80d0430 0x7f4fd815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 --2- 172.21.15.3:0/2989719246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4fd80ce9e0 0x7f4fd81f86f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 >> 172.21.15.3:0/2989719246 conn(0x7f4fd809bb70 msgr2=0x7f4fd806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 shutdown_connections 2023-05-17T11:46:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.182+0000 7f4fdd1bc640 1 -- 172.21.15.3:0/2989719246 wait complete. 2023-05-17T11:46:22.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:22.211 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:22.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 Processor -- start 2023-05-17T11:46:22.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 -- start start 2023-05-17T11:46:22.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f13f006ade0 0x7f13f00ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13f00adbc0 0x7f13f01603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f00cfb20 con 0x7f13f00703d0 2023-05-17T11:46:22.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f015ff10 con 0x7f13f006ade0 2023-05-17T11:46:22.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13f550a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f015fc10 con 0x7f13f00adbc0 2023-05-17T11:46:22.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f13f006ade0 0x7f13f00ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f13f006ade0 0x7f13f00ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37002/0 (socket says 172.21.15.3:37002) 2023-05-17T11:46:22.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 -- 172.21.15.3:0/4051376738 learned_addr learned my addr 172.21.15.3:0/4051376738 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:22.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13ee7fc640 1 --2- 172.21.15.3:0/4051376738 >> v2:172.21.15.60:3300/0 conn(0x7f13f00adbc0 0x7f13f01603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 -- 172.21.15.3:0/4051376738 >> v2:172.21.15.60:3300/0 conn(0x7f13f00adbc0 msgr2=0x7f13f01603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:22.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 --2- 172.21.15.3:0/4051376738 >> v2:172.21.15.60:3300/0 conn(0x7f13f00adbc0 0x7f13f01603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 -- 172.21.15.3:0/4051376738 >> v1:172.21.15.60:6789/0 conn(0x7f13f00703d0 legacy=0x7f13f00707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:22.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.342+0000 7f13eeffd640 1 -- 172.21.15.3:0/4051376738 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0071290 con 0x7f13f006ade0 2023-05-17T11:46:22.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13eeffd640 1 --2- 172.21.15.3:0/4051376738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f00ae110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f13f00cd400 tx=0x7f13e001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933a5b666ba641b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13edffb640 1 -- 172.21.15.3:0/4051376738 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00ab660 con 0x7f13f006ade0 2023-05-17T11:46:22.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13edffb640 1 -- 172.21.15.3:0/4051376738 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e00ab7c0 con 0x7f13f006ade0 2023-05-17T11:46:22.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13edffb640 1 -- 172.21.15.3:0/4051376738 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00abb50 con 0x7f13f006ade0 2023-05-17T11:46:22.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 -- 172.21.15.3:0/4051376738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 msgr2=0x7f13f00ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 --2- 172.21.15.3:0/4051376738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f00ae110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f13f00cd400 tx=0x7f13e001c440 comp rx=0 tx=0).stop 2023-05-17T11:46:22.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 -- 172.21.15.3:0/4051376738 shutdown_connections 2023-05-17T11:46:22.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 --2- 172.21.15.3:0/4051376738 >> v2:172.21.15.60:3300/0 conn(0x7f13f00adbc0 0x7f13f01603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 --2- 172.21.15.3:0/4051376738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f00ae110 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 -- 172.21.15.3:0/4051376738 >> 172.21.15.3:0/4051376738 conn(0x7f13f00b13c0 msgr2=0x7f13f00ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:22.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 -- 172.21.15.3:0/4051376738 shutdown_connections 2023-05-17T11:46:22.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.346+0000 7f13f550a640 1 -- 172.21.15.3:0/4051376738 wait complete. 2023-05-17T11:46:22.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 Processor -- start 2023-05-17T11:46:22.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 -- start start 2023-05-17T11:46:22.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f014e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f13f00703d0 0x7f13f014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00adbc0 0x7f13f0159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f01522f0 con 0x7f13f006ade0 2023-05-17T11:46:22.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0152590 con 0x7f13f00adbc0 2023-05-17T11:46:22.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0152870 con 0x7f13f00703d0 2023-05-17T11:46:22.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f014e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f014e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37016/0 (socket says 172.21.15.3:37016) 2023-05-17T11:46:22.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 -- 172.21.15.3:0/1923951861 learned_addr learned my addr 172.21.15.3:0/1923951861 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:22.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13ee7fc640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f13f00703d0 0x7f13f014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13ef7fe640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00adbc0 0x7f13f0159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 -- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f13f00703d0 msgr2=0x7f13f014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f13f00703d0 0x7f13f014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 -- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00adbc0 msgr2=0x7f13f0159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00adbc0 0x7f13f0159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 -- 172.21.15.3:0/1923951861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00094d0 con 0x7f13f006ade0 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13ee7fc640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f13f00703d0 0x7f13f014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13eeffd640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f014e580 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f13e0019050 tx=0x7f13e001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00b4800 con 0x7f13f006ade0 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e00b4960 con 0x7f13f006ade0 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f0160a70 con 0x7f13f006ade0 2023-05-17T11:46:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00b4d10 con 0x7f13f006ade0 2023-05-17T11:46:22.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.350+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f01608e0 con 0x7f13f006ade0 2023-05-17T11:46:22.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.354+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f006b1b0 con 0x7f13f006ade0 2023-05-17T11:46:22.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.354+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13e00a9070 con 0x7f13f006ade0 2023-05-17T11:46:22.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.354+0000 7f13d77fe640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f13dc066280 0x7f13dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.354+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f13e011e680 con 0x7f13f006ade0 2023-05-17T11:46:22.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.354+0000 7f13ee7fc640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f13dc066280 0x7f13dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.354+0000 7f13ee7fc640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f13dc066280 0x7f13dc068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f13f015ab80 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.358+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f13e00ebc80 con 0x7f13f006ade0 2023-05-17T11:46:22.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.510+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13f004de80 con 0x7f13f006ade0 2023-05-17T11:46:22.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.510+0000 7f13d77fe640 1 -- 172.21.15.3:0/1923951861 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13e00ef2a0 con 0x7f13f006ade0 2023-05-17T11:46:22.522 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f13dc066280 msgr2=0x7f13dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f13dc066280 0x7f13dc068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f13f015ab80 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 msgr2=0x7f13f014e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f014e580 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f13e0019050 tx=0x7f13e001ac80 comp rx=0 tx=0).stop 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 shutdown_connections 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f13dc066280 0x7f13dc068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00adbc0 0x7f13f0159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f13f00703d0 0x7f13f014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 --2- 172.21.15.3:0/1923951861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13f006ade0 0x7f13f014e580 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 >> 172.21.15.3:0/1923951861 conn(0x7f13f00b13c0 msgr2=0x7f13f00ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 shutdown_connections 2023-05-17T11:46:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.514+0000 7f13f550a640 1 -- 172.21.15.3:0/1923951861 wait complete. 2023-05-17T11:46:22.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:22.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 Processor -- start 2023-05-17T11:46:22.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 -- start start 2023-05-17T11:46:22.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd26c06cef0 0x7fd26c15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c15cb00 con 0x7fd26c156460 2023-05-17T11:46:22.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26c06ec30 con 0x7fd26c06cef0 2023-05-17T11:46:22.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd272952640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c15cde0 con 0x7fd26c06e7d0 2023-05-17T11:46:22.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd26c06cef0 0x7fd26c15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd270eef640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd26c06cef0 0x7fd26c15c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:41970/0 (socket says 172.21.15.3:41970) 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd270eef640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:40578/0 (socket says 172.21.15.3:40578) 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 -- 172.21.15.3:0/3539063045 learned_addr learned my addr 172.21.15.3:0/3539063045 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 -- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 msgr2=0x7fd26c0ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 --2- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 -- 172.21.15.3:0/3539063045 >> v1:172.21.15.60:6789/0 conn(0x7fd26c156460 legacy=0x7fd26c06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.674+0000 7fd26b7fe640 1 -- 172.21.15.3:0/3539063045 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c15d0c0 con 0x7fd26c06cef0 2023-05-17T11:46:22.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd26b7fe640 1 --2- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c06cef0 0x7fd26c15c4b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd260009870 tx=0x7fd26001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82044f8249f0d27c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd26affd640 1 -- 172.21.15.3:0/3539063045 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600aa430 con 0x7fd26c06cef0 2023-05-17T11:46:22.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd26affd640 1 -- 172.21.15.3:0/3539063045 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2600aa590 con 0x7fd26c06cef0 2023-05-17T11:46:22.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd26affd640 1 -- 172.21.15.3:0/3539063045 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600aa920 con 0x7fd26c06cef0 2023-05-17T11:46:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 -- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c06cef0 msgr2=0x7fd26c15c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 --2- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c06cef0 0x7fd26c15c4b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd260009870 tx=0x7fd26001c510 comp rx=0 tx=0).stop 2023-05-17T11:46:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 -- 172.21.15.3:0/3539063045 shutdown_connections 2023-05-17T11:46:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 --2- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 --2- 172.21.15.3:0/3539063045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c06cef0 0x7fd26c15c4b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 -- 172.21.15.3:0/3539063045 >> 172.21.15.3:0/3539063045 conn(0x7fd26c0b14a0 msgr2=0x7fd26c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 -- 172.21.15.3:0/3539063045 shutdown_connections 2023-05-17T11:46:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.678+0000 7fd272952640 1 -- 172.21.15.3:0/3539063045 wait complete. 2023-05-17T11:46:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 Processor -- start 2023-05-17T11:46:22.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 -- start start 2023-05-17T11:46:22.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 0x7fd26c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c156460 0x7fd26c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c1601a0 con 0x7fd26c06cef0 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0cd6f0 con 0x7fd26c156460 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0ccae0 con 0x7fd26c06e7d0 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 0x7fd26c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 0x7fd26c0cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37018/0 (socket says 172.21.15.3:37018) 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 -- 172.21.15.3:0/3660842015 learned_addr learned my addr 172.21.15.3:0/3660842015 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26b7fe640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd270eef640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c156460 0x7fd26c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 -- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 msgr2=0x7fd26c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 -- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c156460 msgr2=0x7fd26c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c156460 0x7fd26c0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 -- 172.21.15.3:0/3660842015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600094d0 con 0x7fd26c06cef0 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd26bfff640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 0x7fd26c0cc470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c3c0 tx=0x7fd25c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0052d0 con 0x7fd26c06cef0 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c005430 con 0x7fd26c06cef0 2023-05-17T11:46:22.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c1569c0 con 0x7fd26c06cef0 2023-05-17T11:46:22.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.682+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c003840 con 0x7fd26c06cef0 2023-05-17T11:46:22.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c156830 con 0x7fd26c06cef0 2023-05-17T11:46:22.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c0ae440 con 0x7fd26c06cef0 2023-05-17T11:46:22.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd25c0039a0 con 0x7fd26c06cef0 2023-05-17T11:46:22.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd268ff9640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd2580662b0 0x7fd258068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:22.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd25c0831f0 con 0x7fd26c06cef0 2023-05-17T11:46:22.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd26b7fe640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd2580662b0 0x7fd258068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:22.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.686+0000 7fd26b7fe640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd2580662b0 0x7fd258068760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd2600ae000 tx=0x7fd2600b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:22.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.690+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd25c0506d0 con 0x7fd26c06cef0 2023-05-17T11:46:22.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.846+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd26c04de80 con 0x7fd26c06cef0 2023-05-17T11:46:22.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.846+0000 7fd268ff9640 1 -- 172.21.15.3:0/3660842015 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd25c053cf0 con 0x7fd26c06cef0 2023-05-17T11:46:22.857 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:22.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd2580662b0 msgr2=0x7fd258068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd2580662b0 0x7fd258068760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd2600ae000 tx=0x7fd2600b5040 comp rx=0 tx=0).stop 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 msgr2=0x7fd26c0cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 0x7fd26c0cc470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c3c0 tx=0x7fd25c00c880 comp rx=0 tx=0).stop 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 shutdown_connections 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fd2580662b0 0x7fd258068760 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c156460 0x7fd26c0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fd26c06e7d0 0x7fd26c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 --2- 172.21.15.3:0/3660842015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd26c06cef0 0x7fd26c0cc470 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:22.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 >> 172.21.15.3:0/3660842015 conn(0x7fd26c0b14a0 msgr2=0x7fd26c0cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:22.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 shutdown_connections 2023-05-17T11:46:22.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:22.850+0000 7fd272952640 1 -- 172.21.15.3:0/3660842015 wait complete. 2023-05-17T11:46:22.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:23.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 Processor -- start 2023-05-17T11:46:23.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 -- start start 2023-05-17T11:46:23.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c440b2770 0x7f6c440cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c4406d380 0x7f6c440c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4409c120 con 0x7f6c4409bcb0 2023-05-17T11:46:23.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4406ca70 con 0x7f6c4406d380 2023-05-17T11:46:23.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.006+0000 7f6c49c2d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440cdd30 con 0x7f6c440b2770 2023-05-17T11:46:23.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c4406d380 0x7f6c440c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c4406d380 0x7f6c440c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37032/0 (socket says 172.21.15.3:37032) 2023-05-17T11:46:23.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 -- 172.21.15.3:0/1036369295 learned_addr learned my addr 172.21.15.3:0/1036369295 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c437fe640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c440b2770 0x7f6c440cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 -- 172.21.15.3:0/1036369295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c440b2770 msgr2=0x7f6c440cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c440b2770 0x7f6c440cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 -- 172.21.15.3:0/1036369295 >> v1:172.21.15.60:6789/0 conn(0x7f6c4409bcb0 legacy=0x7f6c4406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 -- 172.21.15.3:0/1036369295 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4406c500 con 0x7f6c4406d380 2023-05-17T11:46:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c437fe640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c440b2770 0x7f6c440cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c43fff640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4406d380 0x7f6c440c9950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009e50 tx=0x7f6c3c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f968165d5b8c217e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c427fc640 1 -- 172.21.15.3:0/1036369295 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0a57d0 con 0x7f6c4406d380 2023-05-17T11:46:23.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c427fc640 1 -- 172.21.15.3:0/1036369295 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0a5930 con 0x7f6c4406d380 2023-05-17T11:46:23.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.010+0000 7f6c427fc640 1 -- 172.21.15.3:0/1036369295 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0a5cc0 con 0x7f6c4406d380 2023-05-17T11:46:23.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- 172.21.15.3:0/1036369295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4406d380 msgr2=0x7f6c440c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4406d380 0x7f6c440c9950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009e50 tx=0x7f6c3c01ca10 comp rx=0 tx=0).stop 2023-05-17T11:46:23.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- 172.21.15.3:0/1036369295 shutdown_connections 2023-05-17T11:46:23.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4406d380 0x7f6c440c9950 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/1036369295 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c440b2770 0x7f6c440cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- 172.21.15.3:0/1036369295 >> 172.21.15.3:0/1036369295 conn(0x7f6c4406a6e0 msgr2=0x7f6c440cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:23.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- 172.21.15.3:0/1036369295 shutdown_connections 2023-05-17T11:46:23.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- 172.21.15.3:0/1036369295 wait complete. 2023-05-17T11:46:23.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 Processor -- start 2023-05-17T11:46:23.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- start start 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4406d380 0x7f6c440c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4409bcb0 0x7f6c4415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 0x7f6c44098a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440c4960 con 0x7f6c440b2770 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440ae620 con 0x7f6c4406d380 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c49c2d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440ae870 con 0x7f6c4409bcb0 2023-05-17T11:46:23.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 0x7f6c44098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 0x7f6c44098a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37042/0 (socket says 172.21.15.3:37042) 2023-05-17T11:46:23.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 -- 172.21.15.3:0/3232953354 learned_addr learned my addr 172.21.15.3:0/3232953354 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:23.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c437fe640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4406d380 0x7f6c440c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c42ffd640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4409bcb0 0x7f6c4415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 -- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4409bcb0 msgr2=0x7f6c4415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4409bcb0 0x7f6c4415ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 -- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4406d380 msgr2=0x7f6c440c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4406d380 0x7f6c440c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.014+0000 7f6c43fff640 1 -- 172.21.15.3:0/3232953354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c009b30 con 0x7f6c440b2770 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c43fff640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 0x7f6c44098a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c01a640 tx=0x7f6c3c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0b8670 con 0x7f6c440b2770 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0b87d0 con 0x7f6c440b2770 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0b8b60 con 0x7f6c440b2770 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c440b2cd0 con 0x7f6c440b2770 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c440b2b40 con 0x7f6c440b2770 2023-05-17T11:46:23.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c440c9e90 con 0x7f6c440b2770 2023-05-17T11:46:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.018+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c3c0b8cc0 con 0x7f6c440b2770 2023-05-17T11:46:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.022+0000 7f6c2bfff640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c30066280 0x7f6c30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.022+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c3c11f470 con 0x7f6c440b2770 2023-05-17T11:46:23.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.022+0000 7f6c437fe640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c30066280 0x7f6c30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.022+0000 7f6c437fe640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c30066280 0x7f6c30068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400ab60 tx=0x7f6c34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.026+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6c3c0ec950 con 0x7f6c440b2770 2023-05-17T11:46:23.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.178+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c4404de80 con 0x7f6c440b2770 2023-05-17T11:46:23.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.178+0000 7f6c2bfff640 1 -- 172.21.15.3:0/3232953354 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c3c0eff70 con 0x7f6c440b2770 2023-05-17T11:46:23.190 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:23.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c30066280 msgr2=0x7f6c30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c30066280 0x7f6c30068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400ab60 tx=0x7f6c34008040 comp rx=0 tx=0).stop 2023-05-17T11:46:23.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 msgr2=0x7f6c44098a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 0x7f6c44098a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c01a640 tx=0x7f6c3c0197b0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 shutdown_connections 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c30066280 0x7f6c30068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c440b2770 0x7f6c44098a70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4409bcb0 0x7f6c4415ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 --2- 172.21.15.3:0/3232953354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4406d380 0x7f6c440c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 >> 172.21.15.3:0/3232953354 conn(0x7f6c4406a6e0 msgr2=0x7f6c440ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:23.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 shutdown_connections 2023-05-17T11:46:23.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.182+0000 7f6c49c2d640 1 -- 172.21.15.3:0/3232953354 wait complete. 2023-05-17T11:46:23.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:23.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.338+0000 7f24fa812640 1 Processor -- start 2023-05-17T11:46:23.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.338+0000 7f24fa812640 1 -- start start 2023-05-17T11:46:23.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24fa812640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f24f406d940 0x7f24f406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24fa812640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24f40cf090 0x7f24f40c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24fa812640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f415c760 con 0x7f24f40cec30 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24fa812640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40cdf60 con 0x7f24f40cf090 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24fa812640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40ccd40 con 0x7f24f406d940 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24f40cf090 0x7f24f40c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24f40cf090 0x7f24f40c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37052/0 (socket says 172.21.15.3:37052) 2023-05-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 -- 172.21.15.3:0/1045621767 learned_addr learned my addr 172.21.15.3:0/1045621767 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f3fff640 1 --2- 172.21.15.3:0/1045621767 >> v2:172.21.15.60:3300/0 conn(0x7f24f406d940 0x7f24f406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 -- 172.21.15.3:0/1045621767 >> v2:172.21.15.60:3300/0 conn(0x7f24f406d940 msgr2=0x7f24f406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 --2- 172.21.15.3:0/1045621767 >> v2:172.21.15.60:3300/0 conn(0x7f24f406d940 0x7f24f406dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 -- 172.21.15.3:0/1045621767 >> v1:172.21.15.60:6789/0 conn(0x7f24f40cec30 legacy=0x7f24f40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 -- 172.21.15.3:0/1045621767 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f406e250 con 0x7f24f40cf090 2023-05-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f3fff640 1 --2- 172.21.15.3:0/1045621767 >> v2:172.21.15.60:3300/0 conn(0x7f24f406d940 0x7f24f406dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f8daf640 1 --2- 172.21.15.3:0/1045621767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f40cf090 0x7f24f40c9ad0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f24f4071f00 tx=0x7f24ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a6e4987739d961 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f2ffd640 1 -- 172.21.15.3:0/1045621767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0a5860 con 0x7f24f40cf090 2023-05-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f2ffd640 1 -- 172.21.15.3:0/1045621767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec0a59c0 con 0x7f24f40cf090 2023-05-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.342+0000 7f24f2ffd640 1 -- 172.21.15.3:0/1045621767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0a5d50 con 0x7f24f40cf090 2023-05-17T11:46:23.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- 172.21.15.3:0/1045621767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f40cf090 msgr2=0x7f24f40c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 --2- 172.21.15.3:0/1045621767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f40cf090 0x7f24f40c9ad0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f24f4071f00 tx=0x7f24ec01c9a0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- 172.21.15.3:0/1045621767 shutdown_connections 2023-05-17T11:46:23.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 --2- 172.21.15.3:0/1045621767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f40cf090 0x7f24f40c9ad0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 --2- 172.21.15.3:0/1045621767 >> v2:172.21.15.60:3300/0 conn(0x7f24f406d940 0x7f24f406dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- 172.21.15.3:0/1045621767 >> 172.21.15.3:0/1045621767 conn(0x7f24f406b4e0 msgr2=0x7f24f40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:23.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- 172.21.15.3:0/1045621767 shutdown_connections 2023-05-17T11:46:23.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- 172.21.15.3:0/1045621767 wait complete. 2023-05-17T11:46:23.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 Processor -- start 2023-05-17T11:46:23.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- start start 2023-05-17T11:46:23.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 0x7f24f4147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f24f40cec30 0x7f24f40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24f40cf090 0x7f24f415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40c7c20 con 0x7f24f406d940 2023-05-17T11:46:23.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40c7010 con 0x7f24f40cf090 2023-05-17T11:46:23.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24fa812640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40c72f0 con 0x7f24f40cec30 2023-05-17T11:46:23.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 0x7f24f4147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 0x7f24f4147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37062/0 (socket says 172.21.15.3:37062) 2023-05-17T11:46:23.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24f3fff640 1 -- 172.21.15.3:0/1319721115 learned_addr learned my addr 172.21.15.3:0/1319721115 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:23.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24f8daf640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24f40cf090 0x7f24f415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.346+0000 7f24f37fe640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f24f40cec30 0x7f24f40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f3fff640 1 -- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f24f40cec30 msgr2=0x7f24f40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f3fff640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f24f40cec30 0x7f24f40c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f3fff640 1 -- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24f40cf090 msgr2=0x7f24f415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f3fff640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24f40cf090 0x7f24f415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f3fff640 1 -- 172.21.15.3:0/1319721115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec009b30 con 0x7f24f406d940 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f37fe640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f24f40cec30 0x7f24f40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f3fff640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 0x7f24f4147ba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f24e400e810 tx=0x7f24e400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400c8d0 con 0x7f24f406d940 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f40ce710 con 0x7f24f406d940 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e400ca30 con 0x7f24f406d940 2023-05-17T11:46:23.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400cdc0 con 0x7f24f406d940 2023-05-17T11:46:23.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f40ce430 con 0x7f24f406d940 2023-05-17T11:46:23.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f40ca420 con 0x7f24f406d940 2023-05-17T11:46:23.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24e4013410 con 0x7f24f406d940 2023-05-17T11:46:23.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f0ff9640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f24e0066280 0x7f24e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f24e4083ac0 con 0x7f24f406d940 2023-05-17T11:46:23.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.350+0000 7f24f37fe640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f24e0066280 0x7f24e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.354+0000 7f24f37fe640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f24e0066280 0x7f24e0068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24f409cdc0 tx=0x7f24e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.354+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f24e4050fa0 con 0x7f24f406d940 2023-05-17T11:46:23.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.506+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24f404de80 con 0x7f24f406d940 2023-05-17T11:46:23.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.506+0000 7f24f0ff9640 1 -- 172.21.15.3:0/1319721115 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24e40545c0 con 0x7f24f406d940 2023-05-17T11:46:23.518 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:23.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f24e0066280 msgr2=0x7f24e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f24e0066280 0x7f24e0068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24f409cdc0 tx=0x7f24e8009040 comp rx=0 tx=0).stop 2023-05-17T11:46:23.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 msgr2=0x7f24f4147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 0x7f24f4147ba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f24e400e810 tx=0x7f24e400ecd0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 shutdown_connections 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f24e0066280 0x7f24e0068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24f40cf090 0x7f24f415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f24f40cec30 0x7f24f40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 --2- 172.21.15.3:0/1319721115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f406d940 0x7f24f4147ba0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 >> 172.21.15.3:0/1319721115 conn(0x7f24f406b4e0 msgr2=0x7f24f4158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:23.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 shutdown_connections 2023-05-17T11:46:23.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.510+0000 7f24fa812640 1 -- 172.21.15.3:0/1319721115 wait complete. 2023-05-17T11:46:23.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:23.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 Processor -- start 2023-05-17T11:46:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 -- start start 2023-05-17T11:46:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b8069ab0 0x7fc0b8069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0b806fbd0 0x7fc0b815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b806c450 con 0x7fc0b815e040 2023-05-17T11:46:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b815eaa0 con 0x7fc0b806fbd0 2023-05-17T11:46:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0bd796640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b815a410 con 0x7fc0b8069ab0 2023-05-17T11:46:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.670+0000 7fc0b6ffd640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b8069ab0 0x7fc0b8069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0affff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0b806fbd0 0x7fc0b815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0b815e040 0x7fc0b80c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:36378/0 (socket says 172.21.15.3:36378) 2023-05-17T11:46:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b77fe640 1 -- 172.21.15.3:0/1859769137 learned_addr learned my addr 172.21.15.3:0/1859769137 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0affff640 1 -- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b8069ab0 msgr2=0x7fc0b8069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0affff640 1 --2- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b8069ab0 0x7fc0b8069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0affff640 1 -- 172.21.15.3:0/1859769137 >> v1:172.21.15.60:6789/0 conn(0x7fc0b815e040 legacy=0x7fc0b80c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0affff640 1 -- 172.21.15.3:0/1859769137 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b806be40 con 0x7fc0b806fbd0 2023-05-17T11:46:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b67fc640 1 -- 172.21.15.3:0/1859769137 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950694901 0 0) 0x7fc0b806c450 con 0x7fc0b815e040 2023-05-17T11:46:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b6ffd640 1 --2- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b8069ab0 0x7fc0b8069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0affff640 1 --2- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b815db00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00097c0 tx=0x7fc0a001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a1776ae8c84fcf3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b67fc640 1 -- 172.21.15.3:0/1859769137 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00a8970 con 0x7fc0b806fbd0 2023-05-17T11:46:23.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b67fc640 1 -- 172.21.15.3:0/1859769137 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00a8ad0 con 0x7fc0b806fbd0 2023-05-17T11:46:23.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.674+0000 7fc0b67fc640 1 -- 172.21.15.3:0/1859769137 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00a8e60 con 0x7fc0b806fbd0 2023-05-17T11:46:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 msgr2=0x7fc0b815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 --2- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b815db00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00097c0 tx=0x7fc0a001ec70 comp rx=0 tx=0).stop 2023-05-17T11:46:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- 172.21.15.3:0/1859769137 shutdown_connections 2023-05-17T11:46:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 --2- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b815db00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 --2- 172.21.15.3:0/1859769137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b8069ab0 0x7fc0b8069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- 172.21.15.3:0/1859769137 >> 172.21.15.3:0/1859769137 conn(0x7fc0b80b0b20 msgr2=0x7fc0b80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- 172.21.15.3:0/1859769137 shutdown_connections 2023-05-17T11:46:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- 172.21.15.3:0/1859769137 wait complete. 2023-05-17T11:46:23.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 Processor -- start 2023-05-17T11:46:23.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- start start 2023-05-17T11:46:23.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 0x7fc0b8152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b815e040 0x7fc0b8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80b2c10 con 0x7fc0b8069ab0 2023-05-17T11:46:23.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8153110 con 0x7fc0b806fbd0 2023-05-17T11:46:23.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0bd796640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80b2090 con 0x7fc0b815e040 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 0x7fc0b8152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 0x7fc0b8152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37064/0 (socket says 172.21.15.3:37064) 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 -- 172.21.15.3:0/3563975345 learned_addr learned my addr 172.21.15.3:0/3563975345 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b77fe640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b815e040 0x7fc0b8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0affff640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 -- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b815e040 msgr2=0x7fc0b8154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b815e040 0x7fc0b8154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 -- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 msgr2=0x7fc0b8153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b8153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.678+0000 7fc0b6ffd640 1 -- 172.21.15.3:0/3563975345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80093b0 con 0x7fc0b8069ab0 2023-05-17T11:46:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0b6ffd640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 0x7fc0b8152bd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800ebe0 tx=0x7fc0a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8009760 con 0x7fc0b8069ab0 2023-05-17T11:46:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800cbd0 con 0x7fc0b8069ab0 2023-05-17T11:46:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a0009420 con 0x7fc0b8069ab0 2023-05-17T11:46:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800eee0 con 0x7fc0b8069ab0 2023-05-17T11:46:23.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b815e4e0 con 0x7fc0b8069ab0 2023-05-17T11:46:23.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b806a3c0 con 0x7fc0b8069ab0 2023-05-17T11:46:23.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0a80059a0 con 0x7fc0b8069ab0 2023-05-17T11:46:23.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0af7fe640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc098066280 0x7fc098068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:23.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc0a8084270 con 0x7fc0b8069ab0 2023-05-17T11:46:23.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.682+0000 7fc0affff640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc098066280 0x7fc098068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:23.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.686+0000 7fc0affff640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc098066280 0x7fc098068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b2000 tx=0x7fc0a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.686+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc0a8051630 con 0x7fc0b8069ab0 2023-05-17T11:46:23.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc0b80c1d80 con 0x7fc0b8069ab0 2023-05-17T11:46:23.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0af7fe640 1 -- 172.21.15.3:0/3563975345 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0a8020080 con 0x7fc0b8069ab0 2023-05-17T11:46:23.864 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:23.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc098066280 msgr2=0x7fc098068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc098066280 0x7fc098068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b2000 tx=0x7fc0a0008040 comp rx=0 tx=0).stop 2023-05-17T11:46:23.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 msgr2=0x7fc0b8152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:23.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 0x7fc0b8152bd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800ebe0 tx=0x7fc0a800c520 comp rx=0 tx=0).stop 2023-05-17T11:46:23.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 shutdown_connections 2023-05-17T11:46:23.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fc098066280 0x7fc098068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fc0b815e040 0x7fc0b8154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b806fbd0 0x7fc0b8153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 --2- 172.21.15.3:0/3563975345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0b8069ab0 0x7fc0b8152bd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:23.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 >> 172.21.15.3:0/3563975345 conn(0x7fc0b80b0b20 msgr2=0x7fc0b815d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:23.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 shutdown_connections 2023-05-17T11:46:23.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:23.854+0000 7fc0bd796640 1 -- 172.21.15.3:0/3563975345 wait complete. 2023-05-17T11:46:23.884 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-05-17T11:46:23.884 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T11:46:23.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:24.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.018+0000 7f3691e2d640 1 Processor -- start 2023-05-17T11:46:24.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f3691e2d640 1 -- start start 2023-05-17T11:46:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f3691e2d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 0x7f368c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f3691e2d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c06d790 con 0x7f368c06d9f0 2023-05-17T11:46:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f3691e2d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c15cc20 con 0x7f368c15d0b0 2023-05-17T11:46:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f3691e2d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c06d1d0 con 0x7f368c0cbf20 2023-05-17T11:46:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368b7fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f368c06d9f0 0x7f368c06ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50466/0 (socket says 172.21.15.3:50466) 2023-05-17T11:46:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368b7fe640 1 -- 172.21.15.3:0/3844719904 learned_addr learned my addr 172.21.15.3:0/3844719904 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 0x7f368c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266328142 0 0) 0x7f368c06d790 con 0x7f368c06d9f0 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3674003530 con 0x7f368c06d9f0 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2546724165 0 0) 0x7f3674003530 con 0x7f368c06d9f0 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 msgr2=0x7f368c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 0x7f368c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 >> v1:172.21.15.60:6789/0 conn(0x7f368c15d0b0 legacy=0x7f368c15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c06d4b0 con 0x7f368c06d9f0 2023-05-17T11:46:24.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f367c001680 con 0x7f368c06d9f0 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 >> v1:172.21.15.3:6789/0 conn(0x7f368c06d9f0 legacy=0x7f368c06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3674003a20 0x7f3674003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f3674004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 0x7f3674005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c06d1d0 con 0x7f36740047d0 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367400ba40 con 0x7f3674003a20 2023-05-17T11:46:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367400bbb0 con 0x7f368c0cbf20 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f3674004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368b7fe640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3674003a20 0x7f3674003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368bfff640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 0x7f3674005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 -- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 msgr2=0x7f3674005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0cbf20 0x7f3674005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 -- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3674003a20 msgr2=0x7f3674003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3674003a20 0x7f3674003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.022+0000 7f368affd640 1 -- 172.21.15.3:0/3844719904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674003530 con 0x7f36740047d0 2023-05-17T11:46:24.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f368affd640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f3674004c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3680009ae0 tx=0x7f368001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01ae536ab14edad server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800a5640 con 0x7f36740047d0 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36800a57a0 con 0x7f36740047d0 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f368a7fc640 1 -- 172.21.15.3:0/3844719904 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800a5b50 con 0x7f36740047d0 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f3691e2d640 1 -- 172.21.15.3:0/3844719904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 msgr2=0x7f3674004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3844719904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f3674004c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3680009ae0 tx=0x7f368001ca50 comp rx=0 tx=0).stop 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f368bfff640 1 -- 172.21.15.3:0/3844719904 reap_dead start 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f3691e2d640 1 -- 172.21.15.3:0/3844719904 shutdown_connections 2023-05-17T11:46:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f3691e2d640 1 -- 172.21.15.3:0/3844719904 >> 172.21.15.3:0/3844719904 conn(0x7f368c06b4e0 msgr2=0x7f368c0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:24.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f3691e2d640 1 -- 172.21.15.3:0/3844719904 shutdown_connections 2023-05-17T11:46:24.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.026+0000 7f3691e2d640 1 -- 172.21.15.3:0/3844719904 wait complete. 2023-05-17T11:46:24.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 Processor -- start 2023-05-17T11:46:24.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- start start 2023-05-17T11:46:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f368c0c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0b4f10 0x7f368c1499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0c49a0 0x7f368c0c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0c6280 con 0x7f36740047d0 2023-05-17T11:46:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0b5380 con 0x7f368c0c49a0 2023-05-17T11:46:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0c5670 con 0x7f368c0b4f10 2023-05-17T11:46:24.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f368c0c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f368c0c2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37076/0 (socket says 172.21.15.3:37076) 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 -- 172.21.15.3:0/3745884410 learned_addr learned my addr 172.21.15.3:0/3745884410 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368affd640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0b4f10 0x7f368c1499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368bfff640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0c49a0 0x7f368c0c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 -- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0b4f10 msgr2=0x7f368c1499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0b4f10 0x7f368c1499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 -- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0c49a0 msgr2=0x7f368c0c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0c49a0 0x7f368c0c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 -- 172.21.15.3:0/3745884410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0cccd0 con 0x7f36740047d0 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368bfff640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0c49a0 0x7f368c0c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f368b7fe640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f368c0c2fd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f367c00e7f0 tx=0x7f367c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00c8d0 con 0x7f36740047d0 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c00ca30 con 0x7f36740047d0 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00cde0 con 0x7f36740047d0 2023-05-17T11:46:24.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c15c8b0 con 0x7f36740047d0 2023-05-17T11:46:24.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c15d530 con 0x7f36740047d0 2023-05-17T11:46:24.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.030+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c04de80 con 0x7f36740047d0 2023-05-17T11:46:24.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.034+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f367c01d460 con 0x7f36740047d0 2023-05-17T11:46:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.034+0000 7f3673fff640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3678066280 0x7f3678068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.034+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f367c083c40 con 0x7f36740047d0 2023-05-17T11:46:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.034+0000 7f368affd640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3678066280 0x7f3678068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.034+0000 7f368affd640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3678066280 0x7f3678068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f36800af000 tx=0x7f36800046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.038+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f367c051110 con 0x7f36740047d0 2023-05-17T11:46:24.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.190+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f368c04de80 con 0x7f36740047d0 2023-05-17T11:46:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3673fff640 1 -- 172.21.15.3:0/3745884410 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7f367c054730 con 0x7f36740047d0 2023-05-17T11:46:24.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:24.204 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3678066280 msgr2=0x7f3678068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3678066280 0x7f3678068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f36800af000 tx=0x7f36800046d0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 msgr2=0x7f368c0c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f368c0c2fd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f367c00e7f0 tx=0x7f367c00ecb0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 shutdown_connections 2023-05-17T11:46:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3678066280 0x7f3678068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0c49a0 0x7f368c0c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f368c0b4f10 0x7f368c1499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 --2- 172.21.15.3:0/3745884410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36740047d0 0x7f368c0c2fd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 >> 172.21.15.3:0/3745884410 conn(0x7f368c06b4e0 msgr2=0x7f368c0ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:24.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 shutdown_connections 2023-05-17T11:46:24.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.194+0000 7f3691e2d640 1 -- 172.21.15.3:0/3745884410 wait complete. 2023-05-17T11:46:24.224 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:24.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:24.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.354+0000 7f2e45d8e640 1 Processor -- start 2023-05-17T11:46:24.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.354+0000 7f2e45d8e640 1 -- start start 2023-05-17T11:46:24.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e45d8e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 0x7f2e4006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e45d8e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4006abb0 con 0x7f2e400ceac0 2023-05-17T11:46:24.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e45d8e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e400cdbd0 con 0x7f2e400b19f0 2023-05-17T11:46:24.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e45d8e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400cdeb0 con 0x7f2e400d0ab0 2023-05-17T11:46:24.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2e400ceac0 0x7f2e4006b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50476/0 (socket says 172.21.15.3:50476) 2023-05-17T11:46:24.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 -- 172.21.15.3:0/4250582009 learned_addr learned my addr 172.21.15.3:0/4250582009 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3ffff640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 0x7f2e4006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644540815 0 0) 0x7f2e4006abb0 con 0x7f2e400ceac0 2023-05-17T11:46:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e30003530 con 0x7f2e400ceac0 2023-05-17T11:46:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 568427593 0 0) 0x7f2e30003530 con 0x7f2e400ceac0 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 msgr2=0x7f2e4006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 0x7f2e4006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 >> v1:172.21.15.60:6789/0 conn(0x7f2e400b19f0 legacy=0x7f2e400d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400ce190 con 0x7f2e400ceac0 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f2e38001a00 con 0x7f2e400ceac0 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 >> v1:172.21.15.3:6789/0 conn(0x7f2e400ceac0 legacy=0x7f2e4006b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e300039b0 0x7f2e30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 0x7f2e300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e30004d10 0x7f2e30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400cdeb0 con 0x7f2e30004d10 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3000bb50 con 0x7f2e300039b0 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3000bd10 con 0x7f2e400d0ab0 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e30004d10 0x7f2e30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e44d8c640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e300039b0 0x7f2e30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e3ffff640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 0x7f2e300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 -- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 msgr2=0x7f2e300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e400d0ab0 0x7f2e300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 -- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e300039b0 msgr2=0x7f2e30003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e300039b0 0x7f2e30003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.358+0000 7f2e4558d640 1 -- 172.21.15.3:0/4250582009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30003530 con 0x7f2e30004d10 2023-05-17T11:46:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e4558d640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e30004d10 0x7f2e30005180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800a800 tx=0x7f2e3801d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb602854de76d45 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380072d0 con 0x7f2e30004d10 2023-05-17T11:46:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e380a8070 con 0x7f2e30004d10 2023-05-17T11:46:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e3f7fe640 1 -- 172.21.15.3:0/4250582009 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380076b0 con 0x7f2e30004d10 2023-05-17T11:46:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 -- 172.21.15.3:0/4250582009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e30004d10 msgr2=0x7f2e30005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/4250582009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e30004d10 0x7f2e30005180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800a800 tx=0x7f2e3801d2d0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e4558d640 1 -- 172.21.15.3:0/4250582009 reap_dead start 2023-05-17T11:46:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 -- 172.21.15.3:0/4250582009 shutdown_connections 2023-05-17T11:46:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 -- 172.21.15.3:0/4250582009 >> 172.21.15.3:0/4250582009 conn(0x7f2e4009bb20 msgr2=0x7f2e400d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 -- 172.21.15.3:0/4250582009 shutdown_connections 2023-05-17T11:46:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 -- 172.21.15.3:0/4250582009 wait complete. 2023-05-17T11:46:24.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.362+0000 7f2e45d8e640 1 Processor -- start 2023-05-17T11:46:24.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- start start 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e30004d10 0x7f2e4015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 0x7f2e4015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e400b2230 0x7f2e40162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400c9c80 con 0x7f2e400b3e80 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4015a9e0 con 0x7f2e400b2230 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400b2ba0 con 0x7f2e30004d10 2023-05-17T11:46:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 0x7f2e4015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 0x7f2e4015d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37092/0 (socket says 172.21.15.3:37092) 2023-05-17T11:46:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 -- 172.21.15.3:0/343684697 learned_addr learned my addr 172.21.15.3:0/343684697 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e4558d640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e400b2230 0x7f2e40162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e44d8c640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e30004d10 0x7f2e4015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 -- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e30004d10 msgr2=0x7f2e4015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e30004d10 0x7f2e4015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 -- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e400b2230 msgr2=0x7f2e40162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e400b2230 0x7f2e40162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 -- 172.21.15.3:0/343684697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4006b4b0 con 0x7f2e400b3e80 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3ffff640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 0x7f2e4015d150 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c011940 tx=0x7f2e2c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004240 con 0x7f2e400b3e80 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c0043a0 con 0x7f2e400b3e80 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c00fb00 con 0x7f2e400b3e80 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4006b320 con 0x7f2e400b3e80 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4006b640 con 0x7f2e400b3e80 2023-05-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.366+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e400c9dc0 con 0x7f2e400b3e80 2023-05-17T11:46:24.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.370+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e2c00fc60 con 0x7f2e400b3e80 2023-05-17T11:46:24.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.370+0000 7f2e3d7fa640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e240662b0 0x7f2e24068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.370+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2e2c0843c0 con 0x7f2e400b3e80 2023-05-17T11:46:24.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.370+0000 7f2e44d8c640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e240662b0 0x7f2e24068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.370+0000 7f2e44d8c640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e240662b0 0x7f2e24068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e34001100 tx=0x7f2e34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.374+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2e400c9dc0 con 0x7f2e400b3e80 2023-05-17T11:46:24.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.526+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e400c9dc0 con 0x7f2e400b3e80 2023-05-17T11:46:24.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e3d7fa640 1 -- 172.21.15.3:0/343684697 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e400c9dc0 con 0x7f2e400b3e80 2023-05-17T11:46:24.539 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:24.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e240662b0 msgr2=0x7f2e24068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e240662b0 0x7f2e24068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e34001100 tx=0x7f2e34009040 comp rx=0 tx=0).stop 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 msgr2=0x7f2e4015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 0x7f2e4015d150 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c011940 tx=0x7f2e2c011e00 comp rx=0 tx=0).stop 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 shutdown_connections 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f2e240662b0 0x7f2e24068760 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e400b2230 0x7f2e40162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e400b3e80 0x7f2e4015d150 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 --2- 172.21.15.3:0/343684697 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2e30004d10 0x7f2e4015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 >> 172.21.15.3:0/343684697 conn(0x7f2e4009bb20 msgr2=0x7f2e400b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:24.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 shutdown_connections 2023-05-17T11:46:24.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.530+0000 7f2e45d8e640 1 -- 172.21.15.3:0/343684697 wait complete. 2023-05-17T11:46:24.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:24.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.690+0000 7fa9fdcb6640 1 Processor -- start 2023-05-17T11:46:24.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.690+0000 7fa9fdcb6640 1 -- start start 2023-05-17T11:46:24.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.690+0000 7fa9fdcb6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa9f809bd90 0x7fa9f80ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9fdcb6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f806d020 con 0x7fa9f806b4d0 2023-05-17T11:46:24.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9fdcb6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80b2d20 con 0x7fa9f80b2950 2023-05-17T11:46:24.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9fdcb6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f81591b0 con 0x7fa9f809bd90 2023-05-17T11:46:24.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa9f806b4d0 0x7fa9f806b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50488/0 (socket says 172.21.15.3:50488) 2023-05-17T11:46:24.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f7fff640 1 -- 172.21.15.3:0/1310310250 learned_addr learned my addr 172.21.15.3:0/1310310250 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f6ffd640 1 --2- 172.21.15.3:0/1310310250 >> v2:172.21.15.60:3300/0 conn(0x7fa9f809bd90 0x7fa9f80ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f67fc640 1 -- 172.21.15.3:0/1310310250 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815470931 0 0) 0x7fa9f806d020 con 0x7fa9f806b4d0 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f67fc640 1 -- 172.21.15.3:0/1310310250 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e0003530 con 0x7fa9f806b4d0 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f6ffd640 1 -- 172.21.15.3:0/1310310250 >> v1:172.21.15.60:6789/0 conn(0x7fa9f80b2950 legacy=0x7fa9f80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f67fc640 1 -- 172.21.15.3:0/1310310250 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926422456 0 0) 0x7fa9f80b2d20 con 0x7fa9f80b2950 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f6ffd640 1 -- 172.21.15.3:0/1310310250 >> v1:172.21.15.3:6789/0 conn(0x7fa9f806b4d0 legacy=0x7fa9f806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.694+0000 7fa9f6ffd640 1 -- 172.21.15.3:0/1310310250 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80cc0a0 con 0x7fa9f809bd90 2023-05-17T11:46:24.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9f6ffd640 1 --2- 172.21.15.3:0/1310310250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f80ad760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0097c0 tx=0x7fa9ec01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0bda0dea028322 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9f67fc640 1 -- 172.21.15.3:0/1310310250 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0ad660 con 0x7fa9f809bd90 2023-05-17T11:46:24.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9f67fc640 1 -- 172.21.15.3:0/1310310250 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0ad7c0 con 0x7fa9f809bd90 2023-05-17T11:46:24.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9f67fc640 1 -- 172.21.15.3:0/1310310250 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0adb50 con 0x7fa9f809bd90 2023-05-17T11:46:24.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/1310310250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 msgr2=0x7fa9f80ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/1310310250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f80ad760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0097c0 tx=0x7fa9ec01c450 comp rx=0 tx=0).stop 2023-05-17T11:46:24.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/1310310250 shutdown_connections 2023-05-17T11:46:24.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/1310310250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f80ad760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/1310310250 >> 172.21.15.3:0/1310310250 conn(0x7fa9f806a740 msgr2=0x7fa9f80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:24.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/1310310250 shutdown_connections 2023-05-17T11:46:24.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/1310310250 wait complete. 2023-05-17T11:46:24.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 Processor -- start 2023-05-17T11:46:24.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 -- start start 2023-05-17T11:46:24.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.698+0000 7fa9fdcb6640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa9f806b4d0 0x7fa9f814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f8070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 0x7fa9f8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8159ac0 con 0x7fa9f80b2950 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81594b0 con 0x7fa9f809bd90 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f815bc60 con 0x7fa9f806b4d0 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 0x7fa9f8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 0x7fa9f8159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37100/0 (socket says 172.21.15.3:37100) 2023-05-17T11:46:24.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 -- 172.21.15.3:0/2920338477 learned_addr learned my addr 172.21.15.3:0/2920338477 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:24.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f77fe640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa9f806b4d0 0x7fa9f814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f6ffd640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f8070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 -- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa9f806b4d0 msgr2=0x7fa9f814fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa9f806b4d0 0x7fa9f814fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 -- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 msgr2=0x7fa9f8070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f8070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 -- 172.21.15.3:0/2920338477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec009420 con 0x7fa9f80b2950 2023-05-17T11:46:24.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9f7fff640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 0x7fa9f8159f50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000cb40 tx=0x7fa9f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000aca0 con 0x7fa9f80b2950 2023-05-17T11:46:24.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f000ae00 con 0x7fa9f80b2950 2023-05-17T11:46:24.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0012620 con 0x7fa9f80b2950 2023-05-17T11:46:24.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f80cb8d0 con 0x7fa9f80b2950 2023-05-17T11:46:24.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f80cc380 con 0x7fa9f80b2950 2023-05-17T11:46:24.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f8159c30 con 0x7fa9f80b2950 2023-05-17T11:46:24.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.702+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9f0007070 con 0x7fa9f80b2950 2023-05-17T11:46:24.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.706+0000 7fa9dffff640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa9e4066280 0x7fa9e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:24.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.706+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa9f0083d70 con 0x7fa9f80b2950 2023-05-17T11:46:24.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.706+0000 7fa9f77fe640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa9e4066280 0x7fa9e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:24.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.706+0000 7fa9f77fe640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa9e4066280 0x7fa9e4068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000f70 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:24.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.710+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa9f0051220 con 0x7fa9f80b2950 2023-05-17T11:46:24.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.862+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9f804de80 con 0x7fa9f80b2950 2023-05-17T11:46:24.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.862+0000 7fa9dffff640 1 -- 172.21.15.3:0/2920338477 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9f00170a0 con 0x7fa9f80b2950 2023-05-17T11:46:24.874 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa9e4066280 msgr2=0x7fa9e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa9e4066280 0x7fa9e4068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000f70 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 msgr2=0x7fa9f8159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 0x7fa9f8159f50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000cb40 tx=0x7fa9f000a060 comp rx=0 tx=0).stop 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 shutdown_connections 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa9e4066280 0x7fa9e4068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9f80b2950 0x7fa9f8159f50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f809bd90 0x7fa9f8070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 --2- 172.21.15.3:0/2920338477 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa9f806b4d0 0x7fa9f814fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 >> 172.21.15.3:0/2920338477 conn(0x7fa9f806a740 msgr2=0x7fa9f80ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 shutdown_connections 2023-05-17T11:46:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:24.866+0000 7fa9fdcb6640 1 -- 172.21.15.3:0/2920338477 wait complete. 2023-05-17T11:46:24.894 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:25.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.022+0000 7fed32a41640 1 Processor -- start 2023-05-17T11:46:25.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.022+0000 7fed32a41640 1 -- start start 2023-05-17T11:46:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed32a41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 0x7fed2c09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed32a41640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fed2c0ad760 0x7fed2c0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed32a41640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c06d020 con 0x7fed2c0cddf0 2023-05-17T11:46:25.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed32a41640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0b2d20 con 0x7fed2c0ad760 2023-05-17T11:46:25.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed32a41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1591b0 con 0x7fed2c0b2950 2023-05-17T11:46:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fed2c0cddf0 0x7fed2c0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50490/0 (socket says 172.21.15.3:50490) 2023-05-17T11:46:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 -- 172.21.15.3:0/1994520172 learned_addr learned my addr 172.21.15.3:0/1994520172 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2b7fe640 1 --2- 172.21.15.3:0/1994520172 >> v2:172.21.15.60:3300/0 conn(0x7fed2c0ad760 0x7fed2c0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2bfff640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 0x7fed2c09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333718721 0 0) 0x7fed2c06d020 con 0x7fed2c0cddf0 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed14003530 con 0x7fed2c0cddf0 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358267231 0 0) 0x7fed14003530 con 0x7fed2c0cddf0 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 msgr2=0x7fed2c09bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 0x7fed2c09bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 >> v2:172.21.15.60:3300/0 conn(0x7fed2c0ad760 msgr2=0x7fed2c0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 --2- 172.21.15.3:0/1994520172 >> v2:172.21.15.60:3300/0 conn(0x7fed2c0ad760 0x7fed2c0cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0adb90 con 0x7fed2c0cddf0 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fed24001a00 con 0x7fed2c0cddf0 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2b7fe640 1 --2- 172.21.15.3:0/1994520172 >> v2:172.21.15.60:3300/0 conn(0x7fed2c0ad760 0x7fed2c0cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 >> v1:172.21.15.3:6789/0 conn(0x7fed2c0cddf0 legacy=0x7fed2c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 0x7fed14003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed14003f00 0x7fed140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed14004d10 0x7fed1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0b2d20 con 0x7fed14004d10 2023-05-17T11:46:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1591b0 con 0x7fed14003f00 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed14005180 con 0x7fed2c0b2950 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed14004d10 0x7fed1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2b7fe640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed14003f00 0x7fed140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed2bfff640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 0x7fed14003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 -- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 msgr2=0x7fed14003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed2c0b2950 0x7fed14003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 -- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed14003f00 msgr2=0x7fed140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed14003f00 0x7fed140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.026+0000 7fed30fde640 1 -- 172.21.15.3:0/1994520172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14003530 con 0x7fed14004d10 2023-05-17T11:46:25.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed30fde640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed14004d10 0x7fed1400b990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed2400a860 tx=0x7fed2401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a2e8a8ec2777a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240ad630 con 0x7fed14004d10 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240a8070 con 0x7fed14004d10 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed2affd640 1 -- 172.21.15.3:0/1994520172 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240ada50 con 0x7fed14004d10 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed32a41640 1 -- 172.21.15.3:0/1994520172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed14004d10 msgr2=0x7fed1400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed32a41640 1 --2- 172.21.15.3:0/1994520172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed14004d10 0x7fed1400b990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed2400a860 tx=0x7fed2401d360 comp rx=0 tx=0).stop 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed30fde640 1 -- 172.21.15.3:0/1994520172 reap_dead start 2023-05-17T11:46:25.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed32a41640 1 -- 172.21.15.3:0/1994520172 shutdown_connections 2023-05-17T11:46:25.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed32a41640 1 -- 172.21.15.3:0/1994520172 >> 172.21.15.3:0/1994520172 conn(0x7fed2c06a740 msgr2=0x7fed2c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:25.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed32a41640 1 -- 172.21.15.3:0/1994520172 shutdown_connections 2023-05-17T11:46:25.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.030+0000 7fed32a41640 1 -- 172.21.15.3:0/1994520172 wait complete. 2023-05-17T11:46:25.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 Processor -- start 2023-05-17T11:46:25.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- start start 2023-05-17T11:46:25.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed14004d10 0x7fed2c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 0x7fed2c0af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed2c15adb0 0x7fed2c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c149ca0 con 0x7fed2c149830 2023-05-17T11:46:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0af860 con 0x7fed2c15adb0 2023-05-17T11:46:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0afb40 con 0x7fed14004d10 2023-05-17T11:46:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 0x7fed2c0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 0x7fed2c0af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37112/0 (socket says 172.21.15.3:37112) 2023-05-17T11:46:25.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 -- 172.21.15.3:0/4126899057 learned_addr learned my addr 172.21.15.3:0/4126899057 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2bfff640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed14004d10 0x7fed2c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed30fde640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed2c15adb0 0x7fed2c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 -- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed14004d10 msgr2=0x7fed2c0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed14004d10 0x7fed2c0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 -- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed2c15adb0 msgr2=0x7fed2c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed2c15adb0 0x7fed2c1582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 -- 172.21.15.3:0/4126899057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0cb5f0 con 0x7fed2c149830 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed2b7fe640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 0x7fed2c0af180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fed20011a90 tx=0x7fed20011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000fc10 con 0x7fed2c149830 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000fd70 con 0x7fed2c149830 2023-05-17T11:46:25.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c0cc0a0 con 0x7fed2c149830 2023-05-17T11:46:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000fee0 con 0x7fed2c149830 2023-05-17T11:46:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c06d4b0 con 0x7fed2c149830 2023-05-17T11:46:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.034+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c04de80 con 0x7fed2c149830 2023-05-17T11:46:25.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.038+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed20004240 con 0x7fed2c149830 2023-05-17T11:46:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.038+0000 7fed28ff9640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fed18066280 0x7fed18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.038+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fed20084510 con 0x7fed2c149830 2023-05-17T11:46:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.038+0000 7fed2bfff640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fed18066280 0x7fed18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.038+0000 7fed2bfff640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fed18066280 0x7fed18068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009b20 tx=0x7fed1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.042+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fed200518b0 con 0x7fed2c149830 2023-05-17T11:46:25.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.194+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed2c15c3b0 con 0x7fed2c149830 2023-05-17T11:46:25.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.194+0000 7fed28ff9640 1 -- 172.21.15.3:0/4126899057 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed20054ed0 con 0x7fed2c149830 2023-05-17T11:46:25.205 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fed18066280 msgr2=0x7fed18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fed18066280 0x7fed18068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009b20 tx=0x7fed1c008040 comp rx=0 tx=0).stop 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 msgr2=0x7fed2c0af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 0x7fed2c0af180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fed20011a90 tx=0x7fed20011f50 comp rx=0 tx=0).stop 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 shutdown_connections 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fed18066280 0x7fed18068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed2c15adb0 0x7fed2c1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed2c149830 0x7fed2c0af180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 --2- 172.21.15.3:0/4126899057 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fed14004d10 0x7fed2c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 >> 172.21.15.3:0/4126899057 conn(0x7fed2c06a740 msgr2=0x7fed2c06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 shutdown_connections 2023-05-17T11:46:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.198+0000 7fed32a41640 1 -- 172.21.15.3:0/4126899057 wait complete. 2023-05-17T11:46:25.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:25.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.354+0000 7fdc03ff3640 1 Processor -- start 2023-05-17T11:46:25.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.354+0000 7fdc03ff3640 1 -- start start 2023-05-17T11:46:25.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc03ff3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbfc160590 0x7fdbfc0c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc03ff3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdbfc0ad3b0 0x7fdbfc0c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc03ff3640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0adb90 con 0x7fdbfc0cdcb0 2023-05-17T11:46:25.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc03ff3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0b05a0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc03ff3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc160960 con 0x7fdbfc160590 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdbfc0ad3b0 0x7fdbfc0c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdbfc0ad3b0 0x7fdbfc0c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37120/0 (socket says 172.21.15.3:37120) 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 -- 172.21.15.3:0/1217956303 learned_addr learned my addr 172.21.15.3:0/1217956303 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc01d8f640 1 --2- 172.21.15.3:0/1217956303 >> v2:172.21.15.60:3300/0 conn(0x7fdbfc160590 0x7fdbfc0c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 -- 172.21.15.3:0/1217956303 >> v2:172.21.15.60:3300/0 conn(0x7fdbfc160590 msgr2=0x7fdbfc0c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 --2- 172.21.15.3:0/1217956303 >> v2:172.21.15.60:3300/0 conn(0x7fdbfc160590 0x7fdbfc0c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 -- 172.21.15.3:0/1217956303 >> v1:172.21.15.60:6789/0 conn(0x7fdbfc0cdcb0 legacy=0x7fdbfc0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 -- 172.21.15.3:0/1217956303 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0ad8b0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc01d8f640 1 --2- 172.21.15.3:0/1217956303 >> v2:172.21.15.60:3300/0 conn(0x7fdbfc160590 0x7fdbfc0c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc02590640 1 --2- 172.21.15.3:0/1217956303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0c1840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc06b330 tx=0x7fdbf401c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e460bfe9062f70bf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc00d8d640 1 -- 172.21.15.3:0/1217956303 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40a5700 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc00d8d640 1 -- 172.21.15.3:0/1217956303 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40a5860 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.358+0000 7fdc00d8d640 1 -- 172.21.15.3:0/1217956303 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40a5bf0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- 172.21.15.3:0/1217956303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 msgr2=0x7fdbfc0c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/1217956303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0c1840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc06b330 tx=0x7fdbf401c840 comp rx=0 tx=0).stop 2023-05-17T11:46:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- 172.21.15.3:0/1217956303 shutdown_connections 2023-05-17T11:46:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/1217956303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0c1840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/1217956303 >> v2:172.21.15.60:3300/0 conn(0x7fdbfc160590 0x7fdbfc0c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- 172.21.15.3:0/1217956303 >> 172.21.15.3:0/1217956303 conn(0x7fdbfc06a740 msgr2=0x7fdbfc0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- 172.21.15.3:0/1217956303 shutdown_connections 2023-05-17T11:46:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- 172.21.15.3:0/1217956303 wait complete. 2023-05-17T11:46:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 Processor -- start 2023-05-17T11:46:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- start start 2023-05-17T11:46:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdbfc160590 0x7fdbfc0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbfc070e60 0x7fdbfc0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0700a0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc070380 con 0x7fdbfc070e60 2023-05-17T11:46:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc03ff3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc070660 con 0x7fdbfc160590 2023-05-17T11:46:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc01d8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc01d8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37136/0 (socket says 172.21.15.3:37136) 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.362+0000 7fdc01d8f640 1 -- 172.21.15.3:0/2034394193 learned_addr learned my addr 172.21.15.3:0/2034394193 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc02590640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbfc070e60 0x7fdbfc0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc0158e640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdbfc160590 0x7fdbfc0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc01d8f640 1 -- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdbfc160590 msgr2=0x7fdbfc0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc01d8f640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdbfc160590 0x7fdbfc0c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc01d8f640 1 -- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbfc070e60 msgr2=0x7fdbfc0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc01d8f640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbfc070e60 0x7fdbfc0c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc01d8f640 1 -- 172.21.15.3:0/2034394193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009b30 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc02590640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbfc070e60 0x7fdbfc0c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc01d8f640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0715c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c7c0 tx=0x7fdbf800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8007a30 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8007b90 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800ce70 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc16d550 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc16d3c0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc16d6e0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbf80193f0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdbf27fc640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdbe0066280 0x7fdbe0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.366+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdbf8084230 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.370+0000 7fdc0158e640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdbe0066280 0x7fdbe0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.370+0000 7fdc0158e640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdbe0066280 0x7fdbe0068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc158300 tx=0x7fdbec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.370+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdbf8051670 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbfc0701e0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdbf27fc640 1 -- 172.21.15.3:0/2034394193 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbfc0701e0 con 0x7fdbfc0ad3b0 2023-05-17T11:46:25.536 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:25.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdbe0066280 msgr2=0x7fdbe0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdbe0066280 0x7fdbe0068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc158300 tx=0x7fdbec008040 comp rx=0 tx=0).stop 2023-05-17T11:46:25.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 msgr2=0x7fdbfc0715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0715c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c7c0 tx=0x7fdbf800cc80 comp rx=0 tx=0).stop 2023-05-17T11:46:25.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 shutdown_connections 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdbe0066280 0x7fdbe0068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbfc070e60 0x7fdbfc0c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdbfc160590 0x7fdbfc0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 --2- 172.21.15.3:0/2034394193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbfc0ad3b0 0x7fdbfc0715c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 >> 172.21.15.3:0/2034394193 conn(0x7fdbfc06a740 msgr2=0x7fdbfc0ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 shutdown_connections 2023-05-17T11:46:25.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.526+0000 7fdc03ff3640 1 -- 172.21.15.3:0/2034394193 wait complete. 2023-05-17T11:46:25.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T11:46:25.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74eeaf2640 1 Processor -- start 2023-05-17T11:46:25.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74eeaf2640 1 -- start start 2023-05-17T11:46:25.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74eeaf2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f74e80ad8a0 0x7f74e80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74eeaf2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80c8a30 con 0x7f74e80b1230 2023-05-17T11:46:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74eeaf2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80adc70 con 0x7f74e80b1d70 2023-05-17T11:46:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74eeaf2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e80cbcf0 con 0x7f74e80ad8a0 2023-05-17T11:46:25.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74ec88e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f74e80ad8a0 0x7f74e80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74e7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f74e80b1230 0x7f74e80b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50500/0 (socket says 172.21.15.3:50500) 2023-05-17T11:46:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74e7fff640 1 -- 172.21.15.3:0/3462829660 learned_addr learned my addr 172.21.15.3:0/3462829660 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74ec88e640 1 -- 172.21.15.3:0/3462829660 >> v1:172.21.15.60:6789/0 conn(0x7f74e80b1d70 legacy=0x7f74e8070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74ec88e640 1 -- 172.21.15.3:0/3462829660 >> v1:172.21.15.3:6789/0 conn(0x7f74e80b1230 legacy=0x7f74e80b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.686+0000 7f74ec88e640 1 -- 172.21.15.3:0/3462829660 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e80c8c80 con 0x7f74e80ad8a0 2023-05-17T11:46:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74ec88e640 1 --2- 172.21.15.3:0/3462829660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80ad8a0 0x7f74e80ca710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0097a0 tx=0x7f74dc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c9254c683b50e5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74e77fe640 1 -- 172.21.15.3:0/3462829660 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0ab5f0 con 0x7f74e80ad8a0 2023-05-17T11:46:25.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74e77fe640 1 -- 172.21.15.3:0/3462829660 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc0ab750 con 0x7f74e80ad8a0 2023-05-17T11:46:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74e77fe640 1 -- 172.21.15.3:0/3462829660 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0abae0 con 0x7f74e80ad8a0 2023-05-17T11:46:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 -- 172.21.15.3:0/3462829660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80ad8a0 msgr2=0x7f74e80ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/3462829660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80ad8a0 0x7f74e80ca710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0097a0 tx=0x7f74dc01c3f0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 -- 172.21.15.3:0/3462829660 shutdown_connections 2023-05-17T11:46:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/3462829660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80ad8a0 0x7f74e80ca710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 -- 172.21.15.3:0/3462829660 >> 172.21.15.3:0/3462829660 conn(0x7f74e80b0b20 msgr2=0x7f74e80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 -- 172.21.15.3:0/3462829660 shutdown_connections 2023-05-17T11:46:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 -- 172.21.15.3:0/3462829660 wait complete. 2023-05-17T11:46:25.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 Processor -- start 2023-05-17T11:46:25.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.690+0000 7f74eeaf2640 1 -- start start 2023-05-17T11:46:25.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f74e80ad8a0 0x7f74e81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e80b1230 0x7f74e80c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 0x7f74e80c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80c6f30 con 0x7f74e80b1d70 2023-05-17T11:46:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8152440 con 0x7f74e80b1230 2023-05-17T11:46:25.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8153c80 con 0x7f74e80ad8a0 2023-05-17T11:46:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 0x7f74e80c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 0x7f74e80c2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37158/0 (socket says 172.21.15.3:37158) 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 -- 172.21.15.3:0/4270957377 learned_addr learned my addr 172.21.15.3:0/4270957377 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ec88e640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f74e80ad8a0 0x7f74e81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74e7fff640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e80b1230 0x7f74e80c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 -- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f74e80ad8a0 msgr2=0x7f74e81513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f74e80ad8a0 0x7f74e81513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 -- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e80b1230 msgr2=0x7f74e80c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e80b1230 0x7f74e80c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 -- 172.21.15.3:0/4270957377 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0093b0 con 0x7f74e80b1d70 2023-05-17T11:46:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74ed08f640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 0x7f74e80c2580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74e000b970 tx=0x7f74e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000cb40 con 0x7f74e80b1d70 2023-05-17T11:46:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e000cca0 con 0x7f74e80b1d70 2023-05-17T11:46:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e8071140 con 0x7f74e80b1d70 2023-05-17T11:46:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0014680 con 0x7f74e80b1d70 2023-05-17T11:46:25.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e80c9240 con 0x7f74e80b1d70 2023-05-17T11:46:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e80712d0 con 0x7f74e80b1d70 2023-05-17T11:46:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.694+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74e001d3b0 con 0x7f74e80b1d70 2023-05-17T11:46:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.698+0000 7f74e57fa640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.698+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f74e0083b40 con 0x7f74e80b1d70 2023-05-17T11:46:25.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.698+0000 7f74ec88e640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:25.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.698+0000 7f74ec88e640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f74cc066280 0x7f74cc068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0af000 tx=0x7f74dc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:25.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.702+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f74e0051020 con 0x7f74e80b1d70 2023-05-17T11:46:25.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.866+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74e804de80 con 0x7f74e80b1d70 2023-05-17T11:46:25.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.866+0000 7f74e57fa640 1 -- 172.21.15.3:0/4270957377 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74e0054640 con 0x7f74e80b1d70 2023-05-17T11:46:25.877 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-05-17T11:46:25.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f74cc066280 msgr2=0x7f74cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f74cc066280 0x7f74cc068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0af000 tx=0x7f74dc0a7000 comp rx=0 tx=0).stop 2023-05-17T11:46:25.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 msgr2=0x7f74e80c2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:25.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 0x7f74e80c2580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74e000b970 tx=0x7f74e000be30 comp rx=0 tx=0).stop 2023-05-17T11:46:25.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 shutdown_connections 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74e80b1d70 0x7f74e80c2580 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e80b1230 0x7f74e80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 --2- 172.21.15.3:0/4270957377 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f74e80ad8a0 0x7f74e81513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 >> 172.21.15.3:0/4270957377 conn(0x7f74e80b0b20 msgr2=0x7f74e80af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 shutdown_connections 2023-05-17T11:46:25.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:25.870+0000 7f74eeaf2640 1 -- 172.21.15.3:0/4270957377 wait complete. 2023-05-17T11:46:25.898 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi060.front.sepia.ceph.com... 2023-05-17T11:46:25.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:25.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-17T11:46:25.919 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:25.920 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-05-17T11:46:25.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:25.921 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-17T11:46:25.969 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T11:46:25.969 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:46:26.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2616666640 1 Processor -- start 2023-05-17T11:46:26.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2616666640 1 -- start start 2023-05-17T11:46:26.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2616666640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f261006abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2616666640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261006c6a0 con 0x7f261015c860 2023-05-17T11:46:26.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2616666640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261015cec0 con 0x7f26100ce240 2023-05-17T11:46:26.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2616666640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261015ccb0 con 0x7f261015c490 2023-05-17T11:46:26.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f261015c860 0x7f26100b2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50504/0 (socket says 172.21.15.3:50504) 2023-05-17T11:46:26.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 -- 172.21.15.3:0/2176574 learned_addr learned my addr 172.21.15.3:0/2176574 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:26.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260ffff640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f261006abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365462319 0 0) 0x7f261006c6a0 con 0x7f261015c860 2023-05-17T11:46:26.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f8003530 con 0x7f261015c860 2023-05-17T11:46:26.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027198689 0 0) 0x7f261015cec0 con 0x7f26100ce240 2023-05-17T11:46:26.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f261006c6a0 con 0x7f26100ce240 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909704077 0 0) 0x7f25f8003530 con 0x7f261015c860 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 msgr2=0x7f261006abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f261006abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 >> v1:172.21.15.60:6789/0 conn(0x7f26100ce240 legacy=0x7f26101603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261015d1a0 con 0x7f261015c860 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f2604001680 con 0x7f261015c860 2023-05-17T11:46:26.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 >> v1:172.21.15.3:6789/0 conn(0x7f261015c860 legacy=0x7f26100b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f8003bb0 0x7f25f8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f25f80047d0 0x7f25f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f25f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261015ccb0 con 0x7f25f80047d0 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f800bb20 con 0x7f25f8003bb0 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f800bcb0 con 0x7f261015c490 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f25f80047d0 0x7f25f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260ffff640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f8003bb0 0x7f25f8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2614c03640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f25f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 -- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 msgr2=0x7f25f8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f25f8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 -- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f8003bb0 msgr2=0x7f25f8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f8003bb0 0x7f25f8003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260f7fe640 1 -- 172.21.15.3:0/2176574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8003530 con 0x7f25f80047d0 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f2614c03640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f261015c490 0x7f25f8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:26.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.098+0000 7f260ffff640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f8003bb0 0x7f25f8003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:26.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f260f7fe640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f25f80047d0 0x7f25f8004c40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f260400c1c0 tx=0x7f260401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2bc17294a744ef server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040058e0 con 0x7f25f80047d0 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604005a40 con 0x7f25f80047d0 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f260effd640 1 -- 172.21.15.3:0/2176574 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604005e10 con 0x7f25f80047d0 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2616666640 1 -- 172.21.15.3:0/2176574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f25f80047d0 msgr2=0x7f25f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2616666640 1 --2- 172.21.15.3:0/2176574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f25f80047d0 0x7f25f8004c40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f260400c1c0 tx=0x7f260401cba0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2614c03640 1 -- 172.21.15.3:0/2176574 reap_dead start 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2616666640 1 -- 172.21.15.3:0/2176574 shutdown_connections 2023-05-17T11:46:26.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2616666640 1 -- 172.21.15.3:0/2176574 >> 172.21.15.3:0/2176574 conn(0x7f261006dec0 msgr2=0x7f261006e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:26.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2616666640 1 -- 172.21.15.3:0/2176574 shutdown_connections 2023-05-17T11:46:26.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.102+0000 7f2616666640 1 -- 172.21.15.3:0/2176574 wait complete. 2023-05-17T11:46:26.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 Processor -- start 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 -- start start 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f80047d0 0x7f26101549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2610158840 0x7f26100b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 0x7f26101f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101f9170 con 0x7f26101f8790 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100b4bd0 con 0x7f25f80047d0 2023-05-17T11:46:26.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2610154f20 con 0x7f2610158840 2023-05-17T11:46:26.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 0x7f26101f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f260ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f80047d0 0x7f26101549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 0x7f26101f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37178/0 (socket says 172.21.15.3:37178) 2023-05-17T11:46:26.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 -- 172.21.15.3:0/306974228 learned_addr learned my addr 172.21.15.3:0/306974228 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:26.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f260f7fe640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2610158840 0x7f26100b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 -- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2610158840 msgr2=0x7f26100b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2610158840 0x7f26100b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 -- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f80047d0 msgr2=0x7f26101549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f80047d0 0x7f26101549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 -- 172.21.15.3:0/306974228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100cea50 con 0x7f26101f8790 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2614c03640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 0x7f26101f8c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f26100718a0 tx=0x7f260800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260800b070 con 0x7f26101f8790 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608003980 con 0x7f26101f8790 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26100b3020 con 0x7f26101f8790 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608003d30 con 0x7f26101f8790 2023-05-17T11:46:26.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.106+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26100cebe0 con 0x7f26101f8790 2023-05-17T11:46:26.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.110+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26100b4d40 con 0x7f26101f8790 2023-05-17T11:46:26.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.110+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2608005070 con 0x7f26101f8790 2023-05-17T11:46:26.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.110+0000 7f260cff9640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f25fc0662b0 0x7f25fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.110+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2608082d90 con 0x7f26101f8790 2023-05-17T11:46:26.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.110+0000 7f260ffff640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f25fc0662b0 0x7f25fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.110+0000 7f260ffff640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f25fc0662b0 0x7f25fc068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26101554f0 tx=0x7f2600008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.114+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f26080502f0 con 0x7f26101f8790 2023-05-17T11:46:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.298+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f261004de80 con 0x7f26101f8790 2023-05-17T11:46:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f260cff9640 1 -- 172.21.15.3:0/306974228 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f2608018020 con 0x7f26101f8790 2023-05-17T11:46:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:26.311 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:46:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:46:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f25fc0662b0 msgr2=0x7f25fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f25fc0662b0 0x7f25fc068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26101554f0 tx=0x7f2600008040 comp rx=0 tx=0).stop 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 msgr2=0x7f26101f8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 0x7f26101f8c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f26100718a0 tx=0x7f260800d7b0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 shutdown_connections 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f25fc0662b0 0x7f25fc068760 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26101f8790 0x7f26101f8c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f2610158840 0x7f26100b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 --2- 172.21.15.3:0/306974228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25f80047d0 0x7f26101549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 >> 172.21.15.3:0/306974228 conn(0x7f261006dec0 msgr2=0x7f2610160260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 shutdown_connections 2023-05-17T11:46:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.302+0000 7f2616666640 1 -- 172.21.15.3:0/306974228 wait complete. 2023-05-17T11:46:26.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 Processor -- start 2023-05-17T11:46:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 -- start start 2023-05-17T11:46:26.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcf1c0c8c10 0x7fcf1c069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf1c069ff0 0x7fcf1c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0cdb70 con 0x7fcf1c158680 2023-05-17T11:46:26.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c06a410 con 0x7fcf1c0c8c10 2023-05-17T11:46:26.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf218c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c158a50 con 0x7fcf1c069ff0 2023-05-17T11:46:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf1affd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcf1c158680 0x7fcf1c0cc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41124/0 (socket says 172.21.15.3:41124) 2023-05-17T11:46:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf1affd640 1 -- 172.21.15.3:0/214540546 learned_addr learned my addr 172.21.15.3:0/214540546 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.458+0000 7fcf13fff640 1 --2- 172.21.15.3:0/214540546 >> v2:172.21.15.3:3300/0 conn(0x7fcf1c0c8c10 0x7fcf1c069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf1b7fe640 1 --2- 172.21.15.3:0/214540546 >> v2:172.21.15.60:3300/0 conn(0x7fcf1c069ff0 0x7fcf1c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf1a7fc640 1 -- 172.21.15.3:0/214540546 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118750726 0 0) 0x7fcf1c0cdb70 con 0x7fcf1c158680 2023-05-17T11:46:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf1a7fc640 1 -- 172.21.15.3:0/214540546 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf08003530 con 0x7fcf1c158680 2023-05-17T11:46:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf13fff640 1 -- 172.21.15.3:0/214540546 >> v2:172.21.15.60:3300/0 conn(0x7fcf1c069ff0 msgr2=0x7fcf1c06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf13fff640 1 --2- 172.21.15.3:0/214540546 >> v2:172.21.15.60:3300/0 conn(0x7fcf1c069ff0 0x7fcf1c06fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf13fff640 1 -- 172.21.15.3:0/214540546 >> v1:172.21.15.3:6789/0 conn(0x7fcf1c158680 legacy=0x7fcf1c0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf13fff640 1 -- 172.21.15.3:0/214540546 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0ccf60 con 0x7fcf1c0c8c10 2023-05-17T11:46:26.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf13fff640 1 --2- 172.21.15.3:0/214540546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c0c8c10 0x7fcf1c069ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0b4500 tx=0x7fcf0401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219c4de5330b58f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf1a7fc640 1 -- 172.21.15.3:0/214540546 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040a9420 con 0x7fcf1c0c8c10 2023-05-17T11:46:26.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf1a7fc640 1 -- 172.21.15.3:0/214540546 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf040a9580 con 0x7fcf1c0c8c10 2023-05-17T11:46:26.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.462+0000 7fcf1a7fc640 1 -- 172.21.15.3:0/214540546 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040a9910 con 0x7fcf1c0c8c10 2023-05-17T11:46:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- 172.21.15.3:0/214540546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c0c8c10 msgr2=0x7fcf1c069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 --2- 172.21.15.3:0/214540546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c0c8c10 0x7fcf1c069ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0b4500 tx=0x7fcf0401c4b0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- 172.21.15.3:0/214540546 shutdown_connections 2023-05-17T11:46:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 --2- 172.21.15.3:0/214540546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c0c8c10 0x7fcf1c069ab0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 --2- 172.21.15.3:0/214540546 >> v2:172.21.15.60:3300/0 conn(0x7fcf1c069ff0 0x7fcf1c06fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- 172.21.15.3:0/214540546 >> 172.21.15.3:0/214540546 conn(0x7fcf1c0b0b30 msgr2=0x7fcf1c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- 172.21.15.3:0/214540546 shutdown_connections 2023-05-17T11:46:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- 172.21.15.3:0/214540546 wait complete. 2023-05-17T11:46:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 Processor -- start 2023-05-17T11:46:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- start start 2023-05-17T11:46:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c069ff0 0x7fcf1c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcf1c0c8c10 0x7fcf1c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 0x7fcf1c0ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c149080 con 0x7fcf1c158680 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b1890 con 0x7fcf1c069ff0 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf218c4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b1280 con 0x7fcf1c0c8c10 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 0x7fcf1c0ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 0x7fcf1c0ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60906/0 (socket says 172.21.15.3:60906) 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 -- 172.21.15.3:0/3877826841 learned_addr learned my addr 172.21.15.3:0/3877826841 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf13fff640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcf1c0c8c10 0x7fcf1c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1affd640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c069ff0 0x7fcf1c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 -- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcf1c0c8c10 msgr2=0x7fcf1c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcf1c0c8c10 0x7fcf1c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 -- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c069ff0 msgr2=0x7fcf1c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c069ff0 0x7fcf1c157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 -- 172.21.15.3:0/3877826841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04007370 con 0x7fcf1c158680 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf1b7fe640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 0x7fcf1c0ace50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf140082d0 tx=0x7fcf14008790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.466+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14010040 con 0x7fcf1c158680 2023-05-17T11:46:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf140165f0 con 0x7fcf1c158680 2023-05-17T11:46:26.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140169a0 con 0x7fcf1c158680 2023-05-17T11:46:26.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c0cdfe0 con 0x7fcf1c158680 2023-05-17T11:46:26.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c0cd800 con 0x7fcf1c158680 2023-05-17T11:46:26.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c0ce170 con 0x7fcf1c158680 2023-05-17T11:46:26.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf14016b00 con 0x7fcf1c158680 2023-05-17T11:46:26.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf18ff9640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcefc066280 0x7fcefc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcf14084340 con 0x7fcf1c158680 2023-05-17T11:46:26.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.470+0000 7fcf1affd640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcefc066280 0x7fcefc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.474+0000 7fcf1affd640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcefc066280 0x7fcefc068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0011f0 tx=0x7fcf0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.474+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcf140516e0 con 0x7fcf1c158680 2023-05-17T11:46:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.630+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf1c04de80 con 0x7fcf1c158680 2023-05-17T11:46:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf18ff9640 1 -- 172.21.15.3:0/3877826841 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7fcf14054d00 con 0x7fcf1c158680 2023-05-17T11:46:26.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:26.643 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcefc066280 msgr2=0x7fcefc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcefc066280 0x7fcefc068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0011f0 tx=0x7fcf0c009040 comp rx=0 tx=0).stop 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 msgr2=0x7fcf1c0ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 0x7fcf1c0ace50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf140082d0 tx=0x7fcf14008790 comp rx=0 tx=0).stop 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 shutdown_connections 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcefc066280 0x7fcefc068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf1c158680 0x7fcf1c0ace50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcf1c0c8c10 0x7fcf1c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 --2- 172.21.15.3:0/3877826841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c069ff0 0x7fcf1c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 >> 172.21.15.3:0/3877826841 conn(0x7fcf1c0b0b30 msgr2=0x7fcf1c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 shutdown_connections 2023-05-17T11:46:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.634+0000 7fcf218c4640 1 -- 172.21.15.3:0/3877826841 wait complete. 2023-05-17T11:46:26.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T11:45:33.186597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T11:45:34.510143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:26.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea29c66640 1 Processor -- start 2023-05-17T11:46:26.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea29c66640 1 -- start start 2023-05-17T11:46:26.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea29c66640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea29c66640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2406d020 con 0x7fea2406b4d0 2023-05-17T11:46:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea29c66640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea240b2d20 con 0x7fea240b2950 2023-05-17T11:46:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea29c66640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea241591b0 con 0x7fea2409bd90 2023-05-17T11:46:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea23fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fea2406b4d0 0x7fea2406b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41138/0 (socket says 172.21.15.3:41138) 2023-05-17T11:46:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea23fff640 1 -- 172.21.15.3:0/3846895504 learned_addr learned my addr 172.21.15.3:0/3846895504 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:26.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea22ffd640 1 --2- 172.21.15.3:0/3846895504 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423886293 0 0) 0x7fea2406d020 con 0x7fea2406b4d0 2023-05-17T11:46:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c005740 con 0x7fea2406b4d0 2023-05-17T11:46:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237192851 0 0) 0x7fea240b2d20 con 0x7fea240b2950 2023-05-17T11:46:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea2406d020 con 0x7fea240b2950 2023-05-17T11:46:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea22ffd640 1 -- 172.21.15.3:0/3846895504 >> v1:172.21.15.60:6789/0 conn(0x7fea240b2950 legacy=0x7fea240cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea22ffd640 1 -- 172.21.15.3:0/3846895504 >> v1:172.21.15.3:6789/0 conn(0x7fea2406b4d0 legacy=0x7fea2406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.794+0000 7fea22ffd640 1 -- 172.21.15.3:0/3846895504 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240cc0a0 con 0x7fea2409bd90 2023-05-17T11:46:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea22ffd640 1 --2- 172.21.15.3:0/3846895504 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240ad760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea180097f0 tx=0x7fea1801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb323aabd08ecd85 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180a6040 con 0x7fea2409bd90 2023-05-17T11:46:26.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea180aa600 con 0x7fea2409bd90 2023-05-17T11:46:26.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea227fc640 1 -- 172.21.15.3:0/3846895504 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180aa990 con 0x7fea2409bd90 2023-05-17T11:46:26.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 -- 172.21.15.3:0/3846895504 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 msgr2=0x7fea240ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 --2- 172.21.15.3:0/3846895504 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240ad760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea180097f0 tx=0x7fea1801c480 comp rx=0 tx=0).stop 2023-05-17T11:46:26.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 -- 172.21.15.3:0/3846895504 shutdown_connections 2023-05-17T11:46:26.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 --2- 172.21.15.3:0/3846895504 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240ad760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 -- 172.21.15.3:0/3846895504 >> 172.21.15.3:0/3846895504 conn(0x7fea2406a740 msgr2=0x7fea240cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:26.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 -- 172.21.15.3:0/3846895504 shutdown_connections 2023-05-17T11:46:26.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.798+0000 7fea29c66640 1 -- 172.21.15.3:0/3846895504 wait complete. 2023-05-17T11:46:26.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 Processor -- start 2023-05-17T11:46:26.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 -- start start 2023-05-17T11:46:26.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 0x7fea24152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea240b2950 0x7fea240ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2415a3d0 con 0x7fea2406b4d0 2023-05-17T11:46:26.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240af3a0 con 0x7fea240b2950 2023-05-17T11:46:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea240af640 con 0x7fea2409bd90 2023-05-17T11:46:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 0x7fea24152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 0x7fea24152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60914/0 (socket says 172.21.15.3:60914) 2023-05-17T11:46:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 -- 172.21.15.3:0/1563633199 learned_addr learned my addr 172.21.15.3:0/1563633199 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea23fff640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea240b2950 0x7fea240ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea22ffd640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 -- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 msgr2=0x7fea240aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 -- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea240b2950 msgr2=0x7fea240ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea240b2950 0x7fea240ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 -- 172.21.15.3:0/1563633199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18009420 con 0x7fea2406b4d0 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea23fff640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea240b2950 0x7fea240ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea237fe640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 0x7fea24152030 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c430 tx=0x7fea1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140052d0 con 0x7fea2406b4d0 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14005450 con 0x7fea2406b4d0 2023-05-17T11:46:26.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea240cb8d0 con 0x7fea2406b4d0 2023-05-17T11:46:26.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.802+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14003840 con 0x7fea2406b4d0 2023-05-17T11:46:26.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2406d490 con 0x7fea2406b4d0 2023-05-17T11:46:26.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea240cdfc0 con 0x7fea2406b4d0 2023-05-17T11:46:26.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea140039a0 con 0x7fea2406b4d0 2023-05-17T11:46:26.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea0bfff640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea100662b0 0x7fea10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:26.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fea140832b0 con 0x7fea2406b4d0 2023-05-17T11:46:26.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea22ffd640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea100662b0 0x7fea10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:26.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.806+0000 7fea22ffd640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea100662b0 0x7fea10068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea180ae000 tx=0x7fea180b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:26.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.810+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fea14050790 con 0x7fea2406b4d0 2023-05-17T11:46:26.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.962+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea2404de80 con 0x7fea2406b4d0 2023-05-17T11:46:26.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.962+0000 7fea0bfff640 1 -- 172.21.15.3:0/1563633199 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea14053db0 con 0x7fea2406b4d0 2023-05-17T11:46:26.975 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:26.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea100662b0 msgr2=0x7fea10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea100662b0 0x7fea10068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea180ae000 tx=0x7fea180b5040 comp rx=0 tx=0).stop 2023-05-17T11:46:26.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 msgr2=0x7fea24152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:26.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 0x7fea24152030 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c430 tx=0x7fea1400c8f0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 shutdown_connections 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fea100662b0 0x7fea10068760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea240b2950 0x7fea240ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fea2409bd90 0x7fea240aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 --2- 172.21.15.3:0/1563633199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea2406b4d0 0x7fea24152030 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 >> 172.21.15.3:0/1563633199 conn(0x7fea2406a740 msgr2=0x7fea240cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 shutdown_connections 2023-05-17T11:46:26.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:26.966+0000 7fea29c66640 1 -- 172.21.15.3:0/1563633199 wait complete. 2023-05-17T11:46:26.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:27.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 Processor -- start 2023-05-17T11:46:27.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 -- start start 2023-05-17T11:46:27.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e84156460 0x7f5e8415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406cef0 0x7f5e840ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8415cb00 con 0x7f5e8406e7d0 2023-05-17T11:46:27.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8415cde0 con 0x7f5e84156460 2023-05-17T11:46:27.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e8b1f3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8415d0c0 con 0x7f5e8406cef0 2023-05-17T11:46:27.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e83fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5e8406e7d0 0x7f5e8406c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41140/0 (socket says 172.21.15.3:41140) 2023-05-17T11:46:27.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e83fff640 1 -- 172.21.15.3:0/2418759312 learned_addr learned my addr 172.21.15.3:0/2418759312 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:27.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e88f8f640 1 --2- 172.21.15.3:0/2418759312 >> v2:172.21.15.60:3300/0 conn(0x7f5e84156460 0x7f5e8415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e89790640 1 --2- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406cef0 0x7f5e840ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e837fe640 1 -- 172.21.15.3:0/2418759312 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779126019 0 0) 0x7f5e8415cb00 con 0x7f5e8406e7d0 2023-05-17T11:46:27.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e837fe640 1 -- 172.21.15.3:0/2418759312 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e74003530 con 0x7f5e8406e7d0 2023-05-17T11:46:27.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e88f8f640 1 -- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406cef0 msgr2=0x7f5e840ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:27.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e88f8f640 1 --2- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406cef0 0x7f5e840ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e88f8f640 1 -- 172.21.15.3:0/2418759312 >> v1:172.21.15.3:6789/0 conn(0x7f5e8406e7d0 legacy=0x7f5e8406c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.126+0000 7f5e88f8f640 1 -- 172.21.15.3:0/2418759312 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8415d3a0 con 0x7f5e84156460 2023-05-17T11:46:27.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e88f8f640 1 --2- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84156460 0x7f5e8415c4b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e780097f0 tx=0x7f5e7801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdfb8d01a3e198a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e837fe640 1 -- 172.21.15.3:0/2418759312 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780ab660 con 0x7f5e84156460 2023-05-17T11:46:27.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e837fe640 1 -- 172.21.15.3:0/2418759312 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e780ab7c0 con 0x7f5e84156460 2023-05-17T11:46:27.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e837fe640 1 -- 172.21.15.3:0/2418759312 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780abb50 con 0x7f5e84156460 2023-05-17T11:46:27.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84156460 msgr2=0x7f5e8415c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84156460 0x7f5e8415c4b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e780097f0 tx=0x7f5e7801c480 comp rx=0 tx=0).stop 2023-05-17T11:46:27.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/2418759312 shutdown_connections 2023-05-17T11:46:27.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406cef0 0x7f5e840ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/2418759312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84156460 0x7f5e8415c4b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/2418759312 >> 172.21.15.3:0/2418759312 conn(0x7f5e840b14a0 msgr2=0x7f5e840cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:27.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/2418759312 shutdown_connections 2023-05-17T11:46:27.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.130+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/2418759312 wait complete. 2023-05-17T11:46:27.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 Processor -- start 2023-05-17T11:46:27.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- start start 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8406cef0 0x7f5e840abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406e7d0 0x7f5e8415fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 0x7f5e84160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840cd8c0 con 0x7f5e84156460 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840cdba0 con 0x7f5e8406cef0 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840cde80 con 0x7f5e8406e7d0 2023-05-17T11:46:27.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 0x7f5e84160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 0x7f5e84160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60928/0 (socket says 172.21.15.3:60928) 2023-05-17T11:46:27.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 -- 172.21.15.3:0/1910892001 learned_addr learned my addr 172.21.15.3:0/1910892001 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:27.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e83fff640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406e7d0 0x7f5e8415fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e88f8f640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8406cef0 0x7f5e840abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 -- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406e7d0 msgr2=0x7f5e8415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406e7d0 0x7f5e8415fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 -- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8406cef0 msgr2=0x7f5e840abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8406cef0 0x7f5e840abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 -- 172.21.15.3:0/1910892001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78009420 con 0x7f5e84156460 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e89790640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 0x7f5e84160140 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00ef90 tx=0x7f5e7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c009ca0 con 0x7f5e84156460 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00f040 con 0x7f5e84156460 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c0146c0 con 0x7f5e84156460 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840ae5d0 con 0x7f5e84156460 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840ae440 con 0x7f5e84156460 2023-05-17T11:46:27.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.134+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840b24c0 con 0x7f5e84156460 2023-05-17T11:46:27.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.138+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e7c014820 con 0x7f5e84156460 2023-05-17T11:46:27.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.138+0000 7f5e817fa640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e68066280 0x7f5e68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.138+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5e7c084b80 con 0x7f5e84156460 2023-05-17T11:46:27.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.138+0000 7f5e88f8f640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e68066280 0x7f5e68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.138+0000 7f5e88f8f640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e68066280 0x7f5e68068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e780af000 tx=0x7f5e780a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.142+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5e7c051fd0 con 0x7f5e84156460 2023-05-17T11:46:27.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e8404de80 con 0x7f5e84156460 2023-05-17T11:46:27.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e817fa640 1 -- 172.21.15.3:0/1910892001 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e7c0180a0 con 0x7f5e84156460 2023-05-17T11:46:27.308 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e68066280 msgr2=0x7f5e68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e68066280 0x7f5e68068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e780af000 tx=0x7f5e780a7000 comp rx=0 tx=0).stop 2023-05-17T11:46:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 msgr2=0x7f5e84160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 0x7f5e84160140 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00ef90 tx=0x7f5e7c00c490 comp rx=0 tx=0).stop 2023-05-17T11:46:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 shutdown_connections 2023-05-17T11:46:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5e68066280 0x7f5e68068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e84156460 0x7f5e84160140 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5e8406e7d0 0x7f5e8415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 --2- 172.21.15.3:0/1910892001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8406cef0 0x7f5e840abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 >> 172.21.15.3:0/1910892001 conn(0x7f5e840b14a0 msgr2=0x7f5e8406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 shutdown_connections 2023-05-17T11:46:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.298+0000 7f5e8b1f3640 1 -- 172.21.15.3:0/1910892001 wait complete. 2023-05-17T11:46:27.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T11:46:27.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.458+0000 7f6c4d3d4640 1 Processor -- start 2023-05-17T11:46:27.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.458+0000 7f6c4d3d4640 1 -- start start 2023-05-17T11:46:27.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c4d3d4640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c4806e760 0x7f6c480cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c4d3d4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c480cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c4d3d4640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480ce180 con 0x7f6c480af870 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c4d3d4640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480cccb0 con 0x7f6c4806e760 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c4d3d4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4815df30 con 0x7f6c4815d9c0 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c46ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c4806e760 0x7f6c480cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c477fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6c480af870 0x7f6c480b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41148/0 (socket says 172.21.15.3:41148) 2023-05-17T11:46:27.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c477fe640 1 -- 172.21.15.3:0/1227607603 learned_addr learned my addr 172.21.15.3:0/1227607603 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:27.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c3ffff640 1 --2- 172.21.15.3:0/1227607603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c480cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c46ffd640 1 -- 172.21.15.3:0/1227607603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 msgr2=0x7f6c480cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:27.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c46ffd640 1 --2- 172.21.15.3:0/1227607603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c480cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c46ffd640 1 -- 172.21.15.3:0/1227607603 >> v1:172.21.15.3:6789/0 conn(0x7f6c480af870 legacy=0x7f6c480b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c46ffd640 1 -- 172.21.15.3:0/1227607603 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4815e210 con 0x7f6c4806e760 2023-05-17T11:46:27.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c46ffd640 1 --2- 172.21.15.3:0/1227607603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4806e760 0x7f6c480cc230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009d90 tx=0x7f6c3801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d403e7f9c8d9663b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c467fc640 1 -- 172.21.15.3:0/1227607603 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380a5900 con 0x7f6c4806e760 2023-05-17T11:46:27.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c467fc640 1 -- 172.21.15.3:0/1227607603 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c380a5a60 con 0x7f6c4806e760 2023-05-17T11:46:27.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.462+0000 7f6c467fc640 1 -- 172.21.15.3:0/1227607603 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380a5df0 con 0x7f6c4806e760 2023-05-17T11:46:27.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1227607603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4806e760 msgr2=0x7f6c480cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1227607603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4806e760 0x7f6c480cc230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009d90 tx=0x7f6c3801c950 comp rx=0 tx=0).stop 2023-05-17T11:46:27.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1227607603 shutdown_connections 2023-05-17T11:46:27.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1227607603 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c480cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1227607603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c4806e760 0x7f6c480cc230 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1227607603 >> 172.21.15.3:0/1227607603 conn(0x7f6c480d05b0 msgr2=0x7f6c480d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:27.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1227607603 shutdown_connections 2023-05-17T11:46:27.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1227607603 wait complete. 2023-05-17T11:46:27.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 Processor -- start 2023-05-17T11:46:27.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- start start 2023-05-17T11:46:27.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4806e760 0x7f6c48162e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 0x7f6c481533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c4806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4806c550 con 0x7f6c480af870 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4806c830 con 0x7f6c4806e760 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c4d3d4640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48157850 con 0x7f6c4815d9c0 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 0x7f6c481533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 0x7f6c481533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60946/0 (socket says 172.21.15.3:60946) 2023-05-17T11:46:27.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 -- 172.21.15.3:0/1322551065 learned_addr learned my addr 172.21.15.3:0/1322551065 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:27.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c46ffd640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4806e760 0x7f6c48162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 -- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 msgr2=0x7f6c4806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c4806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 -- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4806e760 msgr2=0x7f6c48162e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4806e760 0x7f6c48162e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c3ffff640 1 -- 172.21.15.3:0/1322551065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009a70 con 0x7f6c480af870 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.466+0000 7f6c46ffd640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4806e760 0x7f6c48162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3ffff640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 0x7f6c481533d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000d800 tx=0x7f6c3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000b6c0 con 0x7f6c480af870 2023-05-17T11:46:27.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3000b820 con 0x7f6c480af870 2023-05-17T11:46:27.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c48166d00 con 0x7f6c480af870 2023-05-17T11:46:27.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000bb90 con 0x7f6c480af870 2023-05-17T11:46:27.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c480cabe0 con 0x7f6c480af870 2023-05-17T11:46:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c48166e90 con 0x7f6c480af870 2023-05-17T11:46:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c3000bcf0 con 0x7f6c480af870 2023-05-17T11:46:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3f7fe640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c280662b0 0x7f6c28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c300842a0 con 0x7f6c480af870 2023-05-17T11:46:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.470+0000 7f6c46ffd640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c280662b0 0x7f6c28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.474+0000 7f6c46ffd640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c280662b0 0x7f6c28068760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c380af000 tx=0x7f6c380a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.474+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6c300516d0 con 0x7f6c480af870 2023-05-17T11:46:27.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c4804de80 con 0x7f6c480af870 2023-05-17T11:46:27.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c3f7fe640 1 -- 172.21.15.3:0/1322551065 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c30054cf0 con 0x7f6c480af870 2023-05-17T11:46:27.640 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-05-17T11:46:27.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c280662b0 msgr2=0x7f6c28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c280662b0 0x7f6c28068760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c380af000 tx=0x7f6c380a7070 comp rx=0 tx=0).stop 2023-05-17T11:46:27.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 msgr2=0x7f6c481533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 0x7f6c481533d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000d800 tx=0x7f6c3000dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 shutdown_connections 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6c280662b0 0x7f6c28068760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6c4815d9c0 0x7f6c4806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c480af870 0x7f6c481533d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 --2- 172.21.15.3:0/1322551065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4806e760 0x7f6c48162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 >> 172.21.15.3:0/1322551065 conn(0x7f6c480d05b0 msgr2=0x7f6c480b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 shutdown_connections 2023-05-17T11:46:27.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.630+0000 7f6c4d3d4640 1 -- 172.21.15.3:0/1322551065 wait complete. 2023-05-17T11:46:27.660 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T11:46:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.790+0000 7f8fee50a640 1 Processor -- start 2023-05-17T11:46:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.790+0000 7f8fee50a640 1 -- start start 2023-05-17T11:46:27.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.790+0000 7f8fee50a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8fe815d3d0 0x7f8fe80ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fee50a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8fe80b04c0 0x7f8fe806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fee50a640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe809bcb0 con 0x7f8fe80cd2c0 2023-05-17T11:46:27.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fee50a640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe80cdf90 con 0x7f8fe815d3d0 2023-05-17T11:46:27.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fee50a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe80ca130 con 0x7f8fe80b04c0 2023-05-17T11:46:27.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8fe815d3d0 0x7f8fe80ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe77fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8fe80cd2c0 0x7f8fe80afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41152/0 (socket says 172.21.15.3:41152) 2023-05-17T11:46:27.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe77fe640 1 -- 172.21.15.3:0/3342703061 learned_addr learned my addr 172.21.15.3:0/3342703061 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:27.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fecaa7640 1 --2- 172.21.15.3:0/3342703061 >> v2:172.21.15.60:3300/0 conn(0x7f8fe80b04c0 0x7f8fe806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3342703061 >> v2:172.21.15.60:3300/0 conn(0x7f8fe80b04c0 msgr2=0x7f8fe806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:27.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe7fff640 1 --2- 172.21.15.3:0/3342703061 >> v2:172.21.15.60:3300/0 conn(0x7f8fe80b04c0 0x7f8fe806fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3342703061 >> v1:172.21.15.3:6789/0 conn(0x7f8fe80cd2c0 legacy=0x7f8fe80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3342703061 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe809bf00 con 0x7f8fe815d3d0 2023-05-17T11:46:27.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe6ffd640 1 -- 172.21.15.3:0/3342703061 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49111828 0 0) 0x7f8fe809bcb0 con 0x7f8fe80cd2c0 2023-05-17T11:46:27.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe7fff640 1 --2- 172.21.15.3:0/3342703061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe815d3d0 0x7f8fe80ccd80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8061730 tx=0x7f8fd801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94287ca40b7e56ec server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe6ffd640 1 -- 172.21.15.3:0/3342703061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80ab600 con 0x7f8fe815d3d0 2023-05-17T11:46:27.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe6ffd640 1 -- 172.21.15.3:0/3342703061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd80a7050 con 0x7f8fe815d3d0 2023-05-17T11:46:27.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.794+0000 7f8fe6ffd640 1 -- 172.21.15.3:0/3342703061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80ab980 con 0x7f8fe815d3d0 2023-05-17T11:46:27.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- 172.21.15.3:0/3342703061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe815d3d0 msgr2=0x7f8fe80ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3342703061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe815d3d0 0x7f8fe80ccd80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8061730 tx=0x7f8fd801c3d0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- 172.21.15.3:0/3342703061 shutdown_connections 2023-05-17T11:46:27.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3342703061 >> v2:172.21.15.60:3300/0 conn(0x7f8fe80b04c0 0x7f8fe806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3342703061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe815d3d0 0x7f8fe80ccd80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- 172.21.15.3:0/3342703061 >> 172.21.15.3:0/3342703061 conn(0x7f8fe806a740 msgr2=0x7f8fe80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:27.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- 172.21.15.3:0/3342703061 shutdown_connections 2023-05-17T11:46:27.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- 172.21.15.3:0/3342703061 wait complete. 2023-05-17T11:46:27.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 Processor -- start 2023-05-17T11:46:27.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- start start 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 0x7f8fe80aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fe80cd2c0 0x7f8fe80c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8fe815d3d0 0x7f8fe80abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81f7e80 con 0x7f8fe80b04c0 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81f4e90 con 0x7f8fe80cd2c0 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fee50a640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81f5170 con 0x7f8fe815d3d0 2023-05-17T11:46:27.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fe7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 0x7f8fe80aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fe7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 0x7f8fe80aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60960/0 (socket says 172.21.15.3:60960) 2023-05-17T11:46:27.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3931514929 learned_addr learned my addr 172.21.15.3:0/3931514929 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:27.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fe77fe640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fe80cd2c0 0x7f8fe80c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.798+0000 7f8fecaa7640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8fe815d3d0 0x7f8fe80abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8fe815d3d0 msgr2=0x7f8fe80abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe7fff640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8fe815d3d0 0x7f8fe80abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fe80cd2c0 msgr2=0x7f8fe80c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe7fff640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fe80cd2c0 0x7f8fe80c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe7fff640 1 -- 172.21.15.3:0/3931514929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd8009420 con 0x7f8fe80b04c0 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fecaa7640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8fe815d3d0 0x7f8fe80abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe7fff640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 0x7f8fe80aeac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80ae040 tx=0x7f8fd8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80b4410 con 0x7f8fe80b04c0 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd80b4570 con 0x7f8fe80b04c0 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80b4920 con 0x7f8fe80b04c0 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe8070060 con 0x7f8fe80b04c0 2023-05-17T11:46:27.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe815d7a0 con 0x7f8fe80b04c0 2023-05-17T11:46:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe80701f0 con 0x7f8fe80b04c0 2023-05-17T11:46:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8fd80b2040 con 0x7f8fe80b04c0 2023-05-17T11:46:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe4ff9640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8fd4066280 0x7f8fd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:27.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8fd811de00 con 0x7f8fe80b04c0 2023-05-17T11:46:27.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.802+0000 7f8fe77fe640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8fd4066280 0x7f8fd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:27.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.806+0000 7f8fe77fe640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8fd4066280 0x7f8fd4068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80c8b80 tx=0x7f8fdc007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:27.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.806+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8fd80eb240 con 0x7f8fe80b04c0 2023-05-17T11:46:27.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fe804de80 con 0x7f8fe80b04c0 2023-05-17T11:46:27.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fe4ff9640 1 -- 172.21.15.3:0/3931514929 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fd80c20a0 con 0x7f8fe80b04c0 2023-05-17T11:46:27.973 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-05-17T11:46:27.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8fd4066280 msgr2=0x7f8fd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8fd4066280 0x7f8fd4068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80c8b80 tx=0x7f8fdc007b60 comp rx=0 tx=0).stop 2023-05-17T11:46:27.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 msgr2=0x7f8fe80aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:27.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 0x7f8fe80aeac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80ae040 tx=0x7f8fd8019170 comp rx=0 tx=0).stop 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 shutdown_connections 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8fd4066280 0x7f8fd4068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8fe815d3d0 0x7f8fe80abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fe80cd2c0 0x7f8fe80c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 --2- 172.21.15.3:0/3931514929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fe80b04c0 0x7f8fe80aeac0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 >> 172.21.15.3:0/3931514929 conn(0x7f8fe806a740 msgr2=0x7f8fe806cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.962+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 shutdown_connections 2023-05-17T11:46:27.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:27.966+0000 7f8fee50a640 1 -- 172.21.15.3:0/3931514929 wait complete. 2023-05-17T11:46:27.993 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:46:28.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168f59e640 1 Processor -- start 2023-05-17T11:46:28.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168f59e640 1 -- start start 2023-05-17T11:46:28.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168f59e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f16900cf190 0x7f169006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168f59e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169006b3c0 con 0x7f16900b1d30 2023-05-17T11:46:28.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168f59e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169006b5f0 con 0x7f16900d0a40 2023-05-17T11:46:28.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168f59e640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900b2100 con 0x7f16900cf190 2023-05-17T11:46:28.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168e59c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f16900b1d30 0x7f16900d0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41156/0 (socket says 172.21.15.3:41156) 2023-05-17T11:46:28.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168e59c640 1 -- 172.21.15.3:0/3710875547 learned_addr learned my addr 172.21.15.3:0/3710875547 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:28.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168ed9d640 1 --2- 172.21.15.3:0/3710875547 >> v2:172.21.15.3:3300/0 conn(0x7f16900cf190 0x7f169006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168d59a640 1 -- 172.21.15.3:0/3710875547 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330436834 0 0) 0x7f169006b3c0 con 0x7f16900b1d30 2023-05-17T11:46:28.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168d59a640 1 -- 172.21.15.3:0/3710875547 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1678003530 con 0x7f16900b1d30 2023-05-17T11:46:28.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168ed9d640 1 -- 172.21.15.3:0/3710875547 >> v1:172.21.15.60:6789/0 conn(0x7f16900d0a40 legacy=0x7f16900cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168d59a640 1 -- 172.21.15.3:0/3710875547 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715417180 0 0) 0x7f169006b5f0 con 0x7f16900d0a40 2023-05-17T11:46:28.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168ed9d640 1 -- 172.21.15.3:0/3710875547 >> v1:172.21.15.3:6789/0 conn(0x7f16900b1d30 legacy=0x7f16900d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.122+0000 7f168ed9d640 1 -- 172.21.15.3:0/3710875547 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169006b8d0 con 0x7f16900cf190 2023-05-17T11:46:28.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168ed9d640 1 --2- 172.21.15.3:0/3710875547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f169006ae80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1688009d90 tx=0x7f168801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2f6f693fbc0145 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168d59a640 1 -- 172.21.15.3:0/3710875547 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880af600 con 0x7f16900cf190 2023-05-17T11:46:28.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168d59a640 1 -- 172.21.15.3:0/3710875547 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880ab050 con 0x7f16900cf190 2023-05-17T11:46:28.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168d59a640 1 -- 172.21.15.3:0/3710875547 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880af980 con 0x7f16900cf190 2023-05-17T11:46:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 -- 172.21.15.3:0/3710875547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 msgr2=0x7f169006ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 --2- 172.21.15.3:0/3710875547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f169006ae80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1688009d90 tx=0x7f168801f130 comp rx=0 tx=0).stop 2023-05-17T11:46:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 -- 172.21.15.3:0/3710875547 shutdown_connections 2023-05-17T11:46:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 --2- 172.21.15.3:0/3710875547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f169006ae80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 -- 172.21.15.3:0/3710875547 >> 172.21.15.3:0/3710875547 conn(0x7f1690071b00 msgr2=0x7f169009bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:28.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 -- 172.21.15.3:0/3710875547 shutdown_connections 2023-05-17T11:46:28.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.126+0000 7f168f59e640 1 -- 172.21.15.3:0/3710875547 wait complete. 2023-05-17T11:46:28.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 Processor -- start 2023-05-17T11:46:28.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- start start 2023-05-17T11:46:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16900b1d30 0x7f169015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f16901f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16900d0a40 0x7f16901f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169015b2b0 con 0x7f16900cf190 2023-05-17T11:46:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16901f3290 con 0x7f16900b1d30 2023-05-17T11:46:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16901f3570 con 0x7f16900d0a40 2023-05-17T11:46:28.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f16901f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f16901f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60976/0 (socket says 172.21.15.3:60976) 2023-05-17T11:46:28.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 -- 172.21.15.3:0/2524629913 learned_addr learned my addr 172.21.15.3:0/2524629913 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16900b1d30 0x7f169015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168ed9d640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16900d0a40 0x7f16901f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 -- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16900d0a40 msgr2=0x7f16901f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16900d0a40 0x7f16901f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 -- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16900b1d30 msgr2=0x7f169015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16900b1d30 0x7f169015ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 -- 172.21.15.3:0/2524629913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688009a70 con 0x7f16900cf190 2023-05-17T11:46:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168dd9b640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f16901f4330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f168400c470 tx=0x7f168400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684005480 con 0x7f16900cf190 2023-05-17T11:46:28.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684003600 con 0x7f16900cf190 2023-05-17T11:46:28.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840039b0 con 0x7f16900cf190 2023-05-17T11:46:28.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16900cce50 con 0x7f16900cf190 2023-05-17T11:46:28.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169006bbb0 con 0x7f16900cf190 2023-05-17T11:46:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.130+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169006be90 con 0x7f16900cf190 2023-05-17T11:46:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.134+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1684003b10 con 0x7f16900cf190 2023-05-17T11:46:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.134+0000 7f167effd640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16700662b0 0x7f1670068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.134+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f16840832d0 con 0x7f16900cf190 2023-05-17T11:46:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.134+0000 7f168e59c640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16700662b0 0x7f1670068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.134+0000 7f168e59c640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16700662b0 0x7f1670068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1680007fd0 tx=0x7f1680009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.138+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1684050720 con 0x7f16900cf190 2023-05-17T11:46:28.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1690067130 con 0x7f16900cf190 2023-05-17T11:46:28.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f167effd640 1 -- 172.21.15.3:0/2524629913 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f1684053d40 con 0x7f16900cf190 2023-05-17T11:46:28.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:28.336 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:46:28.336 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:46:28.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16700662b0 msgr2=0x7f1670068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16700662b0 0x7f1670068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1680007fd0 tx=0x7f1680009040 comp rx=0 tx=0).stop 2023-05-17T11:46:28.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 msgr2=0x7f16901f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f16901f4330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f168400c470 tx=0x7f168400c930 comp rx=0 tx=0).stop 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 shutdown_connections 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16700662b0 0x7f1670068760 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16900d0a40 0x7f16901f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16900cf190 0x7f16901f4330 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 --2- 172.21.15.3:0/2524629913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16900b1d30 0x7f169015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 >> 172.21.15.3:0/2524629913 conn(0x7f1690071b00 msgr2=0x7f16900d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:28.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 shutdown_connections 2023-05-17T11:46:28.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.326+0000 7f168f59e640 1 -- 172.21.15.3:0/2524629913 wait complete. 2023-05-17T11:46:28.357 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:28.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.482+0000 7f101a3cb640 1 Processor -- start 2023-05-17T11:46:28.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.482+0000 7f101a3cb640 1 -- start start 2023-05-17T11:46:28.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f101a3cb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10140716d0 0x7f101406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f101a3cb640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140ca490 con 0x7f101415a2e0 2023-05-17T11:46:28.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f101a3cb640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1014070140 con 0x7f10140c9fd0 2023-05-17T11:46:28.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f101a3cb640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140cacf0 con 0x7f10140716d0 2023-05-17T11:46:28.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f10137fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f101415a2e0 0x7f1014071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41160/0 (socket says 172.21.15.3:41160) 2023-05-17T11:46:28.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f10137fe640 1 -- 172.21.15.3:0/3024040718 learned_addr learned my addr 172.21.15.3:0/3024040718 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:28.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1013fff640 1 --2- 172.21.15.3:0/3024040718 >> v2:172.21.15.60:3300/0 conn(0x7f10140716d0 0x7f101406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232595785 0 0) 0x7f10140ca490 con 0x7f101415a2e0 2023-05-17T11:46:28.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ffc003530 con 0x7f101415a2e0 2023-05-17T11:46:28.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3210579154 0 0) 0x7f0ffc003530 con 0x7f101415a2e0 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 >> v2:172.21.15.60:3300/0 conn(0x7f10140716d0 msgr2=0x7f101406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 --2- 172.21.15.3:0/3024040718 >> v2:172.21.15.60:3300/0 conn(0x7f10140716d0 0x7f101406fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 >> v1:172.21.15.60:6789/0 conn(0x7f10140c9fd0 legacy=0x7f10140b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140ca730 con 0x7f101415a2e0 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f1008001680 con 0x7f101415a2e0 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 >> v1:172.21.15.3:6789/0 conn(0x7f101415a2e0 legacy=0x7f1014071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ffc0039f0 0x7f0ffc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc0047d0 0x7f0ffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ffc005180 0x7f0ffc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140cacf0 con 0x7f0ffc005180 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00c060 con 0x7f0ffc0047d0 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00c220 con 0x7f0ffc0039f0 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1018968640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ffc005180 0x7f0ffc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f10137fe640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc0047d0 0x7f0ffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1013fff640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ffc0039f0 0x7f0ffc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1018968640 1 -- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ffc0039f0 msgr2=0x7f0ffc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:28.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1018968640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f0ffc0039f0 0x7f0ffc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1018968640 1 -- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc0047d0 msgr2=0x7f0ffc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:28.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1018968640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc0047d0 0x7f0ffc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.486+0000 7f1018968640 1 -- 172.21.15.3:0/3024040718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc003530 con 0x7f0ffc005180 2023-05-17T11:46:28.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f1018968640 1 -- 172.21.15.3:0/3024040718 reap_dead start 2023-05-17T11:46:28.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f1018968640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ffc005180 0x7f0ffc00b990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f101406e110 tx=0x7f100c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fba7e30baa6917 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c003b80 con 0x7f0ffc005180 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c003ce0 con 0x7f0ffc005180 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f1012ffd640 1 -- 172.21.15.3:0/3024040718 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c005310 con 0x7f0ffc005180 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 -- 172.21.15.3:0/3024040718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ffc005180 msgr2=0x7f0ffc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ffc005180 0x7f0ffc00b990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f101406e110 tx=0x7f100c01c700 comp rx=0 tx=0).stop 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 -- 172.21.15.3:0/3024040718 shutdown_connections 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3024040718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ffc005180 0x7f0ffc00b990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 -- 172.21.15.3:0/3024040718 >> 172.21.15.3:0/3024040718 conn(0x7f10140b0b30 msgr2=0x7f10140cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 -- 172.21.15.3:0/3024040718 shutdown_connections 2023-05-17T11:46:28.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 -- 172.21.15.3:0/3024040718 wait complete. 2023-05-17T11:46:28.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 Processor -- start 2023-05-17T11:46:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.490+0000 7f101a3cb640 1 -- start start 2023-05-17T11:46:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc005180 0x7f1014159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 0x7f10141595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10140c7810 0x7f10140c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101414c370 con 0x7f1014151af0 2023-05-17T11:46:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140c61c0 con 0x7f0ffc005180 2023-05-17T11:46:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140c55b0 con 0x7f10140c7810 2023-05-17T11:46:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 0x7f10141595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 0x7f10141595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32770/0 (socket says 172.21.15.3:32770) 2023-05-17T11:46:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 -- 172.21.15.3:0/3744419221 learned_addr learned my addr 172.21.15.3:0/3744419221 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f1013fff640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc005180 0x7f1014159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 -- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10140c7810 msgr2=0x7f10140c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10140c7810 0x7f10140c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 -- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc005180 msgr2=0x7f1014159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc005180 0x7f1014159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 -- 172.21.15.3:0/3744419221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140c8ba0 con 0x7f1014151af0 2023-05-17T11:46:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f10137fe640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 0x7f10141595c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1008007290 tx=0x7f1008007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800f8a0 con 0x7f1014151af0 2023-05-17T11:46:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800fa00 con 0x7f1014151af0 2023-05-17T11:46:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800fdb0 con 0x7f1014151af0 2023-05-17T11:46:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140caa10 con 0x7f1014151af0 2023-05-17T11:46:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140c8e80 con 0x7f1014151af0 2023-05-17T11:46:28.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101404de80 con 0x7f1014151af0 2023-05-17T11:46:28.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.494+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f100801d460 con 0x7f1014151af0 2023-05-17T11:46:28.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.498+0000 7f1010ff9640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10000662b0 0x7f1000068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.498+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1008083fb0 con 0x7f1014151af0 2023-05-17T11:46:28.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.498+0000 7f1013fff640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10000662b0 0x7f1000068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.498+0000 7f1013fff640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10000662b0 0x7f1000068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f10040099a0 tx=0x7f1004008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.502+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f10080513e0 con 0x7f1014151af0 2023-05-17T11:46:28.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10140b34c0 con 0x7f1014151af0 2023-05-17T11:46:28.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f1010ff9640 1 -- 172.21.15.3:0/3744419221 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7f1008054a00 con 0x7f1014151af0 2023-05-17T11:46:28.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:28.669 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:28.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10000662b0 msgr2=0x7f1000068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10000662b0 0x7f1000068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f10040099a0 tx=0x7f1004008040 comp rx=0 tx=0).stop 2023-05-17T11:46:28.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 msgr2=0x7f10141595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 0x7f10141595c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1008007290 tx=0x7f1008007750 comp rx=0 tx=0).stop 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 shutdown_connections 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f10000662b0 0x7f1000068760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f10140c7810 0x7f10140c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1014151af0 0x7f10141595c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 --2- 172.21.15.3:0/3744419221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ffc005180 0x7f1014159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 >> 172.21.15.3:0/3744419221 conn(0x7f10140b0b30 msgr2=0x7f1014157300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:28.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.658+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 shutdown_connections 2023-05-17T11:46:28.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.662+0000 7f101a3cb640 1 -- 172.21.15.3:0/3744419221 wait complete. 2023-05-17T11:46:28.689 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T11:46:28.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:46:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 Processor -- start 2023-05-17T11:46:28.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 -- start start 2023-05-17T11:46:28.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f89180716d0 0x7f891806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f891815a2e0 0x7f8918071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89180ca490 con 0x7f89180c9fd0 2023-05-17T11:46:28.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89180cacf0 con 0x7f891815a2e0 2023-05-17T11:46:28.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891e466640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8918070140 con 0x7f89180716d0 2023-05-17T11:46:28.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f89177fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f891815a2e0 0x7f8918071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f89177fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f891815a2e0 0x7f8918071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32778/0 (socket says 172.21.15.3:32778) 2023-05-17T11:46:28.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f891ca03640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f89180c9fd0 0x7f89180b1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41170/0 (socket says 172.21.15.3:41170) 2023-05-17T11:46:28.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f89177fe640 1 -- 172.21.15.3:0/3432081106 learned_addr learned my addr 172.21.15.3:0/3432081106 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.818+0000 7f8917fff640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f89180716d0 0x7f891806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f89177fe640 1 -- 172.21.15.3:0/3432081106 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f89180716d0 msgr2=0x7f891806fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f89177fe640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f89180716d0 0x7f891806fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f89177fe640 1 -- 172.21.15.3:0/3432081106 >> v1:172.21.15.3:6789/0 conn(0x7f89180c9fd0 legacy=0x7f89180b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f89177fe640 1 -- 172.21.15.3:0/3432081106 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918071fe0 con 0x7f891815a2e0 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f8917fff640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f89180716d0 0x7f891806fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:28.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f8916ffd640 1 -- 172.21.15.3:0/3432081106 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904371991 0 0) 0x7f89180ca490 con 0x7f89180c9fd0 2023-05-17T11:46:28.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f89177fe640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f891815a2e0 0x7f8918071aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f890c009870 tx=0x7f890c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6566bc7562240913 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f8916ffd640 1 -- 172.21.15.3:0/3432081106 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0aa670 con 0x7f891815a2e0 2023-05-17T11:46:28.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f8916ffd640 1 -- 172.21.15.3:0/3432081106 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0aa7d0 con 0x7f891815a2e0 2023-05-17T11:46:28.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f8916ffd640 1 -- 172.21.15.3:0/3432081106 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0aab60 con 0x7f891815a2e0 2023-05-17T11:46:28.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f891e466640 1 -- 172.21.15.3:0/3432081106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f891815a2e0 msgr2=0x7f8918071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f891e466640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f891815a2e0 0x7f8918071aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f890c009870 tx=0x7f890c01c510 comp rx=0 tx=0).stop 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f891e466640 1 -- 172.21.15.3:0/3432081106 shutdown_connections 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f891e466640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f891815a2e0 0x7f8918071aa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f891e466640 1 --2- 172.21.15.3:0/3432081106 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f89180716d0 0x7f891806fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.822+0000 7f891e466640 1 -- 172.21.15.3:0/3432081106 >> 172.21.15.3:0/3432081106 conn(0x7f89180b0b30 msgr2=0x7f89180cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 -- 172.21.15.3:0/3432081106 shutdown_connections 2023-05-17T11:46:28.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 -- 172.21.15.3:0/3432081106 wait complete. 2023-05-17T11:46:28.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 Processor -- start 2023-05-17T11:46:28.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 -- start start 2023-05-17T11:46:28.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89180716d0 0x7f89180c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 0x7f89180c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f891815a2e0 0x7f89180b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89180c82c0 con 0x7f89180c9fd0 2023-05-17T11:46:28.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181551a0 con 0x7f89180716d0 2023-05-17T11:46:28.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891e466640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89180b26e0 con 0x7f891815a2e0 2023-05-17T11:46:28.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 0x7f89180c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 0x7f89180c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32790/0 (socket says 172.21.15.3:32790) 2023-05-17T11:46:28.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 -- 172.21.15.3:0/783797290 learned_addr learned my addr 172.21.15.3:0/783797290 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f891ca03640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f891815a2e0 0x7f89180b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f8917fff640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89180716d0 0x7f89180c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 -- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f891815a2e0 msgr2=0x7f89180b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f891815a2e0 0x7f89180b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 -- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89180716d0 msgr2=0x7f89180c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89180716d0 0x7f89180c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:28.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 -- 172.21.15.3:0/783797290 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c0094d0 con 0x7f89180c9fd0 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f8917fff640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89180716d0 0x7f89180c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.826+0000 7f89177fe640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 0x7f89180c7be0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f890c01a140 tx=0x7f890c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0aae10 con 0x7f89180c9fd0 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0b7070 con 0x7f89180c9fd0 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c004220 con 0x7f89180c9fd0 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89180c8e80 con 0x7f89180c9fd0 2023-05-17T11:46:28.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89180c8ba0 con 0x7f89180c9fd0 2023-05-17T11:46:28.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89180b1910 con 0x7f89180c9fd0 2023-05-17T11:46:28.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f890c004380 con 0x7f89180c9fd0 2023-05-17T11:46:28.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8914ff9640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8904066280 0x7f8904068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:28.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f890c11e210 con 0x7f89180c9fd0 2023-05-17T11:46:28.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8917fff640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8904066280 0x7f8904068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:28.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.830+0000 7f8917fff640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8904066280 0x7f8904068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f89080097a0 tx=0x7f8908008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:28.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:28.834+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f890c0eb640 con 0x7f89180c9fd0 2023-05-17T11:46:29.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f891804de80 con 0x7f89180c9fd0 2023-05-17T11:46:29.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f8914ff9640 1 -- 172.21.15.3:0/783797290 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f890c0eec60 con 0x7f89180c9fd0 2023-05-17T11:46:29.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:29.033 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:46:29.033 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:46:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8904066280 msgr2=0x7f8904068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8904066280 0x7f8904068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f89080097a0 tx=0x7f8908008040 comp rx=0 tx=0).stop 2023-05-17T11:46:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 msgr2=0x7f89180c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 0x7f89180c7be0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f890c01a140 tx=0x7f890c01ad50 comp rx=0 tx=0).stop 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 shutdown_connections 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8904066280 0x7f8904068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f891815a2e0 0x7f89180b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89180c9fd0 0x7f89180c7be0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 --2- 172.21.15.3:0/783797290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89180716d0 0x7f89180c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.022+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 >> 172.21.15.3:0/783797290 conn(0x7f89180b0b30 msgr2=0x7f891806c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:29.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.026+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 shutdown_connections 2023-05-17T11:46:29.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.026+0000 7f891e466640 1 -- 172.21.15.3:0/783797290 wait complete. 2023-05-17T11:46:29.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:46:29.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 Processor -- start 2023-05-17T11:46:29.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 -- start start 2023-05-17T11:46:29.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b2815be40 0x7f7b280d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b280ccf00 0x7f7b280d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280cf010 0x7f7b280cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280d0710 con 0x7f7b2815be40 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280cf9d0 con 0x7f7b280ccf00 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2dba2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280d0900 con 0x7f7b280cf010 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b2815be40 0x7f7b280d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b2815be40 0x7f7b280d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32796/0 (socket says 172.21.15.3:32796) 2023-05-17T11:46:29.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 -- 172.21.15.3:0/1821672796 learned_addr learned my addr 172.21.15.3:0/1821672796 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:29.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2d3a1640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280cf010 0x7f7b280cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b27fff640 1 --2- 172.21.15.3:0/1821672796 >> v2:172.21.15.60:3300/0 conn(0x7f7b280ccf00 0x7f7b280d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 -- 172.21.15.3:0/1821672796 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280cf010 msgr2=0x7f7b280cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280cf010 0x7f7b280cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 -- 172.21.15.3:0/1821672796 >> v2:172.21.15.60:3300/0 conn(0x7f7b280ccf00 msgr2=0x7f7b280d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/1821672796 >> v2:172.21.15.60:3300/0 conn(0x7f7b280ccf00 0x7f7b280d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2cba0640 1 -- 172.21.15.3:0/1821672796 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280d0be0 con 0x7f7b2815be40 2023-05-17T11:46:29.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b2d3a1640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280cf010 0x7f7b280cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:29.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.182+0000 7f7b27fff640 1 --2- 172.21.15.3:0/1821672796 >> v2:172.21.15.60:3300/0 conn(0x7f7b280ccf00 0x7f7b280d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:29.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b2815be40 0x7f7b280d01d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7b280d3680 tx=0x7f7b1c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578d218486f3de34 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b277fe640 1 -- 172.21.15.3:0/1821672796 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0a89b0 con 0x7f7b2815be40 2023-05-17T11:46:29.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b277fe640 1 -- 172.21.15.3:0/1821672796 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0a8b10 con 0x7f7b2815be40 2023-05-17T11:46:29.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b277fe640 1 -- 172.21.15.3:0/1821672796 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0a8ea0 con 0x7f7b2815be40 2023-05-17T11:46:29.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 -- 172.21.15.3:0/1821672796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b2815be40 msgr2=0x7f7b280d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b2815be40 0x7f7b280d01d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7b280d3680 tx=0x7f7b1c01ecf0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 -- 172.21.15.3:0/1821672796 shutdown_connections 2023-05-17T11:46:29.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280cf010 0x7f7b280cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/1821672796 >> v2:172.21.15.60:3300/0 conn(0x7f7b280ccf00 0x7f7b280d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/1821672796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b2815be40 0x7f7b280d01d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 -- 172.21.15.3:0/1821672796 >> 172.21.15.3:0/1821672796 conn(0x7f7b28065a90 msgr2=0x7f7b280711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:29.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 -- 172.21.15.3:0/1821672796 shutdown_connections 2023-05-17T11:46:29.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.186+0000 7f7b2dba2640 1 -- 172.21.15.3:0/1821672796 wait complete. 2023-05-17T11:46:29.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 Processor -- start 2023-05-17T11:46:29.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 -- start start 2023-05-17T11:46:29.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280ccf00 0x7f7b28148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 0x7f7b2815e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2815be40 0x7f7b2815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c7f00 con 0x7f7b280cf010 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c81e0 con 0x7f7b2815be40 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c84c0 con 0x7f7b280ccf00 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 0x7f7b2815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 0x7f7b2815e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32802/0 (socket says 172.21.15.3:32802) 2023-05-17T11:46:29.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 -- 172.21.15.3:0/809671185 learned_addr learned my addr 172.21.15.3:0/809671185 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:29.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280ccf00 0x7f7b28148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 -- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280ccf00 msgr2=0x7f7b28148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2d3a1640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2815be40 0x7f7b2815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280ccf00 0x7f7b28148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 -- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2815be40 msgr2=0x7f7b2815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2815be40 0x7f7b2815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 -- 172.21.15.3:0/809671185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0094d0 con 0x7f7b280cf010 2023-05-17T11:46:29.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280ccf00 0x7f7b28148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2d3a1640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2815be40 0x7f7b2815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b27fff640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 0x7f7b2815e230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400c7c0 tx=0x7f7b1400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14007a30 con 0x7f7b280cf010 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b14007b90 con 0x7f7b280cf010 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280d11a0 con 0x7f7b280cf010 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400ce70 con 0x7f7b280cf010 2023-05-17T11:46:29.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.190+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b280d0ec0 con 0x7f7b280cf010 2023-05-17T11:46:29.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.194+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280d1480 con 0x7f7b280cf010 2023-05-17T11:46:29.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.194+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b140113f0 con 0x7f7b280cf010 2023-05-17T11:46:29.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.194+0000 7f7b257fa640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b0c066250 0x7f7b0c068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.194+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7b14083f70 con 0x7f7b280cf010 2023-05-17T11:46:29.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.194+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b0c066250 0x7f7b0c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.194+0000 7f7b2cba0640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b0c066250 0x7f7b0c068700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0b2000 tx=0x7f7b1c0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.198+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7b14051310 con 0x7f7b280cf010 2023-05-17T11:46:29.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b280d01f0 con 0x7f7b280cf010 2023-05-17T11:46:29.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b257fa640 1 -- 172.21.15.3:0/809671185 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f7b14054930 con 0x7f7b280cf010 2023-05-17T11:46:29.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:29.396 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/360081718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":360081718},{"type":"v1","addr":"172.21.15.60:6834","nonce":360081718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6836/2795580584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":2795580584},{"type":"v1","addr":"172.21.15.3:6836","nonce":2795580584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2008825305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6835","nonce":2008825305},{"type":"v1","addr":"172.21.15.3:6837","nonce":2008825305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:45:35.508081+0000","modified":"2023-05-17T11:45:38.523243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6835/3866363606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3866363606},{"type":"v1","addr":"172.21.15.60:6835","nonce":3866363606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T11:46:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2023-05-17T11:46:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b0c066250 msgr2=0x7f7b0c068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b0c066250 0x7f7b0c068700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0b2000 tx=0x7f7b1c0aa070 comp rx=0 tx=0).stop 2023-05-17T11:46:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 msgr2=0x7f7b2815e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 0x7f7b2815e230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400c7c0 tx=0x7f7b1400cc80 comp rx=0 tx=0).stop 2023-05-17T11:46:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 shutdown_connections 2023-05-17T11:46:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f7b0c066250 0x7f7b0c068700 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2815be40 0x7f7b2815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b280cf010 0x7f7b2815e230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 --2- 172.21.15.3:0/809671185 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f7b280ccf00 0x7f7b28148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 >> 172.21.15.3:0/809671185 conn(0x7f7b28065a90 msgr2=0x7f7b280b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 shutdown_connections 2023-05-17T11:46:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.386+0000 7f7b2dba2640 1 -- 172.21.15.3:0/809671185 wait complete. 2023-05-17T11:46:29.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:29.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 Processor -- start 2023-05-17T11:46:29.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 -- start start 2023-05-17T11:46:29.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0b2750 0x7f375c1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f375c0ce190 0x7f375c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c160b20 con 0x7f375c15f4a0 2023-05-17T11:46:29.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0cfc90 con 0x7f375c0ce190 2023-05-17T11:46:29.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f3763041640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0cff70 con 0x7f375c0b2750 2023-05-17T11:46:29.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.542+0000 7f37615de640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f375c0ce190 0x7f375c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f375c0ce190 0x7f375c0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32810/0 (socket says 172.21.15.3:32810) 2023-05-17T11:46:29.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 -- 172.21.15.3:0/1999463309 learned_addr learned my addr 172.21.15.3:0/1999463309 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:29.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f375bfff640 1 --2- 172.21.15.3:0/1999463309 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0b2750 0x7f375c1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 -- 172.21.15.3:0/1999463309 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0b2750 msgr2=0x7f375c1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 --2- 172.21.15.3:0/1999463309 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0b2750 0x7f375c1605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 -- 172.21.15.3:0/1999463309 >> v1:172.21.15.60:6789/0 conn(0x7f375c15f4a0 legacy=0x7f375c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 -- 172.21.15.3:0/1999463309 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0d0250 con 0x7f375c0ce190 2023-05-17T11:46:29.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f37615de640 1 --2- 172.21.15.3:0/1999463309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c0ce190 0x7f375c0cb4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3754009e50 tx=0x7f375401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01e0c2728eb304c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f375b7fe640 1 -- 172.21.15.3:0/1999463309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540a57d0 con 0x7f375c0ce190 2023-05-17T11:46:29.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f375b7fe640 1 -- 172.21.15.3:0/1999463309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37540a5930 con 0x7f375c0ce190 2023-05-17T11:46:29.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.546+0000 7f375b7fe640 1 -- 172.21.15.3:0/1999463309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540a5cc0 con 0x7f375c0ce190 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- 172.21.15.3:0/1999463309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c0ce190 msgr2=0x7f375c0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 --2- 172.21.15.3:0/1999463309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c0ce190 0x7f375c0cb4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3754009e50 tx=0x7f375401ca10 comp rx=0 tx=0).stop 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- 172.21.15.3:0/1999463309 shutdown_connections 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 --2- 172.21.15.3:0/1999463309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c0ce190 0x7f375c0cb4b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 --2- 172.21.15.3:0/1999463309 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0b2750 0x7f375c1605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- 172.21.15.3:0/1999463309 >> 172.21.15.3:0/1999463309 conn(0x7f375c06eac0 msgr2=0x7f375c0cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:29.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- 172.21.15.3:0/1999463309 shutdown_connections 2023-05-17T11:46:29.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- 172.21.15.3:0/1999463309 wait complete. 2023-05-17T11:46:29.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 Processor -- start 2023-05-17T11:46:29.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- start start 2023-05-17T11:46:29.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f375c0b2750 0x7f375c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0ce190 0x7f375c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 0x7f375c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c153190 con 0x7f375c15f4a0 2023-05-17T11:46:29.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c15a4a0 con 0x7f375c0b2750 2023-05-17T11:46:29.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3763041640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c159890 con 0x7f375c0ce190 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 0x7f375c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 0x7f375c0c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32816/0 (socket says 172.21.15.3:32816) 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 -- 172.21.15.3:0/2797917008 learned_addr learned my addr 172.21.15.3:0/2797917008 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f375bfff640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0ce190 0x7f375c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f3760ddd640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f375c0b2750 0x7f375c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 -- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0ce190 msgr2=0x7f375c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0ce190 0x7f375c157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 -- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f375c0b2750 msgr2=0x7f375c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f375c0b2750 0x7f375c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.550+0000 7f37615de640 1 -- 172.21.15.3:0/2797917008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754009b30 con 0x7f375c15f4a0 2023-05-17T11:46:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37615de640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 0x7f375c0c9a40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f375401a640 tx=0x7f37540197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540b8670 con 0x7f375c15f4a0 2023-05-17T11:46:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37540b87d0 con 0x7f375c15f4a0 2023-05-17T11:46:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c15f870 con 0x7f375c15f4a0 2023-05-17T11:46:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540b8b80 con 0x7f375c15f4a0 2023-05-17T11:46:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c0ce630 con 0x7f375c15f4a0 2023-05-17T11:46:29.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c0cc200 con 0x7f375c15f4a0 2023-05-17T11:46:29.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37540b8ce0 con 0x7f375c15f4a0 2023-05-17T11:46:29.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37597fa640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37400662b0 0x7f3740068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f375411f3d0 con 0x7f375c15f4a0 2023-05-17T11:46:29.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.554+0000 7f3760ddd640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37400662b0 0x7f3740068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.558+0000 7f3760ddd640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37400662b0 0x7f3740068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f375c0cb940 tx=0x7f3750009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.558+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f37540ec8e0 con 0x7f375c15f4a0 2023-05-17T11:46:29.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.714+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f375c04de80 con 0x7f375c15f4a0 2023-05-17T11:46:29.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.714+0000 7f37597fa640 1 -- 172.21.15.3:0/2797917008 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18266 (secure 0 0 0) 0x7f37540eff00 con 0x7f375c15f4a0 2023-05-17T11:46:29.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:29.725 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:16.344615+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:45:33.186597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T11:45:34.510143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37400662b0 msgr2=0x7f3740068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37400662b0 0x7f3740068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f375c0cb940 tx=0x7f3750009040 comp rx=0 tx=0).stop 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 msgr2=0x7f375c0c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 0x7f375c0c9a40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f375401a640 tx=0x7f37540197b0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 shutdown_connections 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37400662b0 0x7f3740068760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f375c15f4a0 0x7f375c0c9a40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f375c0ce190 0x7f375c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 --2- 172.21.15.3:0/2797917008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f375c0b2750 0x7f375c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 >> 172.21.15.3:0/2797917008 conn(0x7f375c06eac0 msgr2=0x7f375c0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:29.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 shutdown_connections 2023-05-17T11:46:29.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.718+0000 7f3763041640 1 -- 172.21.15.3:0/2797917008 wait complete. 2023-05-17T11:46:29.746 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T11:46:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 Processor -- start 2023-05-17T11:46:29.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 -- start start 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 0x7fdfac0d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdfac0d03d0 0x7fdfac0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0d0d60 con 0x7fdfac0b2710 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0b3440 con 0x7fdfac0d03d0 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb2df3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0d27f0 con 0x7fdfac0b1e00 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb1390640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdfac0b2710 0x7fdfac0b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41172/0 (socket says 172.21.15.3:41172) 2023-05-17T11:46:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.874+0000 7fdfb1390640 1 -- 172.21.15.3:0/3015300706 learned_addr learned my addr 172.21.15.3:0/3015300706 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:29.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 0x7fdfac0d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfabfff640 1 --2- 172.21.15.3:0/3015300706 >> v2:172.21.15.60:3300/0 conn(0x7fdfac0d03d0 0x7fdfac0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024464102 0 0) 0x7fdfa40014a0 con 0x7fdfac0b2710 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf9c003530 con 0x7fdfac0b2710 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1453985018 0 0) 0x7fdf9c003530 con 0x7fdfac0b2710 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 msgr2=0x7fdfac0d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 0x7fdfac0d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 >> v2:172.21.15.60:3300/0 conn(0x7fdfac0d03d0 msgr2=0x7fdfac0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 --2- 172.21.15.3:0/3015300706 >> v2:172.21.15.60:3300/0 conn(0x7fdfac0d03d0 0x7fdfac0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0d2ad0 con 0x7fdfac0b2710 2023-05-17T11:46:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fdfa4001b90 con 0x7fdfac0b2710 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfabfff640 1 --2- 172.21.15.3:0/3015300706 >> v2:172.21.15.60:3300/0 conn(0x7fdfac0d03d0 0x7fdfac0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 >> v1:172.21.15.3:6789/0 conn(0x7fdfac0b2710 legacy=0x7fdfac0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf9c0039f0 0x7fdf9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 0x7fdf9c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c004d10 0x7fdf9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0b3440 con 0x7fdf9c004d10 2023-05-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0d27f0 con 0x7fdf9c0039f0 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c00ba70 con 0x7fdfac0b1e00 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb1390640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c004d10 0x7fdf9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf9c0039f0 0x7fdf9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfabfff640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 0x7fdf9c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 msgr2=0x7fdf9c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0b1e00 0x7fdf9c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/3015300706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c004d10 msgr2=0x7fdf9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c004d10 0x7fdf9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/3015300706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c003530 con 0x7fdf9c0039f0 2023-05-17T11:46:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.878+0000 7fdfb1390640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c004d10 0x7fdf9c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf9c0039f0 0x7fdf9c003e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009ac0 tx=0x7fdfa001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=945f88dbc6a88755 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00059a0 con 0x7fdf9c0039f0 2023-05-17T11:46:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0005b00 con 0x7fdf9c0039f0 2023-05-17T11:46:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfab7fe640 1 -- 172.21.15.3:0/3015300706 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0006030 con 0x7fdf9c0039f0 2023-05-17T11:46:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 -- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf9c0039f0 msgr2=0x7fdf9c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/3015300706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf9c0039f0 0x7fdf9c003e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009ac0 tx=0x7fdfa001ca30 comp rx=0 tx=0).stop 2023-05-17T11:46:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb1390640 1 -- 172.21.15.3:0/3015300706 reap_dead start 2023-05-17T11:46:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 -- 172.21.15.3:0/3015300706 shutdown_connections 2023-05-17T11:46:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 -- 172.21.15.3:0/3015300706 >> 172.21.15.3:0/3015300706 conn(0x7fdfac071b00 msgr2=0x7fdfac09bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 -- 172.21.15.3:0/3015300706 shutdown_connections 2023-05-17T11:46:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 -- 172.21.15.3:0/3015300706 wait complete. 2023-05-17T11:46:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 Processor -- start 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.882+0000 7fdfb2df3640 1 -- start start 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 0x7fdfac158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0c8b20 0x7fdfac0b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfac0b04f0 0x7fdfac0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac1f8b80 con 0x7fdf9c0039f0 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0b0ed0 con 0x7fdfac0b04f0 2023-05-17T11:46:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac159110 con 0x7fdfac0c8b20 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 0x7fdfac158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 0x7fdfac158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32838/0 (socket says 172.21.15.3:32838) 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/869252624 learned_addr learned my addr 172.21.15.3:0/869252624 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfabfff640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0c8b20 0x7fdfac0b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb1390640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfac0b04f0 0x7fdfac0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0c8b20 msgr2=0x7fdfac0b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0c8b20 0x7fdfac0b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfac0b04f0 msgr2=0x7fdfac0b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfac0b04f0 0x7fdfac0b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 -- 172.21.15.3:0/869252624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0cd660 con 0x7fdf9c0039f0 2023-05-17T11:46:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb0b8f640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 0x7fdfac158bd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009ac0 tx=0x7fdf9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000f000 con 0x7fdf9c0039f0 2023-05-17T11:46:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0006730 con 0x7fdf9c0039f0 2023-05-17T11:46:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac0d24a0 con 0x7fdf9c0039f0 2023-05-17T11:46:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0005e70 con 0x7fdf9c0039f0 2023-05-17T11:46:29.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac0cd7f0 con 0x7fdf9c0039f0 2023-05-17T11:46:29.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac04de80 con 0x7fdf9c0039f0 2023-05-17T11:46:29.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.886+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdfa00a64e0 con 0x7fdf9c0039f0 2023-05-17T11:46:29.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.890+0000 7fdfa97fa640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdf900662b0 0x7fdf90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:29.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.890+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdfa00aa070 con 0x7fdf9c0039f0 2023-05-17T11:46:29.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.890+0000 7fdfabfff640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdf900662b0 0x7fdf90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:29.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.890+0000 7fdfabfff640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdf900662b0 0x7fdf90068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdfac15bb50 tx=0x7fdf98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:29.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:29.894+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdfa00eb970 con 0x7fdf9c0039f0 2023-05-17T11:46:30.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.082+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdfac08c000 con 0x7fdf9c0039f0 2023-05-17T11:46:30.749 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-05-17T11:46:30.738+0000 7fb1e2ebe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T11:46:30.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.746+0000 7fdfa97fa640 1 -- 172.21.15.3:0/869252624 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdfa00eef90 con 0x7fdf9c0039f0 2023-05-17T11:46:30.757 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T11:46:30.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdf900662b0 msgr2=0x7fdf90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdf900662b0 0x7fdf90068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdfac15bb50 tx=0x7fdf98008040 comp rx=0 tx=0).stop 2023-05-17T11:46:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 msgr2=0x7fdfac158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 0x7fdfac158bd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009ac0 tx=0x7fdf9c005800 comp rx=0 tx=0).stop 2023-05-17T11:46:30.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 shutdown_connections 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fdf900662b0 0x7fdf90068760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfac0b04f0 0x7fdfac0b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fdfac0c8b20 0x7fdfac0b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 --2- 172.21.15.3:0/869252624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf9c0039f0 0x7fdfac158bd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 >> 172.21.15.3:0/869252624 conn(0x7fdfac071b00 msgr2=0x7fdfac0728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 shutdown_connections 2023-05-17T11:46:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.750+0000 7fdfb2df3640 1 -- 172.21.15.3:0/869252624 wait complete. 2023-05-17T11:46:30.764 INFO:tasks.ceph.mds.d.smithi060.stderr: -3020> 2023-05-17T11:45:41.232+0000 7f3468906640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T11:46:30.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T11:46:30.813 INFO:tasks.ceph.mds.d.smithi060.stdout:starting mds.d at 2023-05-17T11:46:30.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.914+0000 7efe6ba74640 1 Processor -- start 2023-05-17T11:46:30.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.914+0000 7efe6ba74640 1 -- start start 2023-05-17T11:46:30.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6ba74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe6406e760 0x7efe640cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:30.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6ba74640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640ce180 con 0x7efe6415d9c0 2023-05-17T11:46:30.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6ba74640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640b2e50 con 0x7efe640cf620 2023-05-17T11:46:30.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6ba74640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6415df30 con 0x7efe6406e760 2023-05-17T11:46:30.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6900f640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7efe6415d9c0 0x7efe640b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41184/0 (socket says 172.21.15.3:41184) 2023-05-17T11:46:30.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6900f640 1 -- 172.21.15.3:0/3243257859 learned_addr learned my addr 172.21.15.3:0/3243257859 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:30.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe69810640 1 --2- 172.21.15.3:0/3243257859 >> v2:172.21.15.60:3300/0 conn(0x7efe6406e760 0x7efe640cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:30.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6880e640 1 -- 172.21.15.3:0/3243257859 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329891586 0 0) 0x7efe640ce180 con 0x7efe6415d9c0 2023-05-17T11:46:30.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6880e640 1 -- 172.21.15.3:0/3243257859 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe50003530 con 0x7efe6415d9c0 2023-05-17T11:46:30.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe69810640 1 -- 172.21.15.3:0/3243257859 >> v1:172.21.15.60:6789/0 conn(0x7efe640cf620 legacy=0x7efe640b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe6880e640 1 -- 172.21.15.3:0/3243257859 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734406043 0 0) 0x7efe640b2e50 con 0x7efe640cf620 2023-05-17T11:46:30.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe69810640 1 -- 172.21.15.3:0/3243257859 >> v1:172.21.15.3:6789/0 conn(0x7efe6415d9c0 legacy=0x7efe640b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.918+0000 7efe69810640 1 -- 172.21.15.3:0/3243257859 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6415e210 con 0x7efe6406e760 2023-05-17T11:46:30.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe69810640 1 --2- 172.21.15.3:0/3243257859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6406e760 0x7efe640cc230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe600097c0 tx=0x7efe6001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d825c681cf9442a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:30.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6880e640 1 -- 172.21.15.3:0/3243257859 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600ab600 con 0x7efe6406e760 2023-05-17T11:46:30.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6880e640 1 -- 172.21.15.3:0/3243257859 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe600a7050 con 0x7efe6406e760 2023-05-17T11:46:30.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6880e640 1 -- 172.21.15.3:0/3243257859 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600ab980 con 0x7efe6406e760 2023-05-17T11:46:30.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 -- 172.21.15.3:0/3243257859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6406e760 msgr2=0x7efe640cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 --2- 172.21.15.3:0/3243257859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6406e760 0x7efe640cc230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe600097c0 tx=0x7efe6001c480 comp rx=0 tx=0).stop 2023-05-17T11:46:30.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 -- 172.21.15.3:0/3243257859 shutdown_connections 2023-05-17T11:46:30.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 --2- 172.21.15.3:0/3243257859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6406e760 0x7efe640cc230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 -- 172.21.15.3:0/3243257859 >> 172.21.15.3:0/3243257859 conn(0x7efe640d05b0 msgr2=0x7efe640d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:30.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 -- 172.21.15.3:0/3243257859 shutdown_connections 2023-05-17T11:46:30.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 -- 172.21.15.3:0/3243257859 wait complete. 2023-05-17T11:46:30.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 Processor -- start 2023-05-17T11:46:30.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.922+0000 7efe6ba74640 1 -- start start 2023-05-17T11:46:30.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 0x7efe640b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:30.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efe640cf620 0x7efe640b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:30.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6415d9c0 0x7efe6414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:30.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64163ad0 con 0x7efe6406e760 2023-05-17T11:46:30.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b0e60 con 0x7efe6415d9c0 2023-05-17T11:46:30.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6406bc70 con 0x7efe640cf620 2023-05-17T11:46:30.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 0x7efe640b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:30.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 0x7efe640b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32840/0 (socket says 172.21.15.3:32840) 2023-05-17T11:46:30.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 -- 172.21.15.3:0/2051309511 learned_addr learned my addr 172.21.15.3:0/2051309511 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:30.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6a011640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6415d9c0 0x7efe6414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:30.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6900f640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efe640cf620 0x7efe640b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:30.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 -- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efe640cf620 msgr2=0x7efe640b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efe640cf620 0x7efe640b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 -- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6415d9c0 msgr2=0x7efe6414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6415d9c0 0x7efe6414ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 -- 172.21.15.3:0/2051309511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60009420 con 0x7efe6406e760 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe69810640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 0x7efe640b0880 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe600097c0 tx=0x7efe6001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60004020 con 0x7efe6406e760 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe60004180 con 0x7efe6406e760 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60003620 con 0x7efe6406e760 2023-05-17T11:46:30.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640ccb80 con 0x7efe6406e760 2023-05-17T11:46:30.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe640cabe0 con 0x7efe6406e760 2023-05-17T11:46:30.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe64168520 con 0x7efe6406e760 2023-05-17T11:46:30.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.926+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe60003780 con 0x7efe6406e760 2023-05-17T11:46:30.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.930+0000 7efe5a7fc640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efe48066280 0x7efe48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:30.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.930+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7efe6011d640 con 0x7efe6406e760 2023-05-17T11:46:30.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.930+0000 7efe6900f640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efe48066280 0x7efe48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:30.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.930+0000 7efe6900f640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efe48066280 0x7efe48068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe640d1220 tx=0x7efe54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:30.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:30.934+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efe600eaa40 con 0x7efe6406e760 2023-05-17T11:46:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.122+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efe641638a0 con 0x7efe6406e760 2023-05-17T11:46:31.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.750+0000 7efe5a7fc640 1 -- 172.21.15.3:0/2051309511 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7efe600ee060 con 0x7efe6406e760 2023-05-17T11:46:31.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efe48066280 msgr2=0x7efe48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efe48066280 0x7efe48068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe640d1220 tx=0x7efe54009040 comp rx=0 tx=0).stop 2023-05-17T11:46:31.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 msgr2=0x7efe640b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 0x7efe640b0880 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe600097c0 tx=0x7efe6001acc0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 shutdown_connections 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7efe48066280 0x7efe48068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe6415d9c0 0x7efe6414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7efe640cf620 0x7efe640b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 --2- 172.21.15.3:0/2051309511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe6406e760 0x7efe640b0880 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 >> 172.21.15.3:0/2051309511 conn(0x7efe640d05b0 msgr2=0x7efe640afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 shutdown_connections 2023-05-17T11:46:31.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.754+0000 7efe6ba74640 1 -- 172.21.15.3:0/2051309511 wait complete. 2023-05-17T11:46:31.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T11:46:31.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bdcdf0640 1 Processor -- start 2023-05-17T11:46:31.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bdcdf0640 1 -- start start 2023-05-17T11:46:31.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bdcdf0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 0x7f3bd809bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bdcdf0640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd806d020 con 0x7f3bd80ad760 2023-05-17T11:46:31.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bdcdf0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80b2d20 con 0x7f3bd806b4d0 2023-05-17T11:46:31.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bdcdf0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd81591b0 con 0x7f3bd80b2950 2023-05-17T11:46:31.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bcffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3bd80ad760 0x7f3bd80cd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41194/0 (socket says 172.21.15.3:41194) 2023-05-17T11:46:31.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bcffff640 1 -- 172.21.15.3:0/240611587 learned_addr learned my addr 172.21.15.3:0/240611587 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:31.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bd659c640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 0x7f3bd809bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175203486 0 0) 0x7f3bd806d020 con 0x7f3bd80ad760 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.922+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc4005740 con 0x7f3bd80ad760 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863814782 0 0) 0x7f3bc4005740 con 0x7f3bd80ad760 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 msgr2=0x7f3bd809bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 0x7f3bd809bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 >> v1:172.21.15.60:6789/0 conn(0x7f3bd806b4d0 legacy=0x7f3bd806b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80adb90 con 0x7f3bd80ad760 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f3bc0001680 con 0x7f3bd80ad760 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 >> v1:172.21.15.3:6789/0 conn(0x7f3bd80ad760 legacy=0x7f3bd80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bc4005bc0 0x7f3bc4005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 0x7f3bc40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc4006f20 0x7f3bc4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd81591b0 con 0x7f3bc4005bc0 2023-05-17T11:46:31.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc400dba0 con 0x7f3bc4006f20 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc400dd30 con 0x7f3bd80b2950 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bc4005bc0 0x7f3bc4005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bcffff640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 0x7f3bc40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd6d9d640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc4006f20 0x7f3bc4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 -- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 msgr2=0x7f3bc40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bd80b2950 0x7f3bc40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 -- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc4006f20 msgr2=0x7f3bc4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:31.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc4006f20 0x7f3bc4007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 -- 172.21.15.3:0/240611587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4005740 con 0x7f3bc4005bc0 2023-05-17T11:46:31.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd6d9d640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc4006f20 0x7f3bc4007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:31.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd659c640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bc4005bc0 0x7f3bc4005f90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009ae0 tx=0x7f3bc801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e37a8a6f77fe58 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:31.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a5640 con 0x7f3bc4005bc0 2023-05-17T11:46:31.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80a57a0 con 0x7f3bc4005bc0 2023-05-17T11:46:31.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.926+0000 7f3bd5d9b640 1 -- 172.21.15.3:0/240611587 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a5b50 con 0x7f3bc4005bc0 2023-05-17T11:46:31.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/240611587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bc4005bc0 msgr2=0x7f3bc4005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/240611587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bc4005bc0 0x7f3bc4005f90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009ae0 tx=0x7f3bc801ca50 comp rx=0 tx=0).stop 2023-05-17T11:46:31.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bd6d9d640 1 -- 172.21.15.3:0/240611587 reap_dead start 2023-05-17T11:46:31.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/240611587 shutdown_connections 2023-05-17T11:46:31.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/240611587 >> 172.21.15.3:0/240611587 conn(0x7f3bd806a740 msgr2=0x7f3bd80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:31.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/240611587 shutdown_connections 2023-05-17T11:46:31.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/240611587 wait complete. 2023-05-17T11:46:31.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 Processor -- start 2023-05-17T11:46:31.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- start start 2023-05-17T11:46:31.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bc4005bc0 0x7f3bd8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 0x7f3bd80c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bd8099720 0x7f3bd8099ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80c4c90 con 0x7f3bd8156100 2023-05-17T11:46:31.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd809a0e0 con 0x7f3bd8099720 2023-05-17T11:46:31.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bdcdf0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80990c0 con 0x7f3bc4005bc0 2023-05-17T11:46:31.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bcffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 0x7f3bd80c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bcffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 0x7f3bd80c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32852/0 (socket says 172.21.15.3:32852) 2023-05-17T11:46:31.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bcffff640 1 -- 172.21.15.3:0/2020710512 learned_addr learned my addr 172.21.15.3:0/2020710512 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:31.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bd659c640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bc4005bc0 0x7f3bd8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.930+0000 7f3bd6d9d640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bd8099720 0x7f3bd8099ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bcffff640 1 -- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bc4005bc0 msgr2=0x7f3bd8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bcffff640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bc4005bc0 0x7f3bd8153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bcffff640 1 -- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bd8099720 msgr2=0x7f3bd8099ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:31.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bcffff640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bd8099720 0x7f3bd8099ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:31.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bcffff640 1 -- 172.21.15.3:0/2020710512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80cb5f0 con 0x7f3bd8156100 2023-05-17T11:46:31.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bcffff640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 0x7f3bd80c4750 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e8f0 tx=0x7f3bc000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:31.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000eee0 con 0x7f3bd8156100 2023-05-17T11:46:31.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000c8d0 con 0x7f3bd8156100 2023-05-17T11:46:31.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000cc80 con 0x7f3bd8156100 2023-05-17T11:46:31.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd80cc0a0 con 0x7f3bd8156100 2023-05-17T11:46:31.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd806d4b0 con 0x7f3bd8156100 2023-05-17T11:46:31.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd806cd10 con 0x7f3bd8156100 2023-05-17T11:46:31.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3bc0013420 con 0x7f3bd8156100 2023-05-17T11:46:31.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bceffd640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3bb80662b0 0x7f3bb8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:31.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f3bc00839e0 con 0x7f3bd8156100 2023-05-17T11:46:31.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.934+0000 7f3bd659c640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3bb80662b0 0x7f3bb8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:31.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.938+0000 7f3bd659c640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3bb80662b0 0x7f3bb8068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af000 tx=0x7f3bc80046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:31.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:31.938+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3bc0050dc0 con 0x7f3bd8156100 2023-05-17T11:46:32.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.094+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bd804de80 con 0x7f3bd8156100 2023-05-17T11:46:32.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.762+0000 7f3bceffd640 1 -- 172.21.15.3:0/2020710512 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3bc00543e0 con 0x7f3bd8156100 2023-05-17T11:46:32.772 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-05-17T11:46:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3bb80662b0 msgr2=0x7f3bb8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3bb80662b0 0x7f3bb8068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af000 tx=0x7f3bc80046d0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 msgr2=0x7f3bd80c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 0x7f3bd80c4750 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e8f0 tx=0x7f3bc000ecf0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 shutdown_connections 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3bb80662b0 0x7f3bb8068760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bd8099720 0x7f3bd8099ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd8156100 0x7f3bd80c4750 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 --2- 172.21.15.3:0/2020710512 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3bc4005bc0 0x7f3bd8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 >> 172.21.15.3:0/2020710512 conn(0x7f3bd806a740 msgr2=0x7f3bd80b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 shutdown_connections 2023-05-17T11:46:32.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.766+0000 7f3bdcdf0640 1 -- 172.21.15.3:0/2020710512 wait complete. 2023-05-17T11:46:32.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T11:46:32.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7afba6640 1 Processor -- start 2023-05-17T11:46:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7afba6640 1 -- start start 2023-05-17T11:46:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7afba6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7a8158730 0x7fb7a80ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7afba6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a815c110 con 0x7fb7a80b04c0 2023-05-17T11:46:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7afba6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a815c3f0 con 0x7fb7a80ca780 2023-05-17T11:46:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7afba6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a815cd90 con 0x7fb7a8158730 2023-05-17T11:46:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7ae143640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb7a80b04c0 0x7fb7a80cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41196/0 (socket says 172.21.15.3:41196) 2023-05-17T11:46:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7ae143640 1 -- 172.21.15.3:0/3276177971 learned_addr learned my addr 172.21.15.3:0/3276177971 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.934+0000 7fb7ad942640 1 --2- 172.21.15.3:0/3276177971 >> v2:172.21.15.60:3300/0 conn(0x7fb7a8158730 0x7fb7a80ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132559338 0 0) 0x7fb7a815c110 con 0x7fb7a80b04c0 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb794003530 con 0x7fb7a80b04c0 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033601364 0 0) 0x7fb794003530 con 0x7fb7a80b04c0 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 >> v2:172.21.15.60:3300/0 conn(0x7fb7a8158730 msgr2=0x7fb7a80ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 --2- 172.21.15.3:0/3276177971 >> v2:172.21.15.60:3300/0 conn(0x7fb7a8158730 0x7fb7a80ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 >> v1:172.21.15.60:6789/0 conn(0x7fb7a80ca780 legacy=0x7fb7a80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a815c6d0 con 0x7fb7a80b04c0 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7fb7a0001a00 con 0x7fb7a80b04c0 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 >> v1:172.21.15.3:6789/0 conn(0x7fb7a80b04c0 legacy=0x7fb7a80cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb794003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7940047d0 0x7fb794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794005180 0x7fb79400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a815cd90 con 0x7fb794003980 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79400e210 con 0x7fb794005180 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79400e3d0 con 0x7fb7940047d0 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb794003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ae143640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794005180 0x7fb79400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad141640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7940047d0 0x7fb794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 -- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7940047d0 msgr2=0x7fb794004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7940047d0 0x7fb794004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 -- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794005180 msgr2=0x7fb79400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794005180 0x7fb79400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 -- 172.21.15.3:0/3276177971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794003530 con 0x7fb794003980 2023-05-17T11:46:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ae143640 1 -- 172.21.15.3:0/3276177971 reap_dead start 2023-05-17T11:46:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.938+0000 7fb7ad942640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb794003d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400aa60 tx=0x7fb7a401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e376ffc3a82eca server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40a58f0 con 0x7fb794003980 2023-05-17T11:46:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a40a5a50 con 0x7fb794003980 2023-05-17T11:46:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7ac940640 1 -- 172.21.15.3:0/3276177971 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40a5e40 con 0x7fb794003980 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- 172.21.15.3:0/3276177971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 msgr2=0x7fb794003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb794003d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400aa60 tx=0x7fb7a401cc10 comp rx=0 tx=0).stop 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- 172.21.15.3:0/3276177971 shutdown_connections 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 --2- 172.21.15.3:0/3276177971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb794003d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- 172.21.15.3:0/3276177971 >> 172.21.15.3:0/3276177971 conn(0x7fb7a806a740 msgr2=0x7fb7a80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- 172.21.15.3:0/3276177971 shutdown_connections 2023-05-17T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- 172.21.15.3:0/3276177971 wait complete. 2023-05-17T11:46:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 Processor -- start 2023-05-17T11:46:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- start start 2023-05-17T11:46:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb7a80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7a8156850 0x7fb7a81f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8157030 0x7fb7a81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80c2050 con 0x7fb794003980 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8157a10 con 0x7fb7a8157030 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7afba6640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b2b10 con 0x7fb7a8156850 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7ad942640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb7a80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7ad942640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb7a80b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32868/0 (socket says 172.21.15.3:32868) 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.942+0000 7fb7ad942640 1 -- 172.21.15.3:0/646140570 learned_addr learned my addr 172.21.15.3:0/646140570 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ae143640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8157030 0x7fb7a81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad141640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7a8156850 0x7fb7a81f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad942640 1 -- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7a8156850 msgr2=0x7fb7a81f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad942640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7a8156850 0x7fb7a81f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad942640 1 -- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8157030 msgr2=0x7fb7a81574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad942640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8157030 0x7fb7a81574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad942640 1 -- 172.21.15.3:0/646140570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80c8b10 con 0x7fb794003980 2023-05-17T11:46:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad141640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7a8156850 0x7fb7a81f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ae143640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8157030 0x7fb7a81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7ad942640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb7a80b1b70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7a401ca40 tx=0x7fb7a40199b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4004020 con 0x7fb794003980 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a40041c0 con 0x7fb794003980 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a80c8980 con 0x7fb794003980 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4003620 con 0x7fb794003980 2023-05-17T11:46:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a80ad420 con 0x7fb794003980 2023-05-17T11:46:32.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a804de80 con 0x7fb794003980 2023-05-17T11:46:32.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7a40b4070 con 0x7fb794003980 2023-05-17T11:46:32.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.946+0000 7fb79e7fc640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb78c0662b0 0x7fb78c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:32.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.950+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fb7a411e4a0 con 0x7fb794003980 2023-05-17T11:46:32.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.950+0000 7fb7ad141640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb78c0662b0 0x7fb78c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:32.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.950+0000 7fb7ad141640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb78c0662b0 0x7fb78c068760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7a809c0a0 tx=0x7fb798009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:32.950+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb7a40eba30 con 0x7fb794003980 2023-05-17T11:46:33.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.106+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7a80b0cd0 con 0x7fb794003980 2023-05-17T11:46:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.766+0000 7fb79e7fc640 1 -- 172.21.15.3:0/646140570 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb7a400b040 con 0x7fb794003980 2023-05-17T11:46:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-05-17T11:46:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb78c0662b0 msgr2=0x7fb78c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb78c0662b0 0x7fb78c068760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7a809c0a0 tx=0x7fb798009040 comp rx=0 tx=0).stop 2023-05-17T11:46:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 msgr2=0x7fb7a80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb7a80b1b70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7a401ca40 tx=0x7fb7a40199b0 comp rx=0 tx=0).stop 2023-05-17T11:46:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 shutdown_connections 2023-05-17T11:46:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb78c0662b0 0x7fb78c068760 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8157030 0x7fb7a81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7a8156850 0x7fb7a81f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 --2- 172.21.15.3:0/646140570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb794003980 0x7fb7a80b1b70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.770+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 >> 172.21.15.3:0/646140570 conn(0x7fb7a806a740 msgr2=0x7fb7a80add90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.774+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 shutdown_connections 2023-05-17T11:46:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:33.774+0000 7fb7afba6640 1 -- 172.21.15.3:0/646140570 wait complete. 2023-05-17T11:46:33.804 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T11:46:33.804 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T11:46:33.804 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T11:46:33.804 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:33.805 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T11:46:33.805 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T11:46:33.805 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T11:46:33.805 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:33.806 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T11:46:33.806 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T11:46:33.806 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T11:46:33.806 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:33.806 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T11:46:33.807 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T11:46:33.807 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T11:46:33.807 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T11:46:33.822 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T11:46:33.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T11:46:33.823 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T11:46:33.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T11:46:33.825 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T11:46:33.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T11:46:33.826 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T11:46:33.826 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T11:46:33.871 INFO:tasks.ceph.mds.d:Started 2023-05-17T11:46:33.871 DEBUG:teuthology.parallel:result is None 2023-05-17T11:46:33.872 INFO:tasks.ceph.mds.a:Started 2023-05-17T11:46:33.873 DEBUG:teuthology.parallel:result is None 2023-05-17T11:46:33.873 INFO:tasks.ceph.mds.b:Started 2023-05-17T11:46:33.874 DEBUG:teuthology.parallel:result is None 2023-05-17T11:46:33.874 INFO:tasks.ceph.mds.c:Started 2023-05-17T11:46:33.875 DEBUG:teuthology.parallel:result is None 2023-05-17T11:46:33.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T11:46:33.960 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-05-17T11:46:33.961 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-05-17T11:46:33.979 INFO:tasks.ceph.mds.b.smithi060.stdout:starting mds.b at 2023-05-17T11:46:33.979 INFO:tasks.ceph.mds.d.smithi060.stdout:starting mds.d at 2023-05-17T11:46:34.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 Processor -- start 2023-05-17T11:46:34.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 -- start start 2023-05-17T11:46:34.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f37bc0d0ae0 0x7f37bc0d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:34.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0b2710 0x7f37bc0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:34.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc0b3440 con 0x7f37bc0b1e00 2023-05-17T11:46:34.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc0d27f0 con 0x7f37bc0d0ae0 2023-05-17T11:46:34.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c4674640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0d2ad0 con 0x7f37bc0b2710 2023-05-17T11:46:34.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2410640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f37bc0b1e00 0x7f37bc0d03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41220/0 (socket says 172.21.15.3:41220) 2023-05-17T11:46:34.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2410640 1 -- 172.21.15.3:0/105637361 learned_addr learned my addr 172.21.15.3:0/105637361 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2c11640 1 --2- 172.21.15.3:0/105637361 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0b2710 0x7f37bc0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c1c0f640 1 --2- 172.21.15.3:0/105637361 >> v2:172.21.15.60:3300/0 conn(0x7f37bc0d0ae0 0x7f37bc0d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c140e640 1 -- 172.21.15.3:0/105637361 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208531259 0 0) 0x7f37bc0b3440 con 0x7f37bc0b1e00 2023-05-17T11:46:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c140e640 1 -- 172.21.15.3:0/105637361 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003530 con 0x7f37bc0b1e00 2023-05-17T11:46:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2c11640 1 -- 172.21.15.3:0/105637361 >> v2:172.21.15.60:3300/0 conn(0x7f37bc0d0ae0 msgr2=0x7f37bc0d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2c11640 1 --2- 172.21.15.3:0/105637361 >> v2:172.21.15.60:3300/0 conn(0x7f37bc0d0ae0 0x7f37bc0d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2c11640 1 -- 172.21.15.3:0/105637361 >> v1:172.21.15.3:6789/0 conn(0x7f37bc0b1e00 legacy=0x7f37bc0d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.026+0000 7f37c2c11640 1 -- 172.21.15.3:0/105637361 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0d2db0 con 0x7f37bc0b2710 2023-05-17T11:46:34.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c2c11640 1 --2- 172.21.15.3:0/105637361 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0b2710 0x7f37bc0b2b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009d90 tx=0x7f37b401c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d4a819197d8907f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:34.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c140e640 1 -- 172.21.15.3:0/105637361 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40a5800 con 0x7f37bc0b2710 2023-05-17T11:46:34.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c140e640 1 -- 172.21.15.3:0/105637361 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40a5960 con 0x7f37bc0b2710 2023-05-17T11:46:34.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c140e640 1 -- 172.21.15.3:0/105637361 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40a5cf0 con 0x7f37bc0b2710 2023-05-17T11:46:34.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 -- 172.21.15.3:0/105637361 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0b2710 msgr2=0x7f37bc0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 --2- 172.21.15.3:0/105637361 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0b2710 0x7f37bc0b2b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009d90 tx=0x7f37b401c830 comp rx=0 tx=0).stop 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 -- 172.21.15.3:0/105637361 shutdown_connections 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 --2- 172.21.15.3:0/105637361 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0b2710 0x7f37bc0b2b90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 --2- 172.21.15.3:0/105637361 >> v2:172.21.15.60:3300/0 conn(0x7f37bc0d0ae0 0x7f37bc0d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 -- 172.21.15.3:0/105637361 >> 172.21.15.3:0/105637361 conn(0x7f37bc071b00 msgr2=0x7f37bc09bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 -- 172.21.15.3:0/105637361 shutdown_connections 2023-05-17T11:46:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.030+0000 7f37c4674640 1 -- 172.21.15.3:0/105637361 wait complete. 2023-05-17T11:46:34.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 Processor -- start 2023-05-17T11:46:34.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 -- start start 2023-05-17T11:46:34.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 0x7f37bc0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 0x7f37bc1578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0d0ae0 0x7f37bc14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0b7b00 con 0x7f37bc0b2710 2023-05-17T11:46:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0ca220 con 0x7f37bc0b1e00 2023-05-17T11:46:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0b6f80 con 0x7f37bc0d0ae0 2023-05-17T11:46:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c2410640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 0x7f37bc0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:34.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 0x7f37bc1578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:34.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c2410640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 0x7f37bc0b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.3:35504/0 (socket says 172.21.15.3:35504) 2023-05-17T11:46:34.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 0x7f37bc1578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32914/0 (socket says 172.21.15.3:32914) 2023-05-17T11:46:34.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c2410640 1 -- 172.21.15.3:0/1322342110 learned_addr learned my addr 172.21.15.3:0/1322342110 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:34.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c2c11640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0d0ae0 0x7f37bc14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:34.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 -- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0d0ae0 msgr2=0x7f37bc14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:34.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0d0ae0 0x7f37bc14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:34.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 -- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 msgr2=0x7f37bc0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:34.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 0x7f37bc0b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:34.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 -- 172.21.15.3:0/1322342110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009a70 con 0x7f37bc0b2710 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c2410640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 0x7f37bc0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c1c0f640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 0x7f37bc1578e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00e840 tx=0x7f37ac00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00c730 con 0x7f37bc0b2710 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00c890 con 0x7f37bc0b2710 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00cc20 con 0x7f37bc0b2710 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.034+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc0cd7f0 con 0x7f37bc0b2710 2023-05-17T11:46:34.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.038+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc0cd660 con 0x7f37bc0b2710 2023-05-17T11:46:34.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.038+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc0cd980 con 0x7f37bc0b2710 2023-05-17T11:46:34.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.038+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37ac013470 con 0x7f37bc0b2710 2023-05-17T11:46:34.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.038+0000 7f37b2ffd640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37a0066280 0x7f37a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:34.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.038+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f37ac083a90 con 0x7f37bc0b2710 2023-05-17T11:46:34.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.038+0000 7f37c2410640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37a0066280 0x7f37a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:34.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.042+0000 7f37c2410640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37a0066280 0x7f37a0068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37b80010f0 tx=0x7f37b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:34.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.046+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f37ac0511b0 con 0x7f37bc0b2710 2023-05-17T11:46:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.222+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f37bc04de80 con 0x7f37bc0b2710 2023-05-17T11:46:34.614 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:46:34.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:46:35.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:34.998+0000 7f37b2ffd640 1 -- 172.21.15.3:0/1322342110 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f37ac021080 con 0x7f37bc0b2710 2023-05-17T11:46:35.009 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-05-17T11:46:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37a0066280 msgr2=0x7f37a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37a0066280 0x7f37a0068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37b80010f0 tx=0x7f37b8009040 comp rx=0 tx=0).stop 2023-05-17T11:46:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 msgr2=0x7f37bc1578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 0x7f37bc1578e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00e840 tx=0x7f37ac00ed00 comp rx=0 tx=0).stop 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 shutdown_connections 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f37a0066280 0x7f37a0068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f37bc0d0ae0 0x7f37bc14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37bc0b2710 0x7f37bc1578e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 --2- 172.21.15.3:0/1322342110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37bc0b1e00 0x7f37bc0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 >> 172.21.15.3:0/1322342110 conn(0x7f37bc071b00 msgr2=0x7f37bc0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 shutdown_connections 2023-05-17T11:46:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.002+0000 7f37c4674640 1 -- 172.21.15.3:0/1322342110 wait complete. 2023-05-17T11:46:35.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T11:46:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.158+0000 7f90787cb640 1 Processor -- start 2023-05-17T11:46:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.158+0000 7f90787cb640 1 -- start start 2023-05-17T11:46:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f90787cb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90700c9fd0 0x7f90700b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f90787cb640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700ca490 con 0x7f907015a2e0 2023-05-17T11:46:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f90787cb640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700ca730 con 0x7f90700716d0 2023-05-17T11:46:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f90787cb640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90700cacf0 con 0x7f90700c9fd0 2023-05-17T11:46:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9076d68640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90700c9fd0 0x7f90700b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9076d68640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90700c9fd0 0x7f90700b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32928/0 (socket says 172.21.15.3:32928) 2023-05-17T11:46:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9075d66640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f907015a2e0 0x7f9070071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41236/0 (socket says 172.21.15.3:41236) 2023-05-17T11:46:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9076d68640 1 -- 172.21.15.3:0/1412542650 learned_addr learned my addr 172.21.15.3:0/1412542650 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9076d68640 1 -- 172.21.15.3:0/1412542650 >> v1:172.21.15.60:6789/0 conn(0x7f90700716d0 legacy=0x7f907006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9076d68640 1 -- 172.21.15.3:0/1412542650 >> v1:172.21.15.3:6789/0 conn(0x7f907015a2e0 legacy=0x7f9070071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9076d68640 1 -- 172.21.15.3:0/1412542650 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90700caa10 con 0x7f90700c9fd0 2023-05-17T11:46:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.162+0000 7f9075565640 1 -- 172.21.15.3:0/1412542650 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957245073 0 0) 0x7f90700ca490 con 0x7f907015a2e0 2023-05-17T11:46:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f9076d68640 1 --2- 172.21.15.3:0/1412542650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90700c9fd0 0x7f90700b1200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9068009e50 tx=0x7f906801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac646c35388f9ba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f9075565640 1 -- 172.21.15.3:0/1412542650 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680a58a0 con 0x7f90700c9fd0 2023-05-17T11:46:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f9075565640 1 -- 172.21.15.3:0/1412542650 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90680a5a00 con 0x7f90700c9fd0 2023-05-17T11:46:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f9075565640 1 -- 172.21.15.3:0/1412542650 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680a5d90 con 0x7f90700c9fd0 2023-05-17T11:46:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 -- 172.21.15.3:0/1412542650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90700c9fd0 msgr2=0x7f90700b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 --2- 172.21.15.3:0/1412542650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90700c9fd0 0x7f90700b1200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9068009e50 tx=0x7f906801c9e0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 -- 172.21.15.3:0/1412542650 shutdown_connections 2023-05-17T11:46:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 --2- 172.21.15.3:0/1412542650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90700c9fd0 0x7f90700b1200 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 -- 172.21.15.3:0/1412542650 >> 172.21.15.3:0/1412542650 conn(0x7f90700b0b30 msgr2=0x7f90700cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 -- 172.21.15.3:0/1412542650 shutdown_connections 2023-05-17T11:46:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 -- 172.21.15.3:0/1412542650 wait complete. 2023-05-17T11:46:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 Processor -- start 2023-05-17T11:46:35.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.166+0000 7f90787cb640 1 -- start start 2023-05-17T11:46:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90700716d0 0x7f9070147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90700c9fd0 0x7f90700caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 0x7f9070150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907014f190 con 0x7f907015a2e0 2023-05-17T11:46:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907014f470 con 0x7f90700716d0 2023-05-17T11:46:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907014f750 con 0x7f90700c9fd0 2023-05-17T11:46:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 0x7f9070150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 0x7f9070150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32944/0 (socket says 172.21.15.3:32944) 2023-05-17T11:46:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 -- 172.21.15.3:0/3556802893 learned_addr learned my addr 172.21.15.3:0/3556802893 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076567640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90700716d0 0x7f9070147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9075d66640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90700c9fd0 0x7f90700caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 -- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90700c9fd0 msgr2=0x7f90700caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90700c9fd0 0x7f90700caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 -- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90700716d0 msgr2=0x7f9070147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90700716d0 0x7f9070147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 -- 172.21.15.3:0/3556802893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068009b30 con 0x7f907015a2e0 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9076d68640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 0x7f9070150530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f90680195f0 tx=0x7f9068019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680b8880 con 0x7f907015a2e0 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90680b8a00 con 0x7f907015a2e0 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680b8db0 con 0x7f907015a2e0 2023-05-17T11:46:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9070167dc0 con 0x7f907015a2e0 2023-05-17T11:46:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9070167c30 con 0x7f907015a2e0 2023-05-17T11:46:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.170+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9070167f50 con 0x7f907015a2e0 2023-05-17T11:46:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.174+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90680c3460 con 0x7f907015a2e0 2023-05-17T11:46:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.174+0000 7f9066ffd640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9054066280 0x7f9054068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.174+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f906811f0d0 con 0x7f907015a2e0 2023-05-17T11:46:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.174+0000 7f9076567640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9054066280 0x7f9054068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.174+0000 7f9076567640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9054066280 0x7f9054068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f906c007fd0 tx=0x7f906c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.178+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f90680eca90 con 0x7f907015a2e0 2023-05-17T11:46:35.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f907004de80 con 0x7f907015a2e0 2023-05-17T11:46:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f9066ffd640 1 -- 172.21.15.3:0/3556802893 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f90680f00b0 con 0x7f907015a2e0 2023-05-17T11:46:35.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:35.395 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAkvmRk4XDrMxAAsLImZAurrBniACU6etzV2Q==", 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.396 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-05-17T11:46:35.397 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAlvmRkGDQiBBAAABY/b3h0AnhBBh0JjX3DNg==", 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.c", 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAkvmRkwrHYOhAAeBG2UCUvXd5rAU1q8/BMJg==", 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.399 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.d", 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAlvmRkAk8sCxAApujQkWzCNGkUTv5QML7tLw==", 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.400 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAovmRkcbh2JhAAFjspIn8MjDqt8XrrKncehg==", 2023-05-17T11:46:35.401 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-05-17T11:46:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQArvmRkncLuLBAAyXasMBqhBlx9e7YQvuvSGg==", 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.403 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAuvmRko7JlMxAAyoKJZUBQhM/k1JhivtwpMw==", 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAxvmRk+/lYORAAPjMMWGhmHdk6XsQ2tu2PTA==", 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.405 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQA2vmRkED/4CxAArTb77kgjATtLGHbQEuuWRg==", 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.406 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQA5vmRkwhiyEhAArfsdbkcgXwg7Nkd19jJIIw==", 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQA8vmRklxAYGhAAFN94Ko8w7EnGPW32h5X/XA==", 2023-05-17T11:46:35.408 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-05-17T11:46:35.409 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQA/vmRkFSGbIBAApDkCF5JhMHZM14gdXWqeYg==", 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAlvmRkOo7kDhAAn+6FakgO0TNk9cKxUzc0ag==", 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-05-17T11:46:35.411 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAlvmRkvYZHGxAAboaf4NuU5FZKCp0dZ1MTeQ==", 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.412 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-05-17T11:46:35.413 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAlvmRkgknHFxAAPaHKhhUsPk1vJ8Ea/nHxJA==", 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.3", 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAlvmRkUuB/IRAAssTl1yJXL7Zc4BrtJPc2uw==", 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-05-17T11:46:35.415 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAkvmRkcD2dGBAAbGB4+Hn2JC6DZhZYiHcHfw==", 2023-05-17T11:46:35.416 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.417 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-mds", 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBFvmRk7iZ7IBAASYMeEWyzzdLhOvlWDYNpyQ==", 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-mds" 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-mgr", 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBFvmRkpzB7IBAAVHPs9gKyxDst8ANFqmVf8g==", 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.419 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-osd", 2023-05-17T11:46:35.420 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBFvmRkZDl7IBAAKZ7N026KdmJLni1T/Y29KA==", 2023-05-17T11:46:35.420 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.420 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-osd" 2023-05-17T11:46:35.420 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.420 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rbd", 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBFvmRk6UF7IBAALnYPLE/6EEMPl76nIlhkBQ==", 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.421 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-17T11:46:35.422 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBFvmRkcUp7IBAAsykvvIZD0tVG/XGy7sQlHQ==", 2023-05-17T11:46:35.422 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.422 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-17T11:46:35.422 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rgw", 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBFvmRkOlN7IBAAnJHlznkrBALqt+4yYcoJxw==", 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.423 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAkvmRkXJnPLxAA+Rj+iNYCzQZ9FJOaROUjrw==", 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.424 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQAkvmRkxjYFLBAAwRWFpyCGp+EL7AANt+uVEg==", 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-05-17T11:46:35.425 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-05-17T11:46:35.426 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-05-17T11:46:35.426 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.426 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:35.426 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-05-17T11:46:35.426 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-05-17T11:46:35.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9054066280 msgr2=0x7f9054068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9054066280 0x7f9054068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f906c007fd0 tx=0x7f906c009040 comp rx=0 tx=0).stop 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 msgr2=0x7f9070150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 0x7f9070150530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f90680195f0 tx=0x7f9068019780 comp rx=0 tx=0).stop 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 shutdown_connections 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9054066280 0x7f9054068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f907015a2e0 0x7f9070150530 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90700c9fd0 0x7f90700caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 --2- 172.21.15.3:0/3556802893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90700716d0 0x7f9070147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 >> 172.21.15.3:0/3556802893 conn(0x7f90700b0b30 msgr2=0x7f907006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:35.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 shutdown_connections 2023-05-17T11:46:35.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.386+0000 7f90787cb640 1 -- 172.21.15.3:0/3556802893 wait complete. 2023-05-17T11:46:35.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-17T11:46:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 Processor -- start 2023-05-17T11:46:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 -- start start 2023-05-17T11:46:35.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f740c0ad8a0 0x7f740c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f740c0b1230 0x7f740c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c0c8a30 con 0x7f740c0b1ba0 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0adc70 con 0x7f740c0b1230 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7411925640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0cbcf0 con 0x7f740c0ad8a0 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740a7fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f740c0b1230 0x7f740c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740b7fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f740c0b1ba0 0x7f740c15c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:41240/0 (socket says 172.21.15.3:41240) 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740b7fe640 1 -- 172.21.15.3:0/1493643249 learned_addr learned my addr 172.21.15.3:0/1493643249 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740a7fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f740c0b1230 0x7f740c0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32948/0 (socket says 172.21.15.3:32948) 2023-05-17T11:46:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740affd640 1 --2- 172.21.15.3:0/1493643249 >> v2:172.21.15.60:3300/0 conn(0x7f740c0ad8a0 0x7f740c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740a7fc640 1 -- 172.21.15.3:0/1493643249 >> v2:172.21.15.60:3300/0 conn(0x7f740c0ad8a0 msgr2=0x7f740c0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740a7fc640 1 --2- 172.21.15.3:0/1493643249 >> v2:172.21.15.60:3300/0 conn(0x7f740c0ad8a0 0x7f740c0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740a7fc640 1 -- 172.21.15.3:0/1493643249 >> v1:172.21.15.3:6789/0 conn(0x7f740c0b1ba0 legacy=0x7f740c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f740a7fc640 1 -- 172.21.15.3:0/1493643249 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0c8c80 con 0x7f740c0b1230 2023-05-17T11:46:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.558+0000 7f7409ffb640 1 -- 172.21.15.3:0/1493643249 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617091853 0 0) 0x7f740c0c8a30 con 0x7f740c0b1ba0 2023-05-17T11:46:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f740a7fc640 1 --2- 172.21.15.3:0/1493643249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0b1230 0x7f740c0b1660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f740c06f5e0 tx=0x7f740001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a270ec9ebdf45f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7409ffb640 1 -- 172.21.15.3:0/1493643249 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000a7070 con 0x7f740c0b1230 2023-05-17T11:46:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7409ffb640 1 -- 172.21.15.3:0/1493643249 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74000ab430 con 0x7f740c0b1230 2023-05-17T11:46:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7409ffb640 1 -- 172.21.15.3:0/1493643249 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000ab7c0 con 0x7f740c0b1230 2023-05-17T11:46:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 -- 172.21.15.3:0/1493643249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0b1230 msgr2=0x7f740c0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 --2- 172.21.15.3:0/1493643249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0b1230 0x7f740c0b1660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f740c06f5e0 tx=0x7f740001c430 comp rx=0 tx=0).stop 2023-05-17T11:46:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 -- 172.21.15.3:0/1493643249 shutdown_connections 2023-05-17T11:46:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 --2- 172.21.15.3:0/1493643249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0b1230 0x7f740c0b1660 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 --2- 172.21.15.3:0/1493643249 >> v2:172.21.15.60:3300/0 conn(0x7f740c0ad8a0 0x7f740c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 -- 172.21.15.3:0/1493643249 >> 172.21.15.3:0/1493643249 conn(0x7f740c0b0b20 msgr2=0x7f740c0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 -- 172.21.15.3:0/1493643249 shutdown_connections 2023-05-17T11:46:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.562+0000 7f7411925640 1 -- 172.21.15.3:0/1493643249 wait complete. 2023-05-17T11:46:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 Processor -- start 2023-05-17T11:46:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 -- start start 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 0x7f740c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f740c0b1230 0x7f740c06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f740c0b1ba0 0x7f740c0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c06c090 con 0x7f740c0ad8a0 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c06b480 con 0x7f740c0b1230 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c06b760 con 0x7f740c0b1ba0 2023-05-17T11:46:35.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 0x7f740c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 0x7f740c156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32952/0 (socket says 172.21.15.3:32952) 2023-05-17T11:46:35.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 -- 172.21.15.3:0/4018906801 learned_addr learned my addr 172.21.15.3:0/4018906801 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:35.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740b7fe640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f740c0b1ba0 0x7f740c0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740a7fc640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f740c0b1230 0x7f740c06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 -- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f740c0b1ba0 msgr2=0x7f740c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f740c0b1ba0 0x7f740c0cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 -- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f740c0b1230 msgr2=0x7f740c06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f740c0b1230 0x7f740c06ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 -- 172.21.15.3:0/4018906801 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009420 con 0x7f740c0ad8a0 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740a7fc640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f740c0b1230 0x7f740c06ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740b7fe640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f740c0b1ba0 0x7f740c0cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f740affd640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 0x7f740c156c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00d800 tx=0x7f73fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc018070 con 0x7f740c0ad8a0 2023-05-17T11:46:35.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc0059a0 con 0x7f740c0ad8a0 2023-05-17T11:46:35.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc005b50 con 0x7f740c0ad8a0 2023-05-17T11:46:35.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c0b1fc0 con 0x7f740c0ad8a0 2023-05-17T11:46:35.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.566+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c0c9240 con 0x7f740c0ad8a0 2023-05-17T11:46:35.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.570+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c163d10 con 0x7f740c0ad8a0 2023-05-17T11:46:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.570+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73fc005cb0 con 0x7f740c0ad8a0 2023-05-17T11:46:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.570+0000 7f73f3fff640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f73f8066280 0x7f73f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.570+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f73fc0838e0 con 0x7f740c0ad8a0 2023-05-17T11:46:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.570+0000 7f740a7fc640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f73f8066280 0x7f73f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.570+0000 7f740a7fc640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f73f8066280 0x7f73f8068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f74000af000 tx=0x7f7400008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.574+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f73fc054b30 con 0x7f740c0ad8a0 2023-05-17T11:46:35.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.782+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f740c071f20 con 0x7f740c0ad8a0 2023-05-17T11:46:35.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.786+0000 7f73f3fff640 1 -- 172.21.15.3:0/4018906801 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73fc0546c0 con 0x7f740c0ad8a0 2023-05-17T11:46:35.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f73f8066280 msgr2=0x7f73f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f73f8066280 0x7f73f8068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f74000af000 tx=0x7f7400008040 comp rx=0 tx=0).stop 2023-05-17T11:46:35.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 msgr2=0x7f740c156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 0x7f740c156c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00d800 tx=0x7f73fc00dcc0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 shutdown_connections 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f73f8066280 0x7f73f8068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f740c0b1ba0 0x7f740c0cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f740c0b1230 0x7f740c06ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 --2- 172.21.15.3:0/4018906801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f740c0ad8a0 0x7f740c156c10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 >> 172.21.15.3:0/4018906801 conn(0x7f740c0b0b20 msgr2=0x7f740c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:35.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 shutdown_connections 2023-05-17T11:46:35.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.790+0000 7f7411925640 1 -- 172.21.15.3:0/4018906801 wait complete. 2023-05-17T11:46:35.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-17T11:46:35.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.946+0000 7fcae3c66640 1 Processor -- start 2023-05-17T11:46:35.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.946+0000 7fcae3c66640 1 -- start start 2023-05-17T11:46:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae3c66640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcadc0ca710 0x7fcadc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae3c66640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcadc070220 0x7fcadc070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae3c66640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0c8a30 con 0x7fcadc0ad8a0 2023-05-17T11:46:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae3c66640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0adc70 con 0x7fcadc0ca710 2023-05-17T11:46:35.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae3c66640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0cab40 con 0x7fcadc070220 2023-05-17T11:46:35.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcadc0ca710 0x7fcadc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcadc0ca710 0x7fcadc0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32960/0 (socket says 172.21.15.3:32960) 2023-05-17T11:46:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 -- 172.21.15.3:0/2662178762 learned_addr learned my addr 172.21.15.3:0/2662178762 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae2203640 1 --2- 172.21.15.3:0/2662178762 >> v2:172.21.15.60:3300/0 conn(0x7fcadc070220 0x7fcadc070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 -- 172.21.15.3:0/2662178762 >> v2:172.21.15.60:3300/0 conn(0x7fcadc070220 msgr2=0x7fcadc070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 --2- 172.21.15.3:0/2662178762 >> v2:172.21.15.60:3300/0 conn(0x7fcadc070220 0x7fcadc070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 -- 172.21.15.3:0/2662178762 >> v1:172.21.15.60:6789/0 conn(0x7fcadc0ad8a0 legacy=0x7fcadc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.950+0000 7fcae1201640 1 -- 172.21.15.3:0/2662178762 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0cbcf0 con 0x7fcadc0ca710 2023-05-17T11:46:35.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae1201640 1 --2- 172.21.15.3:0/2662178762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc0ca710 0x7fcadc0b1940 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0c89c0 tx=0x7fcacc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348947906f4e5a75 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae0a00640 1 -- 172.21.15.3:0/2662178762 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0aa430 con 0x7fcadc0ca710 2023-05-17T11:46:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae0a00640 1 -- 172.21.15.3:0/2662178762 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0aa590 con 0x7fcadc0ca710 2023-05-17T11:46:35.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae0a00640 1 -- 172.21.15.3:0/2662178762 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0aa920 con 0x7fcadc0ca710 2023-05-17T11:46:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 -- 172.21.15.3:0/2662178762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc0ca710 msgr2=0x7fcadc0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 --2- 172.21.15.3:0/2662178762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc0ca710 0x7fcadc0b1940 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0c89c0 tx=0x7fcacc01c4d0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 -- 172.21.15.3:0/2662178762 shutdown_connections 2023-05-17T11:46:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 --2- 172.21.15.3:0/2662178762 >> v2:172.21.15.60:3300/0 conn(0x7fcadc070220 0x7fcadc070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 --2- 172.21.15.3:0/2662178762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc0ca710 0x7fcadc0b1940 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 -- 172.21.15.3:0/2662178762 >> 172.21.15.3:0/2662178762 conn(0x7fcadc0b0b20 msgr2=0x7fcadc0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 -- 172.21.15.3:0/2662178762 shutdown_connections 2023-05-17T11:46:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 -- 172.21.15.3:0/2662178762 wait complete. 2023-05-17T11:46:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 Processor -- start 2023-05-17T11:46:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.954+0000 7fcae3c66640 1 -- start start 2023-05-17T11:46:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 0x7fcadc0ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcadc0ad8a0 0x7fcadc150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcadc0ca710 0x7fcadc151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ac0c0 con 0x7fcadc070220 2023-05-17T11:46:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0cd890 con 0x7fcadc0ca710 2023-05-17T11:46:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0acf30 con 0x7fcadc0ad8a0 2023-05-17T11:46:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 0x7fcadc0ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 0x7fcadc0ab9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32972/0 (socket says 172.21.15.3:32972) 2023-05-17T11:46:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 -- 172.21.15.3:0/1863381978 learned_addr learned my addr 172.21.15.3:0/1863381978 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae2203640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcadc0ca710 0x7fcadc151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1201640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcadc0ad8a0 0x7fcadc150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 -- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcadc0ad8a0 msgr2=0x7fcadc150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcadc0ad8a0 0x7fcadc150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 -- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcadc0ca710 msgr2=0x7fcadc151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcadc0ca710 0x7fcadc151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 -- 172.21.15.3:0/1863381978 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0094d0 con 0x7fcadc070220 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae1a02640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 0x7fcadc0ab9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c480 tx=0x7fcad800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80052d0 con 0x7fcadc070220 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8005430 con 0x7fcadc070220 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0c9240 con 0x7fcadc070220 2023-05-17T11:46:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8003890 con 0x7fcadc070220 2023-05-17T11:46:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc06fd00 con 0x7fcadc070220 2023-05-17T11:46:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc0b1e80 con 0x7fcadc070220 2023-05-17T11:46:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.958+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcad80039f0 con 0x7fcadc070220 2023-05-17T11:46:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.962+0000 7fcad27fc640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcac0066280 0x7fcac0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.962+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcad80834b0 con 0x7fcadc070220 2023-05-17T11:46:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.962+0000 7fcae1201640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcac0066280 0x7fcac0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.962+0000 7fcae1201640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcac0066280 0x7fcac0068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0ae000 tx=0x7fcacc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:35.966+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcad8050d20 con 0x7fcadc070220 2023-05-17T11:46:36.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.174+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcadc071f20 con 0x7fcadc070220 2023-05-17T11:46:36.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcad27fc640 1 -- 172.21.15.3:0/1863381978 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcad8054340 con 0x7fcadc070220 2023-05-17T11:46:36.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcac0066280 msgr2=0x7fcac0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcac0066280 0x7fcac0068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0ae000 tx=0x7fcacc0a7000 comp rx=0 tx=0).stop 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 msgr2=0x7fcadc0ab9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 0x7fcadc0ab9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c480 tx=0x7fcad800c940 comp rx=0 tx=0).stop 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 shutdown_connections 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcac0066280 0x7fcac0068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcadc0ca710 0x7fcadc151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fcadc0ad8a0 0x7fcadc150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 --2- 172.21.15.3:0/1863381978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcadc070220 0x7fcadc0ab9c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 >> 172.21.15.3:0/1863381978 conn(0x7fcadc0b0b20 msgr2=0x7fcadc1556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:36.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 shutdown_connections 2023-05-17T11:46:36.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.178+0000 7fcae3c66640 1 -- 172.21.15.3:0/1863381978 wait complete. 2023-05-17T11:46:36.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-17T11:46:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 Processor -- start 2023-05-17T11:46:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 -- start start 2023-05-17T11:46:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fccf40caf80 0x7fccf40cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf40cbe70 con 0x7fccf40ccb70 2023-05-17T11:46:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf4070f00 con 0x7fccf40caf80 2023-05-17T11:46:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf9334640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40711e0 con 0x7fccf4158d10 2023-05-17T11:46:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fccf40caf80 0x7fccf40cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fccf40caf80 0x7fccf40cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55270/0 (socket says 172.21.15.3:55270) 2023-05-17T11:46:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 -- 172.21.15.3:0/1047505500 learned_addr learned my addr 172.21.15.3:0/1047505500 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf3fff640 1 --2- 172.21.15.3:0/1047505500 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 -- 172.21.15.3:0/1047505500 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 msgr2=0x7fccf40caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:36.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 --2- 172.21.15.3:0/1047505500 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf40caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 -- 172.21.15.3:0/1047505500 >> v1:172.21.15.60:6789/0 conn(0x7fccf40ccb70 legacy=0x7fccf40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.338+0000 7fccf37fe640 1 -- 172.21.15.3:0/1047505500 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40cc110 con 0x7fccf40caf80 2023-05-17T11:46:36.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf37fe640 1 --2- 172.21.15.3:0/1047505500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40caf80 0x7fccf40cc630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcce8006fd0 tx=0x7fcce801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642f3e11226c52ec server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:36.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf2ffd640 1 -- 172.21.15.3:0/1047505500 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80aa610 con 0x7fccf40caf80 2023-05-17T11:46:36.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf2ffd640 1 -- 172.21.15.3:0/1047505500 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce80a6040 con 0x7fccf40caf80 2023-05-17T11:46:36.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf2ffd640 1 -- 172.21.15.3:0/1047505500 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80aa990 con 0x7fccf40caf80 2023-05-17T11:46:36.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 -- 172.21.15.3:0/1047505500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40caf80 msgr2=0x7fccf40cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 --2- 172.21.15.3:0/1047505500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40caf80 0x7fccf40cc630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcce8006fd0 tx=0x7fcce801c490 comp rx=0 tx=0).stop 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 -- 172.21.15.3:0/1047505500 shutdown_connections 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 --2- 172.21.15.3:0/1047505500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40caf80 0x7fccf40cc630 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 --2- 172.21.15.3:0/1047505500 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf40caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 -- 172.21.15.3:0/1047505500 >> 172.21.15.3:0/1047505500 conn(0x7fccf40afdd0 msgr2=0x7fccf40b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 -- 172.21.15.3:0/1047505500 shutdown_connections 2023-05-17T11:46:36.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.342+0000 7fccf9334640 1 -- 172.21.15.3:0/1047505500 wait complete. 2023-05-17T11:46:36.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 Processor -- start 2023-05-17T11:46:36.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 -- start start 2023-05-17T11:46:36.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf40caf80 0x7fccf414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 0x7fccf414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf414c530 con 0x7fccf40ccb70 2023-05-17T11:46:36.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf414dc10 con 0x7fccf40caf80 2023-05-17T11:46:36.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4150940 con 0x7fccf4158d10 2023-05-17T11:46:36.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 0x7fccf414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 0x7fccf414bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55274/0 (socket says 172.21.15.3:55274) 2023-05-17T11:46:36.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 -- 172.21.15.3:0/108539767 learned_addr learned my addr 172.21.15.3:0/108539767 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:36.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf8b33640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf3fff640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf40caf80 0x7fccf414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 -- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 msgr2=0x7fccf4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf4155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 -- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf40caf80 msgr2=0x7fccf414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf40caf80 0x7fccf414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 -- 172.21.15.3:0/108539767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8009480 con 0x7fccf40ccb70 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf8b33640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf4155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf37fe640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 0x7fccf414bff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcce801a0c0 tx=0x7fcce8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8003b70 con 0x7fccf40ccb70 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8003cd0 con 0x7fccf40ccb70 2023-05-17T11:46:36.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf4070b40 con 0x7fccf40ccb70 2023-05-17T11:46:36.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80aa650 con 0x7fccf40ccb70 2023-05-17T11:46:36.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.346+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf40cb3d0 con 0x7fccf40ccb70 2023-05-17T11:46:36.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.350+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf4070cd0 con 0x7fccf40ccb70 2023-05-17T11:46:36.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.350+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcce80aa7b0 con 0x7fccf40ccb70 2023-05-17T11:46:36.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.350+0000 7fccf0ff9640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcce00662b0 0x7fcce0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.350+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcce811e250 con 0x7fccf40ccb70 2023-05-17T11:46:36.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.350+0000 7fccf3fff640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcce00662b0 0x7fcce0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.350+0000 7fccf3fff640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcce00662b0 0x7fcce0068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fccf414f490 tx=0x7fcce4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:36.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.354+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcce80ebab0 con 0x7fccf40ccb70 2023-05-17T11:46:36.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.578+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fccf4067130 con 0x7fccf40ccb70 2023-05-17T11:46:36.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf0ff9640 1 -- 172.21.15.3:0/108539767 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcce80ef0d0 con 0x7fccf40ccb70 2023-05-17T11:46:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcce00662b0 msgr2=0x7fcce0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcce00662b0 0x7fcce0068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fccf414f490 tx=0x7fcce4008040 comp rx=0 tx=0).stop 2023-05-17T11:46:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 msgr2=0x7fccf414bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 0x7fccf414bff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcce801a0c0 tx=0x7fcce8019230 comp rx=0 tx=0).stop 2023-05-17T11:46:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 shutdown_connections 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fcce00662b0 0x7fcce0068760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fccf4158d10 0x7fccf4155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccf40ccb70 0x7fccf414bff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 --2- 172.21.15.3:0/108539767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf40caf80 0x7fccf414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 >> 172.21.15.3:0/108539767 conn(0x7fccf40afdd0 msgr2=0x7fccf4153910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 shutdown_connections 2023-05-17T11:46:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.582+0000 7fccf9334640 1 -- 172.21.15.3:0/108539767 wait complete. 2023-05-17T11:46:36.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-17T11:46:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 Processor -- start 2023-05-17T11:46:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 -- start start 2023-05-17T11:46:36.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f14ac0af060 0x7f14ac0ac650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac0cb8a0 con 0x7f14ac15a070 2023-05-17T11:46:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac06a840 con 0x7f14ac0af060 2023-05-17T11:46:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14b142d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cbad0 con 0x7f14ac15a440 2023-05-17T11:46:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f14ac0af060 0x7f14ac0ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f14ac0af060 0x7f14ac0ac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55280/0 (socket says 172.21.15.3:55280) 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 -- 172.21.15.3:0/2857905974 learned_addr learned my addr 172.21.15.3:0/2857905974 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14a3fff640 1 --2- 172.21.15.3:0/2857905974 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 -- 172.21.15.3:0/2857905974 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 msgr2=0x7f14ac0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 --2- 172.21.15.3:0/2857905974 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 -- 172.21.15.3:0/2857905974 >> v1:172.21.15.60:6789/0 conn(0x7f14ac15a070 legacy=0x7f14ac0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.742+0000 7f14ab7fe640 1 -- 172.21.15.3:0/2857905974 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac06a560 con 0x7f14ac0af060 2023-05-17T11:46:36.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14ab7fe640 1 --2- 172.21.15.3:0/2857905974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac0af060 0x7f14ac0ac650 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009e50 tx=0x7f14a401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2be1f9ef54fd09 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:36.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14aa7fc640 1 -- 172.21.15.3:0/2857905974 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40a57f0 con 0x7f14ac0af060 2023-05-17T11:46:36.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14aa7fc640 1 -- 172.21.15.3:0/2857905974 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a40a5950 con 0x7f14ac0af060 2023-05-17T11:46:36.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14aa7fc640 1 -- 172.21.15.3:0/2857905974 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40a5ce0 con 0x7f14ac0af060 2023-05-17T11:46:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 -- 172.21.15.3:0/2857905974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac0af060 msgr2=0x7f14ac0ac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 --2- 172.21.15.3:0/2857905974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac0af060 0x7f14ac0ac650 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009e50 tx=0x7f14a401ca10 comp rx=0 tx=0).stop 2023-05-17T11:46:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 -- 172.21.15.3:0/2857905974 shutdown_connections 2023-05-17T11:46:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 --2- 172.21.15.3:0/2857905974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac0af060 0x7f14ac0ac650 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 --2- 172.21.15.3:0/2857905974 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 -- 172.21.15.3:0/2857905974 >> 172.21.15.3:0/2857905974 conn(0x7f14ac06b4e0 msgr2=0x7f14ac0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 -- 172.21.15.3:0/2857905974 shutdown_connections 2023-05-17T11:46:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.746+0000 7f14b142d640 1 -- 172.21.15.3:0/2857905974 wait complete. 2023-05-17T11:46:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 Processor -- start 2023-05-17T11:46:36.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 -- start start 2023-05-17T11:46:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0af060 0x7f14ac0c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 0x7f14ac0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0c4520 con 0x7f14ac15a070 2023-05-17T11:46:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0c3910 con 0x7f14ac0af060 2023-05-17T11:46:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0c3bf0 con 0x7f14ac15a440 2023-05-17T11:46:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 0x7f14ac0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 0x7f14ac0cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55282/0 (socket says 172.21.15.3:55282) 2023-05-17T11:46:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 -- 172.21.15.3:0/2910079348 learned_addr learned my addr 172.21.15.3:0/2910079348 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14ab7fe640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14aaffd640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0af060 0x7f14ac0c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 -- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 msgr2=0x7f14ac0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 -- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0af060 msgr2=0x7f14ac0c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0af060 0x7f14ac0c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 -- 172.21.15.3:0/2910079348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009b30 con 0x7f14ac15a070 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a3fff640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 0x7f14ac0cdfe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f149400e840 tx=0x7f149400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494009510 con 0x7f14ac15a070 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149400ee90 con 0x7f14ac15a070 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400cb80 con 0x7f14ac15a070 2023-05-17T11:46:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac06b970 con 0x7f14ac15a070 2023-05-17T11:46:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.750+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac0ccc60 con 0x7f14ac15a070 2023-05-17T11:46:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.754+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac06bb00 con 0x7f14ac15a070 2023-05-17T11:46:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.754+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f149400cce0 con 0x7f14ac15a070 2023-05-17T11:46:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.754+0000 7f14a37fe640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f148c066300 0x7f148c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.754+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1494083920 con 0x7f14ac15a070 2023-05-17T11:46:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.754+0000 7f14aaffd640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f148c066300 0x7f148c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.754+0000 7f14aaffd640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f148c066300 0x7f148c0687b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f149c000fc0 tx=0x7f149c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:36.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.758+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1494051210 con 0x7f14ac15a070 2023-05-17T11:46:36.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.974+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f14ac04de80 con 0x7f14ac15a070 2023-05-17T11:46:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14a37fe640 1 -- 172.21.15.3:0/2910079348 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f14940170a0 con 0x7f14ac15a070 2023-05-17T11:46:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f148c066300 msgr2=0x7f148c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f148c066300 0x7f148c0687b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f149c000fc0 tx=0x7f149c009040 comp rx=0 tx=0).stop 2023-05-17T11:46:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 msgr2=0x7f14ac0cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 0x7f14ac0cdfe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f149400e840 tx=0x7f149400ec40 comp rx=0 tx=0).stop 2023-05-17T11:46:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 shutdown_connections 2023-05-17T11:46:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f148c066300 0x7f148c0687b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f14ac15a440 0x7f14ac0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14ac15a070 0x7f14ac0cdfe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 --2- 172.21.15.3:0/2910079348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0af060 0x7f14ac0c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 >> 172.21.15.3:0/2910079348 conn(0x7f14ac06b4e0 msgr2=0x7f14ac156960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 shutdown_connections 2023-05-17T11:46:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:36.978+0000 7f14b142d640 1 -- 172.21.15.3:0/2910079348 wait complete. 2023-05-17T11:46:37.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-17T11:46:37.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 Processor -- start 2023-05-17T11:46:37.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 -- start start 2023-05-17T11:46:37.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6e040ad8a0 0x7f6e040ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e040b1d70 0x7f6e04070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e040c8a30 con 0x7f6e040b1230 2023-05-17T11:46:37.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e040adc70 con 0x7f6e040ad8a0 2023-05-17T11:46:37.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e0ae41640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e040cbcf0 con 0x7f6e040b1d70 2023-05-17T11:46:37.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e08bdd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6e040ad8a0 0x7f6e040ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e03fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6e040b1230 0x7f6e040b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57046/0 (socket says 172.21.15.3:57046) 2023-05-17T11:46:37.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e03fff640 1 -- 172.21.15.3:0/1397334455 learned_addr learned my addr 172.21.15.3:0/1397334455 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:37.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e093de640 1 --2- 172.21.15.3:0/1397334455 >> v2:172.21.15.60:3300/0 conn(0x7f6e040b1d70 0x7f6e04070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e08bdd640 1 -- 172.21.15.3:0/1397334455 >> v2:172.21.15.60:3300/0 conn(0x7f6e040b1d70 msgr2=0x7f6e04070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e08bdd640 1 --2- 172.21.15.3:0/1397334455 >> v2:172.21.15.60:3300/0 conn(0x7f6e040b1d70 0x7f6e04070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e08bdd640 1 -- 172.21.15.3:0/1397334455 >> v1:172.21.15.3:6789/0 conn(0x7f6e040b1230 legacy=0x7f6e040b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e08bdd640 1 -- 172.21.15.3:0/1397334455 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040c8c80 con 0x7f6e040ad8a0 2023-05-17T11:46:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e093de640 1 --2- 172.21.15.3:0/1397334455 >> v2:172.21.15.60:3300/0 conn(0x7f6e040b1d70 0x7f6e04070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.138+0000 7f6e037fe640 1 -- 172.21.15.3:0/1397334455 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240273040 0 0) 0x7f6e040c8a30 con 0x7f6e040b1230 2023-05-17T11:46:37.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e08bdd640 1 --2- 172.21.15.3:0/1397334455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040ad8a0 0x7f6e040ca710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c89c0 tx=0x7f6df801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93933cf500ef3aa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e037fe640 1 -- 172.21.15.3:0/1397334455 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df80ab610 con 0x7f6e040ad8a0 2023-05-17T11:46:37.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e037fe640 1 -- 172.21.15.3:0/1397334455 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df80ab770 con 0x7f6e040ad8a0 2023-05-17T11:46:37.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e037fe640 1 -- 172.21.15.3:0/1397334455 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df80abb00 con 0x7f6e040ad8a0 2023-05-17T11:46:37.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1397334455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040ad8a0 msgr2=0x7f6e040ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1397334455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040ad8a0 0x7f6e040ca710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c89c0 tx=0x7f6df801c410 comp rx=0 tx=0).stop 2023-05-17T11:46:37.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1397334455 shutdown_connections 2023-05-17T11:46:37.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1397334455 >> v2:172.21.15.60:3300/0 conn(0x7f6e040b1d70 0x7f6e04070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1397334455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040ad8a0 0x7f6e040ca710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1397334455 >> 172.21.15.3:0/1397334455 conn(0x7f6e040b0b20 msgr2=0x7f6e040cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:37.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1397334455 shutdown_connections 2023-05-17T11:46:37.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1397334455 wait complete. 2023-05-17T11:46:37.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.142+0000 7f6e0ae41640 1 Processor -- start 2023-05-17T11:46:37.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- start start 2023-05-17T11:46:37.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e040ad8a0 0x7f6e040c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6e040b1230 0x7f6e041578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 0x7f6e04157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04154b30 con 0x7f6e040b1d70 2023-05-17T11:46:37.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04154e10 con 0x7f6e040ad8a0 2023-05-17T11:46:37.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e041550f0 con 0x7f6e040b1230 2023-05-17T11:46:37.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 0x7f6e04157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 0x7f6e04157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55302/0 (socket says 172.21.15.3:55302) 2023-05-17T11:46:37.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 -- 172.21.15.3:0/1231121268 learned_addr learned my addr 172.21.15.3:0/1231121268 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:37.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 -- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6e040b1230 msgr2=0x7f6e041578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e08bdd640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e040ad8a0 0x7f6e040c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e03fff640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6e040b1230 0x7f6e041578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6e040b1230 0x7f6e041578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 -- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e040ad8a0 msgr2=0x7f6e040c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e040ad8a0 0x7f6e040c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 -- 172.21.15.3:0/1231121268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80093b0 con 0x7f6e040b1d70 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e08bdd640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e040ad8a0 0x7f6e040c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:37.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e03fff640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6e040b1230 0x7f6e041578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:37.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e093de640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 0x7f6e04157e10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007df0 tx=0x7f6dfc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0039a0 con 0x7f6e040b1d70 2023-05-17T11:46:37.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc00f040 con 0x7f6e040b1d70 2023-05-17T11:46:37.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc003d40 con 0x7f6e040b1d70 2023-05-17T11:46:37.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e04070f70 con 0x7f6e040b1d70 2023-05-17T11:46:37.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e040c9240 con 0x7f6e040b1d70 2023-05-17T11:46:37.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.146+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04071100 con 0x7f6e040b1d70 2023-05-17T11:46:37.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.150+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6dfc004030 con 0x7f6e040b1d70 2023-05-17T11:46:37.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.150+0000 7f6e017fa640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6de8066280 0x7f6de8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.150+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6dfc083d30 con 0x7f6e040b1d70 2023-05-17T11:46:37.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.150+0000 7f6e08bdd640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6de8066280 0x7f6de8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.150+0000 7f6e08bdd640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6de8066280 0x7f6de8068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6df80af000 tx=0x7f6df8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.154+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6dfc0514f0 con 0x7f6e040b1d70 2023-05-17T11:46:37.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.362+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6e04071f20 con 0x7f6e040b1d70 2023-05-17T11:46:37.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.366+0000 7f6e017fa640 1 -- 172.21.15.3:0/1231121268 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6dfc01a0a0 con 0x7f6e040b1d70 2023-05-17T11:46:37.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6de8066280 msgr2=0x7f6de8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6de8066280 0x7f6de8068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6df80af000 tx=0x7f6df8008040 comp rx=0 tx=0).stop 2023-05-17T11:46:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 msgr2=0x7f6e04157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 0x7f6e04157e10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007df0 tx=0x7f6dfc00d4a0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 shutdown_connections 2023-05-17T11:46:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6de8066280 0x7f6de8068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e040b1d70 0x7f6e04157e10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6e040b1230 0x7f6e041578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 --2- 172.21.15.3:0/1231121268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e040ad8a0 0x7f6e040c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 >> 172.21.15.3:0/1231121268 conn(0x7f6e040b0b20 msgr2=0x7f6e040ab320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:37.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 shutdown_connections 2023-05-17T11:46:37.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.370+0000 7f6e0ae41640 1 -- 172.21.15.3:0/1231121268 wait complete. 2023-05-17T11:46:37.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-17T11:46:37.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 Processor -- start 2023-05-17T11:46:37.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 -- start start 2023-05-17T11:46:37.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d8158d10 0x7f64d80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d80cbe70 con 0x7f64d80ccb70 2023-05-17T11:46:37.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d8070f00 con 0x7f64d8158d10 2023-05-17T11:46:37.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dd569640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80711e0 con 0x7f64d80caf80 2023-05-17T11:46:37.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64d77fe640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64d7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d8158d10 0x7f64d80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dcd68640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f64d80ccb70 0x7f64d80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:55484/0 (socket says 172.21.15.3:55484) 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.526+0000 7f64dcd68640 1 -- 172.21.15.3:0/2415384386 learned_addr learned my addr 172.21.15.3:0/2415384386 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d77fe640 1 -- 172.21.15.3:0/2415384386 >> v2:172.21.15.60:3300/0 conn(0x7f64d8158d10 msgr2=0x7f64d80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d77fe640 1 --2- 172.21.15.3:0/2415384386 >> v2:172.21.15.60:3300/0 conn(0x7f64d8158d10 0x7f64d80caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d77fe640 1 -- 172.21.15.3:0/2415384386 >> v1:172.21.15.60:6789/0 conn(0x7f64d80ccb70 legacy=0x7f64d80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d77fe640 1 -- 172.21.15.3:0/2415384386 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80cc110 con 0x7f64d80caf80 2023-05-17T11:46:37.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d77fe640 1 --2- 172.21.15.3:0/2415384386 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d80cc630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00ba40 tx=0x7f64cc01eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc31a587ce124623 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d6ffd640 1 -- 172.21.15.3:0/2415384386 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0a7a90 con 0x7f64d80caf80 2023-05-17T11:46:37.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d6ffd640 1 -- 172.21.15.3:0/2415384386 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0a7bf0 con 0x7f64d80caf80 2023-05-17T11:46:37.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64d6ffd640 1 -- 172.21.15.3:0/2415384386 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0af440 con 0x7f64d80caf80 2023-05-17T11:46:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 -- 172.21.15.3:0/2415384386 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 msgr2=0x7f64d80cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 --2- 172.21.15.3:0/2415384386 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d80cc630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00ba40 tx=0x7f64cc01eaa0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 -- 172.21.15.3:0/2415384386 shutdown_connections 2023-05-17T11:46:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 --2- 172.21.15.3:0/2415384386 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d80cc630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 --2- 172.21.15.3:0/2415384386 >> v2:172.21.15.60:3300/0 conn(0x7f64d8158d10 0x7f64d80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 -- 172.21.15.3:0/2415384386 >> 172.21.15.3:0/2415384386 conn(0x7f64d80afdd0 msgr2=0x7f64d80b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 -- 172.21.15.3:0/2415384386 shutdown_connections 2023-05-17T11:46:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.530+0000 7f64dd569640 1 -- 172.21.15.3:0/2415384386 wait complete. 2023-05-17T11:46:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 Processor -- start 2023-05-17T11:46:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 -- start start 2023-05-17T11:46:37.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 0x7f64d81487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d8158d10 0x7f64d8148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8149270 con 0x7f64d80ccb70 2023-05-17T11:46:37.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8159930 con 0x7f64d8158d10 2023-05-17T11:46:37.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dd569640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8159bd0 con 0x7f64d80caf80 2023-05-17T11:46:37.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 0x7f64d81487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 0x7f64d81487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55304/0 (socket says 172.21.15.3:55304) 2023-05-17T11:46:37.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 -- 172.21.15.3:0/1925700049 learned_addr learned my addr 172.21.15.3:0/1925700049 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dcd68640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d8158d10 0x7f64d8148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d7fff640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 -- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 msgr2=0x7f64d814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 -- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d8158d10 msgr2=0x7f64d8148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d8158d10 0x7f64d8148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 -- 172.21.15.3:0/1925700049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc00b650 con 0x7f64d80ccb70 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64dcd68640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d8158d10 0x7f64d8148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d77fe640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 0x7f64d81487f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0b2040 tx=0x7f64cc01b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0afbd0 con 0x7f64d80ccb70 2023-05-17T11:46:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0afd50 con 0x7f64d80ccb70 2023-05-17T11:46:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.534+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc005be0 con 0x7f64d80ccb70 2023-05-17T11:46:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d8070b40 con 0x7f64d80ccb70 2023-05-17T11:46:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d80cb3d0 con 0x7f64d80ccb70 2023-05-17T11:46:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d8070cd0 con 0x7f64d80ccb70 2023-05-17T11:46:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64cc0b9440 con 0x7f64d80ccb70 2023-05-17T11:46:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64d4ff9640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f64c406a690 0x7f64c406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f64cc11e100 con 0x7f64d80ccb70 2023-05-17T11:46:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64d7fff640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f64c406a690 0x7f64c406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.538+0000 7f64d7fff640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f64c406a690 0x7f64c406cb40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009af0 tx=0x7f64c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.542+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f64cc0eb8f0 con 0x7f64d80ccb70 2023-05-17T11:46:37.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.750+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f64d8067130 con 0x7f64d80ccb70 2023-05-17T11:46:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64d4ff9640 1 -- 172.21.15.3:0/1925700049 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f64cc0eef10 con 0x7f64d80ccb70 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f64c406a690 msgr2=0x7f64c406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f64c406a690 0x7f64c406cb40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009af0 tx=0x7f64c8008040 comp rx=0 tx=0).stop 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 msgr2=0x7f64d81487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 0x7f64d81487f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0b2040 tx=0x7f64cc01b840 comp rx=0 tx=0).stop 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 shutdown_connections 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f64c406a690 0x7f64c406cb40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d8158d10 0x7f64d8148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64d80ccb70 0x7f64d81487f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 --2- 172.21.15.3:0/1925700049 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f64d80caf80 0x7f64d814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 >> 172.21.15.3:0/1925700049 conn(0x7f64d80afdd0 msgr2=0x7f64d80b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:37.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.754+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 shutdown_connections 2023-05-17T11:46:37.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.758+0000 7f64dd569640 1 -- 172.21.15.3:0/1925700049 wait complete. 2023-05-17T11:46:37.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:37.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.910+0000 7f35f758f640 1 Processor -- start 2023-05-17T11:46:37.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.910+0000 7f35f758f640 1 -- start start 2023-05-17T11:46:37.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f758f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00716d0 0x7f35f006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f758f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35f015a2e0 0x7f35f0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f758f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f35f00c9fd0 0x7f35f00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f758f640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00cacf0 con 0x7f35f00c9fd0 2023-05-17T11:46:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f758f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00ca490 con 0x7f35f015a2e0 2023-05-17T11:46:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f758f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0070140 con 0x7f35f00716d0 2023-05-17T11:46:37.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f35f00c9fd0 0x7f35f00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f35f00c9fd0 0x7f35f00b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55308/0 (socket says 172.21.15.3:55308) 2023-05-17T11:46:37.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 -- 172.21.15.3:0/3991816452 learned_addr learned my addr 172.21.15.3:0/3991816452 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f532b640 1 --2- 172.21.15.3:0/3991816452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00716d0 0x7f35f006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f4b2a640 1 --2- 172.21.15.3:0/3991816452 >> v2:172.21.15.60:3300/0 conn(0x7f35f015a2e0 0x7f35f0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 -- 172.21.15.3:0/3991816452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00716d0 msgr2=0x7f35f006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 --2- 172.21.15.3:0/3991816452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00716d0 0x7f35f006fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 -- 172.21.15.3:0/3991816452 >> v2:172.21.15.60:3300/0 conn(0x7f35f015a2e0 msgr2=0x7f35f0071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 --2- 172.21.15.3:0/3991816452 >> v2:172.21.15.60:3300/0 conn(0x7f35f015a2e0 0x7f35f0071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.914+0000 7f35f5b2c640 1 -- 172.21.15.3:0/3991816452 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0071fe0 con 0x7f35f00c9fd0 2023-05-17T11:46:37.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f5b2c640 1 --2- 172.21.15.3:0/3991816452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f00c9fd0 0x7f35f00b1200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f35f006cf30 tx=0x7f35e801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287450d736fe0ff1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35e7fff640 1 -- 172.21.15.3:0/3991816452 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80a5820 con 0x7f35f00c9fd0 2023-05-17T11:46:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35e7fff640 1 -- 172.21.15.3:0/3991816452 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80a5980 con 0x7f35f00c9fd0 2023-05-17T11:46:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35e7fff640 1 -- 172.21.15.3:0/3991816452 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80a5d10 con 0x7f35f00c9fd0 2023-05-17T11:46:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 -- 172.21.15.3:0/3991816452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f00c9fd0 msgr2=0x7f35f00b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 --2- 172.21.15.3:0/3991816452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f00c9fd0 0x7f35f00b1200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f35f006cf30 tx=0x7f35e801c9a0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 -- 172.21.15.3:0/3991816452 shutdown_connections 2023-05-17T11:46:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 --2- 172.21.15.3:0/3991816452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f00c9fd0 0x7f35f00b1200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 --2- 172.21.15.3:0/3991816452 >> v2:172.21.15.60:3300/0 conn(0x7f35f015a2e0 0x7f35f0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 --2- 172.21.15.3:0/3991816452 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00716d0 0x7f35f006fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 -- 172.21.15.3:0/3991816452 >> 172.21.15.3:0/3991816452 conn(0x7f35f00b0b30 msgr2=0x7f35f00cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 -- 172.21.15.3:0/3991816452 shutdown_connections 2023-05-17T11:46:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 -- 172.21.15.3:0/3991816452 wait complete. 2023-05-17T11:46:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 Processor -- start 2023-05-17T11:46:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.918+0000 7f35f758f640 1 -- start start 2023-05-17T11:46:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f00716d0 0x7f35f0144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00c9fd0 0x7f35f015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 0x7f35f015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f014f5b0 con 0x7f35f015a2e0 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f015c410 con 0x7f35f00716d0 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f015c6f0 con 0x7f35f00c9fd0 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 0x7f35f015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 0x7f35f015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55322/0 (socket says 172.21.15.3:55322) 2023-05-17T11:46:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 -- 172.21.15.3:0/145292589 learned_addr learned my addr 172.21.15.3:0/145292589 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f4b2a640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00c9fd0 0x7f35f015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f532b640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f00716d0 0x7f35f0144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 -- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00c9fd0 msgr2=0x7f35f015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00c9fd0 0x7f35f015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 -- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f00716d0 msgr2=0x7f35f0144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f00716d0 0x7f35f0144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 -- 172.21.15.3:0/145292589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8009b30 con 0x7f35f015a2e0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f5b2c640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 0x7f35f015bdc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f35e80af040 tx=0x7f35e8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b8670 con 0x7f35f015a2e0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80b87d0 con 0x7f35f015a2e0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b8b60 con 0x7f35f015a2e0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f00c8e80 con 0x7f35f015a2e0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f00c8ba0 con 0x7f35f015a2e0 2023-05-17T11:46:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f006bc30 con 0x7f35f015a2e0 2023-05-17T11:46:37.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.922+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35e80b8cc0 con 0x7f35f015a2e0 2023-05-17T11:46:37.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.926+0000 7f35e5ffb640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f35d40662b0 0x7f35d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:37.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.926+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35e811ecf0 con 0x7f35f015a2e0 2023-05-17T11:46:37.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.926+0000 7f35f532b640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f35d40662b0 0x7f35d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:37.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.926+0000 7f35f532b640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f35d40662b0 0x7f35d4068760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009ae0 tx=0x7f35ec009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:37.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:37.930+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f35e8123070 con 0x7f35f015a2e0 2023-05-17T11:46:38.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.082+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f015c830 con 0x7f35f015a2e0 2023-05-17T11:46:38.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35e5ffb640 1 -- 172.21.15.3:0/145292589 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f35f015c830 con 0x7f35f015a2e0 2023-05-17T11:46:38.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:38.095 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:34.999927+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:38.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f35d40662b0 msgr2=0x7f35d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f35d40662b0 0x7f35d4068760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009ae0 tx=0x7f35ec009190 comp rx=0 tx=0).stop 2023-05-17T11:46:38.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 msgr2=0x7f35f015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 0x7f35f015bdc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f35e80af040 tx=0x7f35e8019740 comp rx=0 tx=0).stop 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 shutdown_connections 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f35d40662b0 0x7f35d4068760 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35f015a2e0 0x7f35f015bdc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f35f00c9fd0 0x7f35f015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 --2- 172.21.15.3:0/145292589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f00716d0 0x7f35f0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 >> 172.21.15.3:0/145292589 conn(0x7f35f00b0b30 msgr2=0x7f35f0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 shutdown_connections 2023-05-17T11:46:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.086+0000 7f35f758f640 1 -- 172.21.15.3:0/145292589 wait complete. 2023-05-17T11:46:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T11:45:22.595654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T11:45:28.386583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T11:46:38.116 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T11:46:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 Processor -- start 2023-05-17T11:46:38.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 -- start start 2023-05-17T11:46:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb82c0ca780 0x7fb82c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0b02f0 0x7fb82c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c0adb30 con 0x7fb82c158730 2023-05-17T11:46:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c15cd90 con 0x7fb82c0ca780 2023-05-17T11:46:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb830b25640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0b0760 con 0x7fb82c0b02f0 2023-05-17T11:46:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb82a59c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb82c158730 0x7fb82c0ad420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57056/0 (socket says 172.21.15.3:57056) 2023-05-17T11:46:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.246+0000 7fb82a59c640 1 -- 172.21.15.3:0/3237217960 learned_addr learned my addr 172.21.15.3:0/3237217960 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb829d9b640 1 --2- 172.21.15.3:0/3237217960 >> v2:172.21.15.3:3300/0 conn(0x7fb82c0ca780 0x7fb82c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb82ad9d640 1 --2- 172.21.15.3:0/3237217960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0b02f0 0x7fb82c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb829d9b640 1 -- 172.21.15.3:0/3237217960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0b02f0 msgr2=0x7fb82c0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb829d9b640 1 --2- 172.21.15.3:0/3237217960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0b02f0 0x7fb82c0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb829d9b640 1 -- 172.21.15.3:0/3237217960 >> v1:172.21.15.3:6789/0 conn(0x7fb82c158730 legacy=0x7fb82c0ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb829d9b640 1 -- 172.21.15.3:0/3237217960 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c15c110 con 0x7fb82c0ca780 2023-05-17T11:46:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb82959a640 1 -- 172.21.15.3:0/3237217960 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54552049 0 0) 0x7fb82c0adb30 con 0x7fb82c158730 2023-05-17T11:46:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb829d9b640 1 --2- 172.21.15.3:0/3237217960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c0ca780 0x7fb82c0afdb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb8200097c0 tx=0x7fb82001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbd0122e6399906 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb82959a640 1 -- 172.21.15.3:0/3237217960 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200ab600 con 0x7fb82c0ca780 2023-05-17T11:46:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb82959a640 1 -- 172.21.15.3:0/3237217960 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8200a7050 con 0x7fb82c0ca780 2023-05-17T11:46:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.250+0000 7fb82959a640 1 -- 172.21.15.3:0/3237217960 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200ab980 con 0x7fb82c0ca780 2023-05-17T11:46:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- 172.21.15.3:0/3237217960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c0ca780 msgr2=0x7fb82c0afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 --2- 172.21.15.3:0/3237217960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c0ca780 0x7fb82c0afdb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb8200097c0 tx=0x7fb82001c480 comp rx=0 tx=0).stop 2023-05-17T11:46:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- 172.21.15.3:0/3237217960 shutdown_connections 2023-05-17T11:46:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 --2- 172.21.15.3:0/3237217960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0b02f0 0x7fb82c0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 --2- 172.21.15.3:0/3237217960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c0ca780 0x7fb82c0afdb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- 172.21.15.3:0/3237217960 >> 172.21.15.3:0/3237217960 conn(0x7fb82c06a740 msgr2=0x7fb82c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- 172.21.15.3:0/3237217960 shutdown_connections 2023-05-17T11:46:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- 172.21.15.3:0/3237217960 wait complete. 2023-05-17T11:46:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 Processor -- start 2023-05-17T11:46:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- start start 2023-05-17T11:46:38.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c0b02f0 0x7fb82c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0ca780 0x7fb82c152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 0x7fb82c159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c158c10 con 0x7fb82c158730 2023-05-17T11:46:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c1527d0 con 0x7fb82c0b02f0 2023-05-17T11:46:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb830b25640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0c72f0 con 0x7fb82c0ca780 2023-05-17T11:46:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 0x7fb82c159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 0x7fb82c159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55336/0 (socket says 172.21.15.3:55336) 2023-05-17T11:46:38.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 -- 172.21.15.3:0/1270586689 learned_addr learned my addr 172.21.15.3:0/1270586689 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:38.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb829d9b640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0ca780 0x7fb82c152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82a59c640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c0b02f0 0x7fb82c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 -- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0ca780 msgr2=0x7fb82c152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0ca780 0x7fb82c152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 -- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c0b02f0 msgr2=0x7fb82c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c0b02f0 0x7fb82c152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82ad9d640 1 -- 172.21.15.3:0/1270586689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820009420 con 0x7fb82c158730 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb829d9b640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0ca780 0x7fb82c152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.254+0000 7fb82a59c640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c0b02f0 0x7fb82c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb82ad9d640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 0x7fb82c159f00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb824007e90 tx=0x7fb82400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824014420 con 0x7fb82c158730 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824014580 con 0x7fb82c158730 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824014930 con 0x7fb82c158730 2023-05-17T11:46:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c0c8980 con 0x7fb82c158730 2023-05-17T11:46:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c15c9b0 con 0x7fb82c158730 2023-05-17T11:46:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c0c8b10 con 0x7fb82c158730 2023-05-17T11:46:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb824014a90 con 0x7fb82c158730 2023-05-17T11:46:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb81affd640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb80c066280 0x7fb80c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb8240842f0 con 0x7fb82c158730 2023-05-17T11:46:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.258+0000 7fb82a59c640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb80c066280 0x7fb80c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.262+0000 7fb82a59c640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb80c066280 0x7fb80c068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb81c007fd0 tx=0x7fb81c007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.262+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb824055540 con 0x7fb82c158730 2023-05-17T11:46:38.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb82c04de80 con 0x7fb82c158730 2023-05-17T11:46:38.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb81affd640 1 -- 172.21.15.3:0/1270586689 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8240550d0 con 0x7fb82c158730 2023-05-17T11:46:38.427 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-05-17T11:46:38.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb80c066280 msgr2=0x7fb80c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb80c066280 0x7fb80c068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb81c007fd0 tx=0x7fb81c007c20 comp rx=0 tx=0).stop 2023-05-17T11:46:38.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 msgr2=0x7fb82c159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 0x7fb82c159f00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb824007e90 tx=0x7fb82400e4b0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 shutdown_connections 2023-05-17T11:46:38.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb80c066280 0x7fb80c068730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb82c158730 0x7fb82c159f00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb82c0ca780 0x7fb82c152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 --2- 172.21.15.3:0/1270586689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c0b02f0 0x7fb82c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 >> 172.21.15.3:0/1270586689 conn(0x7fb82c06a740 msgr2=0x7fb82c0cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:38.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 shutdown_connections 2023-05-17T11:46:38.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.418+0000 7fb830b25640 1 -- 172.21.15.3:0/1270586689 wait complete. 2023-05-17T11:46:38.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T11:46:38.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 Processor -- start 2023-05-17T11:46:38.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 -- start start 2023-05-17T11:46:38.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80cbe90 0x7fb7b80cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb7b80ca370 0x7fb7b80ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b80cc7a0 con 0x7fb7b80cd050 2023-05-17T11:46:38.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b8159500 con 0x7fb7b80ca370 2023-05-17T11:46:38.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bf811640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b80cd530 con 0x7fb7b80cbe90 2023-05-17T11:46:38.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bcdac640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb7b80cd050 0x7fb7b806e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57072/0 (socket says 172.21.15.3:57072) 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bcdac640 1 -- 172.21.15.3:0/1373252735 learned_addr learned my addr 172.21.15.3:0/1373252735 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bddae640 1 --2- 172.21.15.3:0/1373252735 >> v2:172.21.15.3:3300/0 conn(0x7fb7b80ca370 0x7fb7b80ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bd5ad640 1 --2- 172.21.15.3:0/1373252735 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80cbe90 0x7fb7b80cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bddae640 1 -- 172.21.15.3:0/1373252735 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80cbe90 msgr2=0x7fb7b80cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bddae640 1 --2- 172.21.15.3:0/1373252735 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80cbe90 0x7fb7b80cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bddae640 1 -- 172.21.15.3:0/1373252735 >> v1:172.21.15.3:6789/0 conn(0x7fb7b80cd050 legacy=0x7fb7b806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7bddae640 1 -- 172.21.15.3:0/1373252735 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80cd810 con 0x7fb7b80ca370 2023-05-17T11:46:38.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.578+0000 7fb7affff640 1 -- 172.21.15.3:0/1373252735 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410639714 0 0) 0x7fb7b80cc7a0 con 0x7fb7b80cd050 2023-05-17T11:46:38.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bddae640 1 --2- 172.21.15.3:0/1373252735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80ca370 0x7fb7b80ca7f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009d90 tx=0x7fb7b001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b282b4b47f7fed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7affff640 1 -- 172.21.15.3:0/1373252735 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00a7c00 con 0x7fb7b80ca370 2023-05-17T11:46:38.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7affff640 1 -- 172.21.15.3:0/1373252735 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b00a7d60 con 0x7fb7b80ca370 2023-05-17T11:46:38.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7affff640 1 -- 172.21.15.3:0/1373252735 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00af660 con 0x7fb7b80ca370 2023-05-17T11:46:38.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 -- 172.21.15.3:0/1373252735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80ca370 msgr2=0x7fb7b80ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 --2- 172.21.15.3:0/1373252735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80ca370 0x7fb7b80ca7f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009d90 tx=0x7fb7b001eb30 comp rx=0 tx=0).stop 2023-05-17T11:46:38.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 -- 172.21.15.3:0/1373252735 shutdown_connections 2023-05-17T11:46:38.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 --2- 172.21.15.3:0/1373252735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80ca370 0x7fb7b80ca7f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 --2- 172.21.15.3:0/1373252735 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80cbe90 0x7fb7b80cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 -- 172.21.15.3:0/1373252735 >> 172.21.15.3:0/1373252735 conn(0x7fb7b806b4e0 msgr2=0x7fb7b80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:38.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 -- 172.21.15.3:0/1373252735 shutdown_connections 2023-05-17T11:46:38.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.582+0000 7fb7bf811640 1 -- 172.21.15.3:0/1373252735 wait complete. 2023-05-17T11:46:38.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 Processor -- start 2023-05-17T11:46:38.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 -- start start 2023-05-17T11:46:38.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80ca370 0x7fb7b8157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b80cbe90 0x7fb7b81511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 0x7fb7b8157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b81571b0 con 0x7fb7b80cd050 2023-05-17T11:46:38.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b81516e0 con 0x7fb7b80cbe90 2023-05-17T11:46:38.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b8158550 con 0x7fb7b80ca370 2023-05-17T11:46:38.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 0x7fb7b8157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 0x7fb7b8157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55356/0 (socket says 172.21.15.3:55356) 2023-05-17T11:46:38.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 -- 172.21.15.3:0/3284104354 learned_addr learned my addr 172.21.15.3:0/3284104354 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bcdac640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b80cbe90 0x7fb7b81511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bd5ad640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80ca370 0x7fb7b8157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 -- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80ca370 msgr2=0x7fb7b8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80ca370 0x7fb7b8157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 -- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b80cbe90 msgr2=0x7fb7b81511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b80cbe90 0x7fb7b81511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 -- 172.21.15.3:0/3284104354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b0009a70 con 0x7fb7b80cd050 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bd5ad640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80ca370 0x7fb7b8157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bcdac640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b80cbe90 0x7fb7b81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bddae640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 0x7fb7b8157d00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00b2040 tx=0x7fb7b001b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00a7c00 con 0x7fb7b80cd050 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b00afbc0 con 0x7fb7b80cd050 2023-05-17T11:46:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b80cdc80 con 0x7fb7b80cd050 2023-05-17T11:46:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00b8440 con 0x7fb7b80cd050 2023-05-17T11:46:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.586+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b80cdaf0 con 0x7fb7b80cd050 2023-05-17T11:46:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.590+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b80aeb70 con 0x7fb7b80cd050 2023-05-17T11:46:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.590+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7b00b6070 con 0x7fb7b80cd050 2023-05-17T11:46:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.590+0000 7fb7adffb640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb79c066280 0x7fb79c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.590+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb7b011e860 con 0x7fb7b80cd050 2023-05-17T11:46:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.590+0000 7fb7bd5ad640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb79c066280 0x7fb79c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.590+0000 7fb7bd5ad640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb79c066280 0x7fb79c068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb7b809d3c0 tx=0x7fb7b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.594+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb7b00ebf90 con 0x7fb7b80cd050 2023-05-17T11:46:38.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.746+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7b804de80 con 0x7fb7b80cd050 2023-05-17T11:46:38.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.746+0000 7fb7adffb640 1 -- 172.21.15.3:0/3284104354 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7b00ef5b0 con 0x7fb7b80cd050 2023-05-17T11:46:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-05-17T11:46:38.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb79c066280 msgr2=0x7fb79c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb79c066280 0x7fb79c068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb7b809d3c0 tx=0x7fb7b4008040 comp rx=0 tx=0).stop 2023-05-17T11:46:38.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 msgr2=0x7fb7b8157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 0x7fb7b8157d00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00b2040 tx=0x7fb7b001b8d0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 shutdown_connections 2023-05-17T11:46:38.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fb79c066280 0x7fb79c068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7b80cd050 0x7fb7b8157d00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b80cbe90 0x7fb7b81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 --2- 172.21.15.3:0/3284104354 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fb7b80ca370 0x7fb7b8157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 >> 172.21.15.3:0/3284104354 conn(0x7fb7b806b4e0 msgr2=0x7fb7b8155310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 shutdown_connections 2023-05-17T11:46:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.750+0000 7fb7bf811640 1 -- 172.21.15.3:0/3284104354 wait complete. 2023-05-17T11:46:38.778 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T11:46:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f20515a6640 1 Processor -- start 2023-05-17T11:46:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f20515a6640 1 -- start start 2023-05-17T11:46:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f20515a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f204c1605e0 0x7f204c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f20515a6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c0ce6d0 con 0x7f204c15f4a0 2023-05-17T11:46:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f20515a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c0cfc90 con 0x7f204c0b2750 2023-05-17T11:46:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f20515a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c0cff70 con 0x7f204c1605e0 2023-05-17T11:46:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f204affd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f204c15f4a0 0x7f204c0b2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57084/0 (socket says 172.21.15.3:57084) 2023-05-17T11:46:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f204affd640 1 -- 172.21.15.3:0/2710998137 learned_addr learned my addr 172.21.15.3:0/2710998137 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:38.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f204b7fe640 1 --2- 172.21.15.3:0/2710998137 >> v2:172.21.15.60:3300/0 conn(0x7f204c1605e0 0x7f204c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152304353 0 0) 0x7f203c001120 con 0x7f204c15f4a0 2023-05-17T11:46:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.906+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2038003530 con 0x7f204c15f4a0 2023-05-17T11:46:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823420135 0 0) 0x7f2038003530 con 0x7f204c15f4a0 2023-05-17T11:46:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 >> v2:172.21.15.60:3300/0 conn(0x7f204c1605e0 msgr2=0x7f204c0ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 --2- 172.21.15.3:0/2710998137 >> v2:172.21.15.60:3300/0 conn(0x7f204c1605e0 0x7f204c0ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 >> v1:172.21.15.60:6789/0 conn(0x7f204c0b2750 legacy=0x7f204c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0d0250 con 0x7f204c15f4a0 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f203c001810 con 0x7f204c15f4a0 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 >> v1:172.21.15.3:6789/0 conn(0x7f204c15f4a0 legacy=0x7f204c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20380039f0 0x7f2038003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f20380047d0 0x7f2038004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2038005180 0x7f203800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0cff70 con 0x7f2038005180 2023-05-17T11:46:38.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203800bfe0 con 0x7f20380039f0 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203800c1a0 con 0x7f20380047d0 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2038005180 0x7f203800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204affd640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20380039f0 0x7f2038003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f20427fc640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f20380047d0 0x7f2038004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 -- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f20380047d0 msgr2=0x7f2038004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f20380047d0 0x7f2038004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 -- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20380039f0 msgr2=0x7f2038003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:38.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20380039f0 0x7f2038003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 -- 172.21.15.3:0/2710998137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038003530 con 0x7f2038005180 2023-05-17T11:46:38.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 -- 172.21.15.3:0/2710998137 reap_dead start 2023-05-17T11:46:38.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.910+0000 7f204b7fe640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2038005180 0x7f203800b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2044009fc0 tx=0x7f204401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97dbb21bd1a83768 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044003ba0 con 0x7f2038005180 2023-05-17T11:46:38.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204400f040 con 0x7f2038005180 2023-05-17T11:46:38.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204a7fc640 1 -- 172.21.15.3:0/2710998137 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440a59a0 con 0x7f2038005180 2023-05-17T11:46:38.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- 172.21.15.3:0/2710998137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2038005180 msgr2=0x7f203800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2038005180 0x7f203800b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2044009fc0 tx=0x7f204401cca0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- 172.21.15.3:0/2710998137 shutdown_connections 2023-05-17T11:46:38.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 --2- 172.21.15.3:0/2710998137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2038005180 0x7f203800b990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- 172.21.15.3:0/2710998137 >> 172.21.15.3:0/2710998137 conn(0x7f204c06eac0 msgr2=0x7f204c0cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:38.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- 172.21.15.3:0/2710998137 shutdown_connections 2023-05-17T11:46:38.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- 172.21.15.3:0/2710998137 wait complete. 2023-05-17T11:46:38.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 Processor -- start 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- start start 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2038005180 0x7f204c156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f204c0c80a0 0x7f204c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 0x7f204c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c5c90 con 0x7f204c0b3930 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c157110 con 0x7f2038005180 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20515a6640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c7c40 con 0x7f204c0c80a0 2023-05-17T11:46:38.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 0x7f204c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 0x7f204c0cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55382/0 (socket says 172.21.15.3:55382) 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204b7fe640 1 -- 172.21.15.3:0/476669662 learned_addr learned my addr 172.21.15.3:0/476669662 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f204affd640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2038005180 0x7f204c156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.914+0000 7f20427fc640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f204c0c80a0 0x7f204c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f204b7fe640 1 -- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f204c0c80a0 msgr2=0x7f204c0b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f204b7fe640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f204c0c80a0 0x7f204c0b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f204b7fe640 1 -- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2038005180 msgr2=0x7f204c156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:38.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f204b7fe640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2038005180 0x7f204c156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:38.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f204b7fe640 1 -- 172.21.15.3:0/476669662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0cacb0 con 0x7f204c0b3930 2023-05-17T11:46:38.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f204b7fe640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 0x7f204c0cb3b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f204401c710 tx=0x7f2044009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440039a0 con 0x7f204c0b3930 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044003b00 con 0x7f204c0b3930 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c0caf90 con 0x7f204c0b3930 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044003e70 con 0x7f204c0b3930 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c1609e0 con 0x7f204c0b3930 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c0cfaf0 con 0x7f204c0b3930 2023-05-17T11:46:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2044004030 con 0x7f204c0b3930 2023-05-17T11:46:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f2043fff640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f202c0662b0 0x7f202c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.918+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f204411df80 con 0x7f204c0b3930 2023-05-17T11:46:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.922+0000 7f204affd640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f202c0662b0 0x7f202c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.922+0000 7f204affd640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f202c0662b0 0x7f202c068760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f203c001060 tx=0x7f203c001240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:38.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:38.922+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f204c0cfaf0 con 0x7f204c0b3930 2023-05-17T11:46:39.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f204c0c5dd0 con 0x7f204c0b3930 2023-05-17T11:46:39.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f2043fff640 1 -- 172.21.15.3:0/476669662 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7f204c0c5dd0 con 0x7f204c0b3930 2023-05-17T11:46:39.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:39.091 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-05-17T11:46:39.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 2, 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": "rbd" 2023-05-17T11:46:39.092 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:39.093 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-05-17T11:46:39.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f202c0662b0 msgr2=0x7f202c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f202c0662b0 0x7f202c068760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f203c001060 tx=0x7f203c001240 comp rx=0 tx=0).stop 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 msgr2=0x7f204c0cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 0x7f204c0cb3b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f204401c710 tx=0x7f2044009750 comp rx=0 tx=0).stop 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 shutdown_connections 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f202c0662b0 0x7f202c068760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f204c0b3930 0x7f204c0cb3b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f204c0c80a0 0x7f204c0b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 --2- 172.21.15.3:0/476669662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2038005180 0x7f204c156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 >> 172.21.15.3:0/476669662 conn(0x7f204c06eac0 msgr2=0x7f204c0d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:39.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 shutdown_connections 2023-05-17T11:46:39.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.082+0000 7f20515a6640 1 -- 172.21.15.3:0/476669662 wait complete. 2023-05-17T11:46:39.112 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T11:46:39.112 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-17T11:46:39.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.242+0000 7fa242fbc640 1 Processor -- start 2023-05-17T11:46:39.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.242+0000 7fa242fbc640 1 -- start start 2023-05-17T11:46:39.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa242fbc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa23c15d3d0 0x7fa23c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:39.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa242fbc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c0cd2c0 0x7fa23c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:39.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa242fbc640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c09bcb0 con 0x7fa23c0ad440 2023-05-17T11:46:39.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa242fbc640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c0cdf90 con 0x7fa23c15d3d0 2023-05-17T11:46:39.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa242fbc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0ca130 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa23c15d3d0 0x7fa23c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:39.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa23c15d3d0 0x7fa23c0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55388/0 (socket says 172.21.15.3:55388) 2023-05-17T11:46:39.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 -- 172.21.15.3:0/3237556900 learned_addr learned my addr 172.21.15.3:0/3237556900 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:39.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 -- 172.21.15.3:0/3237556900 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c0cd2c0 msgr2=0x7fa23c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:39.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 --2- 172.21.15.3:0/3237556900 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c0cd2c0 0x7fa23c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 -- 172.21.15.3:0/3237556900 >> v1:172.21.15.60:6789/0 conn(0x7fa23c0ad440 legacy=0x7fa23c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:39.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.246+0000 7fa240d58640 1 -- 172.21.15.3:0/3237556900 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c09bf00 con 0x7fa23c15d3d0 2023-05-17T11:46:39.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa240d58640 1 --2- 172.21.15.3:0/3237556900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c15d3d0 0x7fa23c0ccd80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b587acaee6b2672 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:39.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa23b7fe640 1 -- 172.21.15.3:0/3237556900 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300ab600 con 0x7fa23c15d3d0 2023-05-17T11:46:39.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa23b7fe640 1 -- 172.21.15.3:0/3237556900 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300a7050 con 0x7fa23c15d3d0 2023-05-17T11:46:39.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa23b7fe640 1 -- 172.21.15.3:0/3237556900 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300ab980 con 0x7fa23c15d3d0 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 -- 172.21.15.3:0/3237556900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c15d3d0 msgr2=0x7fa23c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 --2- 172.21.15.3:0/3237556900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c15d3d0 0x7fa23c0ccd80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23001c490 comp rx=0 tx=0).stop 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 -- 172.21.15.3:0/3237556900 shutdown_connections 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 --2- 172.21.15.3:0/3237556900 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c0cd2c0 0x7fa23c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 --2- 172.21.15.3:0/3237556900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c15d3d0 0x7fa23c0ccd80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 -- 172.21.15.3:0/3237556900 >> 172.21.15.3:0/3237556900 conn(0x7fa23c06a740 msgr2=0x7fa23c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:39.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 -- 172.21.15.3:0/3237556900 shutdown_connections 2023-05-17T11:46:39.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 -- 172.21.15.3:0/3237556900 wait complete. 2023-05-17T11:46:39.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 Processor -- start 2023-05-17T11:46:39.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.250+0000 7fa242fbc640 1 -- start start 2023-05-17T11:46:39.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa23c0ad440 0x7fa23c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:39.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 0x7fa23c0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c15d3d0 0x7fa23c0c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0ae390 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1f82e0 con 0x7fa23c0ad440 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0c3050 con 0x7fa23c15d3d0 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 0x7fa23c0c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 0x7fa23c0c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55398/0 (socket says 172.21.15.3:55398) 2023-05-17T11:46:39.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 -- 172.21.15.3:0/1131362428 learned_addr learned my addr 172.21.15.3:0/1131362428 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:39.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa240d58640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa23c0ad440 0x7fa23c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:39.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa241559640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c15d3d0 0x7fa23c0c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:39.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 -- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c15d3d0 msgr2=0x7fa23c0c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:39.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c15d3d0 0x7fa23c0c2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 -- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa23c0ad440 msgr2=0x7fa23c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:39.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa23c0ad440 0x7fa23c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:39.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 -- 172.21.15.3:0/1131362428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300094d0 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa241559640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c15d3d0 0x7fa23c0c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa23bfff640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 0x7fa23c0c24e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b450 tx=0x7fa22800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228011890 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa228011a10 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228011dc0 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c0b02f0 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c15d7a0 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0b0480 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.254+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa22801a400 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.258+0000 7fa2397fa640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa220066280 0x7fa220068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:39.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.258+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa228083de0 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.258+0000 7fa240d58640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa220066280 0x7fa220068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:39.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.258+0000 7fa240d58640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa220066280 0x7fa220068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0b3350 tx=0x7fa2300a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:39.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.262+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa228051510 con 0x7fa23c0cd2c0 2023-05-17T11:46:39.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:39.418+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa23c04de80 con 0x7fa23c0cd2c0 2023-05-17T11:46:40.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.342+0000 7fa2397fa640 1 -- 172.21.15.3:0/1131362428 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa2280150b0 con 0x7fa23c0cd2c0 2023-05-17T11:46:40.354 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-05-17T11:46:40.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa220066280 msgr2=0x7fa220068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:40.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa220066280 0x7fa220068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0b3350 tx=0x7fa2300a6000 comp rx=0 tx=0).stop 2023-05-17T11:46:40.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 msgr2=0x7fa23c0c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:40.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 0x7fa23c0c24e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b450 tx=0x7fa22800b910 comp rx=0 tx=0).stop 2023-05-17T11:46:40.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 shutdown_connections 2023-05-17T11:46:40.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7fa220066280 0x7fa220068730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7fa23c15d3d0 0x7fa23c0c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa23c0cd2c0 0x7fa23c0c24e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 --2- 172.21.15.3:0/1131362428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa23c0ad440 0x7fa23c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 >> 172.21.15.3:0/1131362428 conn(0x7fa23c06a740 msgr2=0x7fa23c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:40.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 shutdown_connections 2023-05-17T11:46:40.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.350+0000 7fa242fbc640 1 -- 172.21.15.3:0/1131362428 wait complete. 2023-05-17T11:46:40.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T11:46:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.522+0000 7f16c5fbc640 1 Processor -- start 2023-05-17T11:46:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.522+0000 7f16c5fbc640 1 -- start start 2023-05-17T11:46:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16c5fbc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f16c00b2950 0x7f16c009bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16c5fbc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00ad760 0x7f16c00cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16c5fbc640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c006d020 con 0x7f16c00cddf0 2023-05-17T11:46:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16c5fbc640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00b2d20 con 0x7f16c00b2950 2023-05-17T11:46:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16c5fbc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01591b0 con 0x7f16c00ad760 2023-05-17T11:46:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f16c00b2950 0x7f16c009bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f16c00b2950 0x7f16c009bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55402/0 (socket says 172.21.15.3:55402) 2023-05-17T11:46:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 -- 172.21.15.3:0/1263760045 learned_addr learned my addr 172.21.15.3:0/1263760045 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 -- 172.21.15.3:0/1263760045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00ad760 msgr2=0x7f16c00cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:40.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16beffd640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00ad760 0x7f16c00cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00ad760 0x7f16c00cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 -- 172.21.15.3:0/1263760045 >> v1:172.21.15.60:6789/0 conn(0x7f16c00cddf0 legacy=0x7f16c00c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16bf7fe640 1 -- 172.21.15.3:0/1263760045 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00adb90 con 0x7f16c00b2950 2023-05-17T11:46:40.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.526+0000 7f16beffd640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00ad760 0x7f16c00cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16bf7fe640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00b2950 0x7f16c009bd90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009870 tx=0x7f16b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13c825ef237b393 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:40.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16be7fc640 1 -- 172.21.15.3:0/1263760045 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00ac410 con 0x7f16c00b2950 2023-05-17T11:46:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16be7fc640 1 -- 172.21.15.3:0/1263760045 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b00ac570 con 0x7f16c00b2950 2023-05-17T11:46:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16be7fc640 1 -- 172.21.15.3:0/1263760045 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00ac900 con 0x7f16c00b2950 2023-05-17T11:46:40.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 -- 172.21.15.3:0/1263760045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00b2950 msgr2=0x7f16c009bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00b2950 0x7f16c009bd90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009870 tx=0x7f16b001c4d0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 -- 172.21.15.3:0/1263760045 shutdown_connections 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00ad760 0x7f16c00cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/1263760045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00b2950 0x7f16c009bd90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 -- 172.21.15.3:0/1263760045 >> 172.21.15.3:0/1263760045 conn(0x7f16c006a740 msgr2=0x7f16c00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 -- 172.21.15.3:0/1263760045 shutdown_connections 2023-05-17T11:46:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 -- 172.21.15.3:0/1263760045 wait complete. 2023-05-17T11:46:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 Processor -- start 2023-05-17T11:46:40.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.530+0000 7f16c5fbc640 1 -- start start 2023-05-17T11:46:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 0x7f16c0151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00b2950 0x7f16c0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00cddf0 0x7f16c0159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:40.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015c420 con 0x7f16c00ad760 2023-05-17T11:46:40.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015bf90 con 0x7f16c00cddf0 2023-05-17T11:46:40.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00c1e60 con 0x7f16c00b2950 2023-05-17T11:46:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 0x7f16c0151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16beffd640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00b2950 0x7f16c0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00cddf0 0x7f16c0159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 0x7f16c0151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55412/0 (socket says 172.21.15.3:55412) 2023-05-17T11:46:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 -- 172.21.15.3:0/3152049307 learned_addr learned my addr 172.21.15.3:0/3152049307 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 -- 172.21.15.3:0/3152049307 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00b2950 msgr2=0x7f16c0150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00b2950 0x7f16c0150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 -- 172.21.15.3:0/3152049307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00cddf0 msgr2=0x7f16c0159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00cddf0 0x7f16c0159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 -- 172.21.15.3:0/3152049307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00094d0 con 0x7f16c00ad760 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16bf7fe640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 0x7f16c0151420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f16b001ab80 tx=0x7f16b0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00ac410 con 0x7f16c00ad760 2023-05-17T11:46:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b00b65f0 con 0x7f16c00ad760 2023-05-17T11:46:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00b69a0 con 0x7f16c00ad760 2023-05-17T11:46:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c00cc380 con 0x7f16c00ad760 2023-05-17T11:46:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c006d4b0 con 0x7f16c00ad760 2023-05-17T11:46:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.534+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c00cb8d0 con 0x7f16c00ad760 2023-05-17T11:46:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.538+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16b00b6b00 con 0x7f16c00ad760 2023-05-17T11:46:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.538+0000 7f16a7fff640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16ac066280 0x7f16ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.538+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f16b011eeb0 con 0x7f16c00ad760 2023-05-17T11:46:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.538+0000 7f16beffd640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16ac066280 0x7f16ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.538+0000 7f16beffd640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16ac066280 0x7f16ac068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f16c0159a10 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.542+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f16b00ec630 con 0x7f16c00ad760 2023-05-17T11:46:40.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:40.694+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f16c015bd60 con 0x7f16c00ad760 2023-05-17T11:46:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.354+0000 7f16a7fff640 1 -- 172.21.15.3:0/3152049307 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f16c015bd60 con 0x7f16c00ad760 2023-05-17T11:46:41.364 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-05-17T11:46:41.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16ac066280 msgr2=0x7f16ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16ac066280 0x7f16ac068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f16c0159a10 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 msgr2=0x7f16c0151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 0x7f16c0151420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f16b001ab80 tx=0x7f16b0019270 comp rx=0 tx=0).stop 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 shutdown_connections 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f16ac066280 0x7f16ac068730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00cddf0 0x7f16c0159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f16c00b2950 0x7f16c0150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 --2- 172.21.15.3:0/3152049307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16c00ad760 0x7f16c0151420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 >> 172.21.15.3:0/3152049307 conn(0x7f16c006a740 msgr2=0x7f16c00abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.358+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 shutdown_connections 2023-05-17T11:46:41.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.362+0000 7f16c5fbc640 1 -- 172.21.15.3:0/3152049307 wait complete. 2023-05-17T11:46:41.404 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T11:46:41.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 Processor -- start 2023-05-17T11:46:41.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- start start 2023-05-17T11:46:41.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50d40b19f0 0x7f50d40d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d406abb0 con 0x7f50d40ceac0 2023-05-17T11:46:41.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40cfdc0 con 0x7f50d40b1dc0 2023-05-17T11:46:41.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d40cdbd0 con 0x7f50d40b19f0 2023-05-17T11:46:41.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f50d40ceac0 0x7f50d40cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57090/0 (socket says 172.21.15.3:57090) 2023-05-17T11:46:41.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 -- 172.21.15.3:0/1764590045 learned_addr learned my addr 172.21.15.3:0/1764590045 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:41.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057819742 0 0) 0x7f50d406abb0 con 0x7f50d40ceac0 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d3fff640 1 --2- 172.21.15.3:0/1764590045 >> v2:172.21.15.60:3300/0 conn(0x7f50d40b19f0 0x7f50d40d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50bc003530 con 0x7f50d40ceac0 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518109544 0 0) 0x7f50bc003530 con 0x7f50d40ceac0 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 >> v2:172.21.15.60:3300/0 conn(0x7f50d40b19f0 msgr2=0x7f50d40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 --2- 172.21.15.3:0/1764590045 >> v2:172.21.15.60:3300/0 conn(0x7f50d40b19f0 0x7f50d40d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 >> v1:172.21.15.60:6789/0 conn(0x7f50d40b1dc0 legacy=0x7f50d40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40cdeb0 con 0x7f50d40ceac0 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f50c8001680 con 0x7f50d40ceac0 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 >> v1:172.21.15.3:6789/0 conn(0x7f50d40ceac0 legacy=0x7f50d40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc003980 0x7f50bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0052a0 0x7f50bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40cdbd0 con 0x7f50bc0047d0 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc00c1d0 con 0x7f50bc0052a0 2023-05-17T11:46:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc00c390 con 0x7f50bc003980 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d3fff640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc003980 0x7f50bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d8fa1640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0052a0 0x7f50bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 -- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc003980 msgr2=0x7f50bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc003980 0x7f50bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 -- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0052a0 msgr2=0x7f50bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0052a0 0x7f50bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 -- 172.21.15.3:0/1764590045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc003530 con 0x7f50bc0047d0 2023-05-17T11:46:41.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d8fa1640 1 -- 172.21.15.3:0/1764590045 reap_dead start 2023-05-17T11:46:41.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d37fe640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c210 tx=0x7f50c801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd3a52102b1c62 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8005ae0 con 0x7f50bc0047d0 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8005c40 con 0x7f50bc0047d0 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d2ffd640 1 -- 172.21.15.3:0/1764590045 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80a59f0 con 0x7f50bc0047d0 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- 172.21.15.3:0/1764590045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50bc0047d0 msgr2=0x7f50bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c210 tx=0x7f50c801cbf0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- 172.21.15.3:0/1764590045 shutdown_connections 2023-05-17T11:46:41.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 --2- 172.21.15.3:0/1764590045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- 172.21.15.3:0/1764590045 >> 172.21.15.3:0/1764590045 conn(0x7f50d409bb20 msgr2=0x7f50d40d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- 172.21.15.3:0/1764590045 shutdown_connections 2023-05-17T11:46:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.542+0000 7f50d97a2640 1 -- 172.21.15.3:0/1764590045 wait complete. 2023-05-17T11:46:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 Processor -- start 2023-05-17T11:46:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 -- start start 2023-05-17T11:46:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc0047d0 0x7f50d40b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 0x7f50d41e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d415a560 0x7f50d415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41f4f90 con 0x7f50d415bb50 2023-05-17T11:46:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40ca8f0 con 0x7f50d415a560 2023-05-17T11:46:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d415aef0 con 0x7f50bc0047d0 2023-05-17T11:46:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 0x7f50d41e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 0x7f50d41e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55440/0 (socket says 172.21.15.3:55440) 2023-05-17T11:46:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 -- 172.21.15.3:0/4162510418 learned_addr learned my addr 172.21.15.3:0/4162510418 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d3fff640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc0047d0 0x7f50d40b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d8fa1640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d415a560 0x7f50d415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 -- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc0047d0 msgr2=0x7f50d40b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc0047d0 0x7f50d40b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 -- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d415a560 msgr2=0x7f50d415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d415a560 0x7f50d415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 -- 172.21.15.3:0/4162510418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40cefa0 con 0x7f50d415bb50 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d37fe640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 0x7f50d41e9460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f50c801ca20 tx=0x7f50bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80b4070 con 0x7f50d415bb50 2023-05-17T11:46:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8005db0 con 0x7f50d415bb50 2023-05-17T11:46:41.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d40cd830 con 0x7f50d415bb50 2023-05-17T11:46:41.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8001660 con 0x7f50d415bb50 2023-05-17T11:46:41.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.546+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d40cf130 con 0x7f50d415bb50 2023-05-17T11:46:41.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.550+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d40616e0 con 0x7f50d415bb50 2023-05-17T11:46:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.550+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50c80a57b0 con 0x7f50d415bb50 2023-05-17T11:46:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.550+0000 7f50d0ff9640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f50c0066280 0x7f50c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.550+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f50c811dbf0 con 0x7f50d415bb50 2023-05-17T11:46:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.550+0000 7f50d3fff640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f50c0066280 0x7f50c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.550+0000 7f50d3fff640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f50c0066280 0x7f50c0068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f50d40727c0 tx=0x7f50c4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.554+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f50c80eb1d0 con 0x7f50d415bb50 2023-05-17T11:46:41.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.738+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f50d40664e0 con 0x7f50d415bb50 2023-05-17T11:46:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.754+0000 7f50d0ff9640 1 -- 172.21.15.3:0/4162510418 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f50c80ee7f0 con 0x7f50d415bb50 2023-05-17T11:46:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 5 and data pool 6 2023-05-17T11:46:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.758+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f50c0066280 msgr2=0x7f50c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.758+0000 7f50d97a2640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f50c0066280 0x7f50c0068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f50d40727c0 tx=0x7f50c4009190 comp rx=0 tx=0).stop 2023-05-17T11:46:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.758+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 msgr2=0x7f50d41e9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.758+0000 7f50d97a2640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 0x7f50d41e9460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f50c801ca20 tx=0x7f50bc005800 comp rx=0 tx=0).stop 2023-05-17T11:46:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 shutdown_connections 2023-05-17T11:46:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f50c0066280 0x7f50c0068730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d415a560 0x7f50d415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50d415bb50 0x7f50d41e9460 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 --2- 172.21.15.3:0/4162510418 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f50bc0047d0 0x7f50d40b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 >> 172.21.15.3:0/4162510418 conn(0x7f50d409bb20 msgr2=0x7f50d40b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.762+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 shutdown_connections 2023-05-17T11:46:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.766+0000 7f50d97a2640 1 -- 172.21.15.3:0/4162510418 wait complete. 2023-05-17T11:46:41.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:41.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.930+0000 7f90f2212640 1 Processor -- start 2023-05-17T11:46:41.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f2212640 1 -- start start 2023-05-17T11:46:41.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f2212640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90ec0b2550 0x7f90ec06c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f2212640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 0x7f90ec06c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f2212640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec15fd60 con 0x7f90ec15c100 2023-05-17T11:46:41.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f2212640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec1609e0 con 0x7f90ec0b2550 2023-05-17T11:46:41.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f2212640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15fb50 con 0x7f90ec0ca980 2023-05-17T11:46:41.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f1210640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f90ec15c100 0x7f90ec0b1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57100/0 (socket says 172.21.15.3:57100) 2023-05-17T11:46:41.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f1210640 1 -- 172.21.15.3:0/1030249851 learned_addr learned my addr 172.21.15.3:0/1030249851 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:41.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127748939 0 0) 0x7f90ec15fd60 con 0x7f90ec15c100 2023-05-17T11:46:41.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d8003530 con 0x7f90ec15c100 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f1a11640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 0x7f90ec06c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/1030249851 >> v2:172.21.15.60:3300/0 conn(0x7f90ec0b2550 0x7f90ec06c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1987063118 0 0) 0x7f90d8003530 con 0x7f90ec15c100 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 msgr2=0x7f90ec06c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 0x7f90ec06c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 >> v2:172.21.15.60:3300/0 conn(0x7f90ec0b2550 msgr2=0x7f90ec06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 --2- 172.21.15.3:0/1030249851 >> v2:172.21.15.60:3300/0 conn(0x7f90ec0b2550 0x7f90ec06c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec160040 con 0x7f90ec15c100 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f90e8001680 con 0x7f90ec15c100 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 >> v1:172.21.15.3:6789/0 conn(0x7f90ec15c100 legacy=0x7f90ec0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 0x7f90d80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90d8003f70 0x7f90d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d8004d10 0x7f90d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec1609e0 con 0x7f90d8003f70 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15fb50 con 0x7f90d8004d10 2023-05-17T11:46:41.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d800ba10 con 0x7f90ec0ca980 2023-05-17T11:46:41.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90d8003f70 0x7f90d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f1210640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 0x7f90d80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f1a11640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d8004d10 0x7f90d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 -- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 msgr2=0x7f90d80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90ec0ca980 0x7f90d80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 -- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d8004d10 msgr2=0x7f90d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:41.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d8004d10 0x7f90d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.934+0000 7f90f0a0f640 1 -- 172.21.15.3:0/1030249851 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8003530 con 0x7f90d8003f70 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90d8003f70 0x7f90d80047d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009ab0 tx=0x7f90dc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69fa00c190dc3b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a5660 con 0x7f90d8003f70 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0a57c0 con 0x7f90d8003f70 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90e3fff640 1 -- 172.21.15.3:0/1030249851 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a5b70 con 0x7f90d8003f70 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f2212640 1 -- 172.21.15.3:0/1030249851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90d8003f70 msgr2=0x7f90d80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f2212640 1 --2- 172.21.15.3:0/1030249851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90d8003f70 0x7f90d80047d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009ab0 tx=0x7f90dc01ca70 comp rx=0 tx=0).stop 2023-05-17T11:46:41.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f1a11640 1 -- 172.21.15.3:0/1030249851 reap_dead start 2023-05-17T11:46:41.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f2212640 1 -- 172.21.15.3:0/1030249851 shutdown_connections 2023-05-17T11:46:41.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f2212640 1 -- 172.21.15.3:0/1030249851 >> 172.21.15.3:0/1030249851 conn(0x7f90ec0d03c0 msgr2=0x7f90ec0d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:41.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f2212640 1 -- 172.21.15.3:0/1030249851 shutdown_connections 2023-05-17T11:46:41.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.938+0000 7f90f2212640 1 -- 172.21.15.3:0/1030249851 wait complete. 2023-05-17T11:46:41.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 Processor -- start 2023-05-17T11:46:41.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 -- start start 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90d8003f70 0x7f90ec0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 0x7f90ec156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ec1f0e00 0x7f90ec1f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b40b0 con 0x7f90ec159010 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c7400 con 0x7f90ec1f0e00 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b3af0 con 0x7f90d8003f70 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 0x7f90ec156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 0x7f90ec156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55454/0 (socket says 172.21.15.3:55454) 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 -- 172.21.15.3:0/59625891 learned_addr learned my addr 172.21.15.3:0/59625891 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f1210640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90d8003f70 0x7f90ec0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f1a11640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ec1f0e00 0x7f90ec1f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 -- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90d8003f70 msgr2=0x7f90ec0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90d8003f70 0x7f90ec0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 -- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ec1f0e00 msgr2=0x7f90ec1f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:41.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ec1f0e00 0x7f90ec1f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:41.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 -- 172.21.15.3:0/59625891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec160600 con 0x7f90ec159010 2023-05-17T11:46:41.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f0a0f640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 0x7f90ec156c00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009a00 tx=0x7f90d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004220 con 0x7f90ec159010 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0043a0 con 0x7f90ec159010 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004510 con 0x7f90ec159010 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec160320 con 0x7f90ec159010 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.942+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec06c750 con 0x7f90ec159010 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.946+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec067130 con 0x7f90ec159010 2023-05-17T11:46:41.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.946+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90dc0b4040 con 0x7f90ec159010 2023-05-17T11:46:41.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.946+0000 7f90e1ffb640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f90d00662b0 0x7f90d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:41.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.946+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90dc11d8d0 con 0x7f90ec159010 2023-05-17T11:46:41.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.946+0000 7f90f1210640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f90d00662b0 0x7f90d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:41.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.946+0000 7f90f1210640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f90d00662b0 0x7f90d0068760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90ec159650 tx=0x7f90e8007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:41.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:41.950+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f90dc0ead60 con 0x7f90ec159010 2023-05-17T11:46:42.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.106+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90ec0b6340 con 0x7f90ec159010 2023-05-17T11:46:42.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.106+0000 7f90e1ffb640 1 -- 172.21.15.3:0/59625891 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f90dc0ee380 con 0x7f90ec159010 2023-05-17T11:46:42.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:42.117 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":36,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:41.746413+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:46:39.465215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T11:46:40.743260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:42.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f90d00662b0 msgr2=0x7f90d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f90d00662b0 0x7f90d0068760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90ec159650 tx=0x7f90e8007040 comp rx=0 tx=0).stop 2023-05-17T11:46:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 msgr2=0x7f90ec156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 0x7f90ec156c00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009a00 tx=0x7f90d8005800 comp rx=0 tx=0).stop 2023-05-17T11:46:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 shutdown_connections 2023-05-17T11:46:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f90d00662b0 0x7f90d0068760 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ec1f0e00 0x7f90ec1f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90ec159010 0x7f90ec156c00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 --2- 172.21.15.3:0/59625891 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f90d8003f70 0x7f90ec0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 >> 172.21.15.3:0/59625891 conn(0x7f90ec0d03c0 msgr2=0x7f90ec0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 shutdown_connections 2023-05-17T11:46:42.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.110+0000 7f90f2212640 1 -- 172.21.15.3:0/59625891 wait complete. 2023-05-17T11:46:42.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.266+0000 7f19e8998640 1 Processor -- start 2023-05-17T11:46:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.266+0000 7f19e8998640 1 -- start start 2023-05-17T11:46:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 0x7f19e4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e40c92f0 con 0x7f19e4071c10 2023-05-17T11:46:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e4071480 con 0x7f19e406bc30 2023-05-17T11:46:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e40c8a00 con 0x7f19e4158f10 2023-05-17T11:46:42.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f19e4071c10 0x7f19e40cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57106/0 (socket says 172.21.15.3:57106) 2023-05-17T11:46:42.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 -- 172.21.15.3:0/1844676350 learned_addr learned my addr 172.21.15.3:0/1844676350 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462479547 0 0) 0x7f19e40c92f0 con 0x7f19e4071c10 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19cc005740 con 0x7f19e4071c10 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e259c640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 0x7f19e4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731513158 0 0) 0x7f19cc005740 con 0x7f19e4071c10 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 msgr2=0x7f19e4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 0x7f19e4070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 >> v1:172.21.15.60:6789/0 conn(0x7f19e406bc30 legacy=0x7f19e40c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e40716e0 con 0x7f19e4071c10 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f19d8001680 con 0x7f19e4071c10 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 >> v1:172.21.15.3:6789/0 conn(0x7f19e4071c10 legacy=0x7f19e40cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19cc005c30 0x7f19cc006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19cc0069e0 0x7f19cc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 0x7f19cc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e40c8a00 con 0x7f19cc0069e0 2023-05-17T11:46:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc00dc80 con 0x7f19cc005c30 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc00de40 con 0x7f19e4158f10 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19cc0069e0 0x7f19cc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e259c640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19cc005c30 0x7f19cc006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e2d9d640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 0x7f19cc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 -- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 msgr2=0x7f19cc007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19e4158f10 0x7f19cc007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 -- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19cc005c30 msgr2=0x7f19cc006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19cc005c30 0x7f19cc006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 -- 172.21.15.3:0/1844676350 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc005740 con 0x7f19cc0069e0 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e1d9b640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19cc0069e0 0x7f19cc006e50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c240 tx=0x7f19d801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e727072b49f6d2ab server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8005ae0 con 0x7f19cc0069e0 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d80ab070 con 0x7f19cc0069e0 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e159a640 1 -- 172.21.15.3:0/1844676350 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8007070 con 0x7f19cc0069e0 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- 172.21.15.3:0/1844676350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19cc0069e0 msgr2=0x7f19cc006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 --2- 172.21.15.3:0/1844676350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19cc0069e0 0x7f19cc006e50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c240 tx=0x7f19d801f3b0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e2d9d640 1 -- 172.21.15.3:0/1844676350 reap_dead start 2023-05-17T11:46:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- 172.21.15.3:0/1844676350 shutdown_connections 2023-05-17T11:46:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- 172.21.15.3:0/1844676350 >> 172.21.15.3:0/1844676350 conn(0x7f19e40b0b30 msgr2=0x7f19e40cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- 172.21.15.3:0/1844676350 shutdown_connections 2023-05-17T11:46:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 -- 172.21.15.3:0/1844676350 wait complete. 2023-05-17T11:46:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.270+0000 7f19e8998640 1 Processor -- start 2023-05-17T11:46:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- start start 2023-05-17T11:46:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19cc0069e0 0x7f19e40c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19e40c7ec0 0x7f19e4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 0x7f19e40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e40c68e0 con 0x7f19e41558b0 2023-05-17T11:46:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e40c6bc0 con 0x7f19e40c7ec0 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e40c6ea0 con 0x7f19cc0069e0 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 0x7f19e40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 0x7f19e40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55468/0 (socket says 172.21.15.3:55468) 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 -- 172.21.15.3:0/544764960 learned_addr learned my addr 172.21.15.3:0/544764960 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e1d9b640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19e40c7ec0 0x7f19e4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e259c640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19cc0069e0 0x7f19e40c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 -- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19cc0069e0 msgr2=0x7f19e40c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19cc0069e0 0x7f19e40c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 -- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19e40c7ec0 msgr2=0x7f19e4155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19e40c7ec0 0x7f19e4155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 -- 172.21.15.3:0/544764960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e40c8f80 con 0x7f19e41558b0 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e259c640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19cc0069e0 0x7f19e40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e1d9b640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19e40c7ec0 0x7f19e4155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e2d9d640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 0x7f19e40c5bb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f19e406e090 tx=0x7f19dc00f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:42.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00fec0 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc006b60 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e40c8ca0 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc003980 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e40cc690 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.278+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e404de80 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.282+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19dc003ae0 con 0x7f19e41558b0 2023-05-17T11:46:42.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.282+0000 7f19d2ffd640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19c4066280 0x7f19c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.282+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19dc082e10 con 0x7f19e41558b0 2023-05-17T11:46:42.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.282+0000 7f19e259c640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19c4066280 0x7f19c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.282+0000 7f19e259c640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19c4066280 0x7f19c4068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19e40cdb50 tx=0x7f19d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:42.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.282+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f19dc086030 con 0x7f19e41558b0 2023-05-17T11:46:42.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.438+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19e40b4330 con 0x7f19e41558b0 2023-05-17T11:46:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.438+0000 7f19d2ffd640 1 -- 172.21.15.3:0/544764960 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f19dc01a090 con 0x7f19e41558b0 2023-05-17T11:46:42.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:42.452 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":36,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:41.746413+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:46:39.465215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T11:46:40.743260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19c4066280 msgr2=0x7f19c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19c4066280 0x7f19c4068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19e40cdb50 tx=0x7f19d4008040 comp rx=0 tx=0).stop 2023-05-17T11:46:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 msgr2=0x7f19e40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 0x7f19e40c5bb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f19e406e090 tx=0x7f19dc00f900 comp rx=0 tx=0).stop 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 shutdown_connections 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19c4066280 0x7f19c4068730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e41558b0 0x7f19e40c5bb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19e40c7ec0 0x7f19e4155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 --2- 172.21.15.3:0/544764960 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19cc0069e0 0x7f19e40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 >> 172.21.15.3:0/544764960 conn(0x7f19e40b0b30 msgr2=0x7f19e40ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 shutdown_connections 2023-05-17T11:46:42.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.442+0000 7f19e8998640 1 -- 172.21.15.3:0/544764960 wait complete. 2023-05-17T11:46:42.469 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T11:46:42.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 Processor -- start 2023-05-17T11:46:42.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 -- start start 2023-05-17T11:46:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f515c06d940 0x7f515c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c15c760 con 0x7f515c0cec30 2023-05-17T11:46:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c0cdf60 con 0x7f515c06d940 2023-05-17T11:46:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f51630c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0ccd40 con 0x7f515c0cf090 2023-05-17T11:46:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f515c06d940 0x7f515c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f515c06d940 0x7f515c06dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55484/0 (socket says 172.21.15.3:55484) 2023-05-17T11:46:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 -- 172.21.15.3:0/2927697103 learned_addr learned my addr 172.21.15.3:0/2927697103 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5161660640 1 --2- 172.21.15.3:0/2927697103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 -- 172.21.15.3:0/2927697103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 msgr2=0x7f515c0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 --2- 172.21.15.3:0/2927697103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 -- 172.21.15.3:0/2927697103 >> v1:172.21.15.60:6789/0 conn(0x7f515c0cec30 legacy=0x7f515c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:42.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.602+0000 7f5160e5f640 1 -- 172.21.15.3:0/2927697103 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c06e250 con 0x7f515c06d940 2023-05-17T11:46:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f5160e5f640 1 --2- 172.21.15.3:0/2927697103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c06dd10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5150009870 tx=0x7f515001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9e2d98ed11eafd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f515b7fe640 1 -- 172.21.15.3:0/2927697103 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500aa5f0 con 0x7f515c06d940 2023-05-17T11:46:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f515b7fe640 1 -- 172.21.15.3:0/2927697103 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500aa750 con 0x7f515c06d940 2023-05-17T11:46:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f515b7fe640 1 -- 172.21.15.3:0/2927697103 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500aaae0 con 0x7f515c06d940 2023-05-17T11:46:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 -- 172.21.15.3:0/2927697103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 msgr2=0x7f515c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 --2- 172.21.15.3:0/2927697103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c06dd10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5150009870 tx=0x7f515001c4d0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 -- 172.21.15.3:0/2927697103 shutdown_connections 2023-05-17T11:46:42.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 --2- 172.21.15.3:0/2927697103 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 --2- 172.21.15.3:0/2927697103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c06dd10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 -- 172.21.15.3:0/2927697103 >> 172.21.15.3:0/2927697103 conn(0x7f515c06b4e0 msgr2=0x7f515c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:42.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 -- 172.21.15.3:0/2927697103 shutdown_connections 2023-05-17T11:46:42.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 -- 172.21.15.3:0/2927697103 wait complete. 2023-05-17T11:46:42.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 Processor -- start 2023-05-17T11:46:42.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.610+0000 7f51630c3640 1 -- start start 2023-05-17T11:46:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515c0cec30 0x7f515c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c06c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0c52d0 con 0x7f515c06d940 2023-05-17T11:46:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0c4ff0 con 0x7f515c0cec30 2023-05-17T11:46:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c156ed0 con 0x7f515c0cf090 2023-05-17T11:46:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c0c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55494/0 (socket says 172.21.15.3:55494) 2023-05-17T11:46:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 -- 172.21.15.3:0/3151862927 learned_addr learned my addr 172.21.15.3:0/3151862927 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f515bfff640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515c0cec30 0x7f515c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5161660640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c06c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 -- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 msgr2=0x7f515c06c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c06c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 -- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515c0cec30 msgr2=0x7f515c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515c0cec30 0x7f515c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 -- 172.21.15.3:0/3151862927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500094d0 con 0x7f515c06d940 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f5160e5f640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c0c5b40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f51500ac040 tx=0x7f515001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500aa5f0 con 0x7f515c06d940 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500b3800 con 0x7f515c06d940 2023-05-17T11:46:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500b3bb0 con 0x7f515c06d940 2023-05-17T11:46:42.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c0ce710 con 0x7f515c06d940 2023-05-17T11:46:42.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c0ce430 con 0x7f515c06d940 2023-05-17T11:46:42.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c0ca420 con 0x7f515c06d940 2023-05-17T11:46:42.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51500b3d10 con 0x7f515c06d940 2023-05-17T11:46:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51597fa640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f51400662b0 0x7f5140068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51500a7070 con 0x7f515c06d940 2023-05-17T11:46:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f515bfff640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f51400662b0 0x7f5140068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.614+0000 7f515bfff640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f51400662b0 0x7f5140068760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f515c0c9780 tx=0x7f5148007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.622+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f51500eb740 con 0x7f515c06d940 2023-05-17T11:46:42.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:42.806+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f515c04de80 con 0x7f515c06d940 2023-05-17T11:46:43.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.758+0000 7f51597fa640 1 -- 172.21.15.3:0/3151862927 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f51500eed60 con 0x7f515c06d940 2023-05-17T11:46:43.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f51400662b0 msgr2=0x7f5140068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:43.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f51400662b0 0x7f5140068760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f515c0c9780 tx=0x7f5148007e40 comp rx=0 tx=0).stop 2023-05-17T11:46:43.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 msgr2=0x7f515c0c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:43.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c0c5b40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f51500ac040 tx=0x7f515001ad10 comp rx=0 tx=0).stop 2023-05-17T11:46:43.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 shutdown_connections 2023-05-17T11:46:43.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f51400662b0 0x7f5140068760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f515c0cf090 0x7f515c06c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515c0cec30 0x7f515c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 --2- 172.21.15.3:0/3151862927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f515c06d940 0x7f515c0c5b40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 >> 172.21.15.3:0/3151862927 conn(0x7f515c06b4e0 msgr2=0x7f515c0adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:43.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 shutdown_connections 2023-05-17T11:46:43.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.762+0000 7f51630c3640 1 -- 172.21.15.3:0/3151862927 wait complete. 2023-05-17T11:46:43.789 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-17T11:46:43.790 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T11:46:43.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 Processor -- start 2023-05-17T11:46:43.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 -- start start 2023-05-17T11:46:43.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f864409bd90 0x7f86440ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 0x7f864406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864406d020 con 0x7f86440b2950 2023-05-17T11:46:43.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86440b2d20 con 0x7f864409bd90 2023-05-17T11:46:43.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864b4f2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441591b0 con 0x7f864406b4d0 2023-05-17T11:46:43.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864928e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f86440b2950 0x7f86440cd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57108/0 (socket says 172.21.15.3:57108) 2023-05-17T11:46:43.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864928e640 1 -- 172.21.15.3:0/2247446532 learned_addr learned my addr 172.21.15.3:0/2247446532 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:43.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 0x7f864406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8648a8d640 1 --2- 172.21.15.3:0/2247446532 >> v2:172.21.15.60:3300/0 conn(0x7f864409bd90 0x7f86440ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082384956 0 0) 0x7f864406d020 con 0x7f86440b2950 2023-05-17T11:46:43.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8630003530 con 0x7f86440b2950 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752980801 0 0) 0x7f8630003530 con 0x7f86440b2950 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 msgr2=0x7f864406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 0x7f864406b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 >> v2:172.21.15.60:3300/0 conn(0x7f864409bd90 msgr2=0x7f86440ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 --2- 172.21.15.3:0/2247446532 >> v2:172.21.15.60:3300/0 conn(0x7f864409bd90 0x7f86440ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440cc0a0 con 0x7f86440b2950 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f8640001680 con 0x7f86440b2950 2023-05-17T11:46:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 >> v1:172.21.15.3:6789/0 conn(0x7f86440b2950 legacy=0x7f86440cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 0x7f8630003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8630003f00 0x7f86300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8630004d10 0x7f8630005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440b2d20 con 0x7f8630004d10 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441591b0 con 0x7f8630003f00 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863000fda0 con 0x7f864406b4d0 2023-05-17T11:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8630004d10 0x7f8630005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f864928e640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 0x7f8630003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8648a8d640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8630003f00 0x7f86300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 -- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 msgr2=0x7f8630003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f864406b4d0 0x7f8630003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 -- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8630003f00 msgr2=0x7f86300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8630003f00 0x7f86300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.930+0000 7f8649a8f640 1 -- 172.21.15.3:0/2247446532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630003530 con 0x7f8630004d10 2023-05-17T11:46:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f8649a8f640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8630004d10 0x7f8630005180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f863c009fc0 tx=0x7f863c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed873315d83ccc24 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0a5c70 con 0x7f8630004d10 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00f040 con 0x7f8630004d10 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f863bfff640 1 -- 172.21.15.3:0/2247446532 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0ad440 con 0x7f8630004d10 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f864b4f2640 1 -- 172.21.15.3:0/2247446532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8630004d10 msgr2=0x7f8630005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f864b4f2640 1 --2- 172.21.15.3:0/2247446532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8630004d10 0x7f8630005180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f863c009fc0 tx=0x7f863c01cc60 comp rx=0 tx=0).stop 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f8649a8f640 1 -- 172.21.15.3:0/2247446532 reap_dead start 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f864b4f2640 1 -- 172.21.15.3:0/2247446532 shutdown_connections 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f864b4f2640 1 -- 172.21.15.3:0/2247446532 >> 172.21.15.3:0/2247446532 conn(0x7f864406a740 msgr2=0x7f86440cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f864b4f2640 1 -- 172.21.15.3:0/2247446532 shutdown_connections 2023-05-17T11:46:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.934+0000 7f864b4f2640 1 -- 172.21.15.3:0/2247446532 wait complete. 2023-05-17T11:46:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 Processor -- start 2023-05-17T11:46:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 -- start start 2023-05-17T11:46:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8630004d10 0x7f864415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8644099480 0x7f8644154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 0x7f8644156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644157400 con 0x7f8644156a50 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864409aa50 con 0x7f8644099480 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440999b0 con 0x7f8630004d10 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 0x7f8644156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 0x7f8644156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55510/0 (socket says 172.21.15.3:55510) 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 -- 172.21.15.3:0/3774262641 learned_addr learned my addr 172.21.15.3:0/3774262641 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8648a8d640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8644099480 0x7f8644154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864928e640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8630004d10 0x7f864415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 -- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8630004d10 msgr2=0x7f864415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8630004d10 0x7f864415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 -- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8644099480 msgr2=0x7f8644154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8644099480 0x7f8644154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 -- 172.21.15.3:0/3774262641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864406d4b0 con 0x7f8644156a50 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8648a8d640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8644099480 0x7f8644154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864928e640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8630004d10 0x7f864415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8649a8f640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 0x7f8644156ec0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f863c0b0040 tx=0x7f863c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0bc070 con 0x7f8644156a50 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c0039a0 con 0x7f8644156a50 2023-05-17T11:46:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c003b30 con 0x7f8644156a50 2023-05-17T11:46:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440cb5f0 con 0x7f8644156a50 2023-05-17T11:46:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.938+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86440cc380 con 0x7f8644156a50 2023-05-17T11:46:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.942+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644073330 con 0x7f8644156a50 2023-05-17T11:46:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.942+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f863c0b4040 con 0x7f8644156a50 2023-05-17T11:46:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.942+0000 7f8639ffb640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f86280662b0 0x7f8628068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.942+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f863c11dfe0 con 0x7f8644156a50 2023-05-17T11:46:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.942+0000 7f864928e640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f86280662b0 0x7f8628068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.942+0000 7f864928e640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f86280662b0 0x7f8628068760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8640001580 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:43.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:43.946+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8644073330 con 0x7f8644156a50 2023-05-17T11:46:44.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.134+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f864404de80 con 0x7f8644156a50 2023-05-17T11:46:44.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f8639ffb640 1 -- 172.21.15.3:0/3774262641 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f863c0b2020 con 0x7f8644156a50 2023-05-17T11:46:44.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f86280662b0 msgr2=0x7f8628068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:44.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f86280662b0 0x7f8628068760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8640001580 tx=0x7f8640009040 comp rx=0 tx=0).stop 2023-05-17T11:46:44.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 msgr2=0x7f8644156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:44.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 0x7f8644156ec0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f863c0b0040 tx=0x7f863c009750 comp rx=0 tx=0).stop 2023-05-17T11:46:44.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 shutdown_connections 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f86280662b0 0x7f8628068760 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644156a50 0x7f8644156ec0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8644099480 0x7f8644154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 --2- 172.21.15.3:0/3774262641 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8630004d10 0x7f864415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 >> 172.21.15.3:0/3774262641 conn(0x7f864406a740 msgr2=0x7f86440ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 shutdown_connections 2023-05-17T11:46:44.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.766+0000 7f864b4f2640 1 -- 172.21.15.3:0/3774262641 wait complete. 2023-05-17T11:46:44.786 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-05-17T11:46:44.782+0000 7f2eb8dd6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T11:46:44.794 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-17T11:46:44.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:46:44.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.926+0000 7f59f2f39640 1 Processor -- start 2023-05-17T11:46:44.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f2f39640 1 -- start start 2023-05-17T11:46:44.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f2f39640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 0x7f59ec070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:44.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f2f39640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59ec06bc30 0x7f59ec06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:44.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f2f39640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec0c92f0 con 0x7f59ec071c10 2023-05-17T11:46:44.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f2f39640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec06c5f0 con 0x7f59ec06bc30 2023-05-17T11:46:44.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f2f39640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec071480 con 0x7f59ec158f10 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f0cd5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 0x7f59ec070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59ebfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f59ec071c10 0x7f59ec0cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:55548/0 (socket says 172.21.15.3:55548) 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59ebfff640 1 -- 172.21.15.3:0/2400959659 learned_addr learned my addr 172.21.15.3:0/2400959659 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f14d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59ec06bc30 0x7f59ec06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f0cd5640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 0x7f59ec070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3301/0 says I am v2:172.21.15.3:60892/0 (socket says 172.21.15.3:60892) 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f0cd5640 1 -- 172.21.15.3:0/2400959659 >> v2:172.21.15.60:3300/0 conn(0x7f59ec06bc30 msgr2=0x7f59ec06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:44.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f0cd5640 1 --2- 172.21.15.3:0/2400959659 >> v2:172.21.15.60:3300/0 conn(0x7f59ec06bc30 0x7f59ec06c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f0cd5640 1 -- 172.21.15.3:0/2400959659 >> v1:172.21.15.60:6789/0 conn(0x7f59ec071c10 legacy=0x7f59ec0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f0cd5640 1 -- 172.21.15.3:0/2400959659 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0c8a00 con 0x7f59ec158f10 2023-05-17T11:46:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59eb7fe640 1 -- 172.21.15.3:0/2400959659 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293451309 0 0) 0x7f59ec0c92f0 con 0x7f59ec071c10 2023-05-17T11:46:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.930+0000 7f59f14d6640 1 --2- 172.21.15.3:0/2400959659 >> v2:172.21.15.60:3300/0 conn(0x7f59ec06bc30 0x7f59ec06c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:46:44.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f0cd5640 1 --2- 172.21.15.3:0/2400959659 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 0x7f59ec070f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59e00097c0 tx=0x7f59e001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09b7870fb961a8b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59eb7fe640 1 -- 172.21.15.3:0/2400959659 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e00ab600 con 0x7f59ec158f10 2023-05-17T11:46:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59eb7fe640 1 -- 172.21.15.3:0/2400959659 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e00a7050 con 0x7f59ec158f10 2023-05-17T11:46:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59eb7fe640 1 -- 172.21.15.3:0/2400959659 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e00ab980 con 0x7f59ec158f10 2023-05-17T11:46:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 -- 172.21.15.3:0/2400959659 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 msgr2=0x7f59ec070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 --2- 172.21.15.3:0/2400959659 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 0x7f59ec070f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59e00097c0 tx=0x7f59e001c480 comp rx=0 tx=0).stop 2023-05-17T11:46:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 -- 172.21.15.3:0/2400959659 shutdown_connections 2023-05-17T11:46:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 --2- 172.21.15.3:0/2400959659 >> v2:172.21.15.60:3300/0 conn(0x7f59ec06bc30 0x7f59ec06c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 --2- 172.21.15.3:0/2400959659 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec158f10 0x7f59ec070f40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 -- 172.21.15.3:0/2400959659 >> 172.21.15.3:0/2400959659 conn(0x7f59ec0b0b30 msgr2=0x7f59ec0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 -- 172.21.15.3:0/2400959659 shutdown_connections 2023-05-17T11:46:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.934+0000 7f59f2f39640 1 -- 172.21.15.3:0/2400959659 wait complete. 2023-05-17T11:46:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 Processor -- start 2023-05-17T11:46:44.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- start start 2023-05-17T11:46:44.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec06bc30 0x7f59ec0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:44.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59ec071c10 0x7f59ec0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:44.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 0x7f59ec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:44.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec15bcb0 con 0x7f59ec158f10 2023-05-17T11:46:44.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c5240 con 0x7f59ec071c10 2023-05-17T11:46:44.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec15b0a0 con 0x7f59ec06bc30 2023-05-17T11:46:44.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 0x7f59ec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 0x7f59ec0c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55524/0 (socket says 172.21.15.3:55524) 2023-05-17T11:46:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 -- 172.21.15.3:0/3112039128 learned_addr learned my addr 172.21.15.3:0/3112039128 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59ebfff640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59ec071c10 0x7f59ec0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f0cd5640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec06bc30 0x7f59ec0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 -- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec06bc30 msgr2=0x7f59ec0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec06bc30 0x7f59ec0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 -- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59ec071c10 msgr2=0x7f59ec0b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59ec071c10 0x7f59ec0b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 -- 172.21.15.3:0/3112039128 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4009a70 con 0x7f59ec158f10 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f14d6640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 0x7f59ec0c7490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f59e400efc0 tx=0x7f59e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4009d70 con 0x7f59ec158f10 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400f040 con 0x7f59ec158f10 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e0009420 con 0x7f59ec158f10 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40039a0 con 0x7f59ec158f10 2023-05-17T11:46:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec0cc690 con 0x7f59ec158f10 2023-05-17T11:46:44.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.938+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec0c8f80 con 0x7f59ec158f10 2023-05-17T11:46:44.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.942+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59e40144a0 con 0x7f59ec158f10 2023-05-17T11:46:44.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.942+0000 7f59e97fa640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f59d0066280 0x7f59d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:44.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.942+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59e4084810 con 0x7f59ec158f10 2023-05-17T11:46:44.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.942+0000 7f59f0cd5640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f59d0066280 0x7f59d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:44.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.942+0000 7f59f0cd5640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f59d0066280 0x7f59d0068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59e00ad000 tx=0x7f59e00a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:44.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:44.946+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59e4055800 con 0x7f59ec158f10 2023-05-17T11:46:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.130+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59ec069ab0 con 0x7f59ec158f10 2023-05-17T11:46:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59e97fa640 1 -- 172.21.15.3:0/3112039128 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f59e4055390 con 0x7f59ec158f10 2023-05-17T11:46:45.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:45.139 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/172630740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":172630740},{"type":"v1","addr":"172.21.15.3:6837","nonce":172630740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/3415937638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3415937638},{"type":"v1","addr":"172.21.15.60:6834","nonce":3415937638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3587202772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3587202772},{"type":"v1","addr":"172.21.15.60:6835","nonce":3587202772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:46:41.746770+0000","modified":"2023-05-17T11:46:44.758576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3253181122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3253181122},{"type":"v1","addr":"172.21.15.3:6835","nonce":3253181122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-17T11:46:45.139 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 16 2023-05-17T11:46:45.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f59d0066280 msgr2=0x7f59d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f59d0066280 0x7f59d0068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59e00ad000 tx=0x7f59e00a6000 comp rx=0 tx=0).stop 2023-05-17T11:46:45.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 msgr2=0x7f59ec0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 0x7f59ec0c7490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f59e400efc0 tx=0x7f59e4009f90 comp rx=0 tx=0).stop 2023-05-17T11:46:45.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 shutdown_connections 2023-05-17T11:46:45.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f59d0066280 0x7f59d0068730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59ec158f10 0x7f59ec0c7490 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59ec071c10 0x7f59ec0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 --2- 172.21.15.3:0/3112039128 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f59ec06bc30 0x7f59ec0c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 >> 172.21.15.3:0/3112039128 conn(0x7f59ec0b0b30 msgr2=0x7f59ec162450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:45.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 shutdown_connections 2023-05-17T11:46:45.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.134+0000 7f59f2f39640 1 -- 172.21.15.3:0/3112039128 wait complete. 2023-05-17T11:46:45.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T11:46:45.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d26ba6640 1 Processor -- start 2023-05-17T11:46:45.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d26ba6640 1 -- start start 2023-05-17T11:46:45.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d26ba6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d200cac10 0x7f9d2015df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d26ba6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200b5ec0 con 0x7f9d200b5af0 2023-05-17T11:46:45.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d26ba6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200d0370 con 0x7f9d200af890 2023-05-17T11:46:45.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d26ba6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2015db00 con 0x7f9d200cac10 2023-05-17T11:46:45.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d24942640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9d200b5af0 0x7f9d200ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57116/0 (socket says 172.21.15.3:57116) 2023-05-17T11:46:45.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d24942640 1 -- 172.21.15.3:0/465420316 learned_addr learned my addr 172.21.15.3:0/465420316 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1ffff640 1 --2- 172.21.15.3:0/465420316 >> v2:172.21.15.60:3300/0 conn(0x7f9d200cac10 0x7f9d2015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1f7fe640 1 -- 172.21.15.3:0/465420316 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870698160 0 0) 0x7f9d200b5ec0 con 0x7f9d200b5af0 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1f7fe640 1 -- 172.21.15.3:0/465420316 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d10003530 con 0x7f9d200b5af0 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1f7fe640 1 -- 172.21.15.3:0/465420316 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2550841534 0 0) 0x7f9d10003530 con 0x7f9d200b5af0 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1ffff640 1 -- 172.21.15.3:0/465420316 >> v1:172.21.15.60:6789/0 conn(0x7f9d200af890 legacy=0x7f9d200cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1ffff640 1 -- 172.21.15.3:0/465420316 >> v1:172.21.15.3:6789/0 conn(0x7f9d200b5af0 legacy=0x7f9d200ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.290+0000 7f9d1ffff640 1 -- 172.21.15.3:0/465420316 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200cfad0 con 0x7f9d200cac10 2023-05-17T11:46:45.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d1ffff640 1 --2- 172.21.15.3:0/465420316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200cac10 0x7f9d2015df00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0097c0 tx=0x7f9d0c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d00da0911d1e02d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d1f7fe640 1 -- 172.21.15.3:0/465420316 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14001680 con 0x7f9d200cac10 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d1f7fe640 1 -- 172.21.15.3:0/465420316 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c0a7050 con 0x7f9d200cac10 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d1f7fe640 1 -- 172.21.15.3:0/465420316 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0ab620 con 0x7f9d200cac10 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 -- 172.21.15.3:0/465420316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200cac10 msgr2=0x7f9d2015df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/465420316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200cac10 0x7f9d2015df00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0097c0 tx=0x7f9d0c01c310 comp rx=0 tx=0).stop 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 -- 172.21.15.3:0/465420316 shutdown_connections 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/465420316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200cac10 0x7f9d2015df00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 -- 172.21.15.3:0/465420316 >> 172.21.15.3:0/465420316 conn(0x7f9d2006eac0 msgr2=0x7f9d200cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 -- 172.21.15.3:0/465420316 shutdown_connections 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.294+0000 7f9d26ba6640 1 -- 172.21.15.3:0/465420316 wait complete. 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 Processor -- start 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 -- start start 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200af890 0x7f9d20148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9d200b5af0 0x7f9d20157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 0x7f9d200b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20148770 con 0x7f9d200cac10 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201583f0 con 0x7f9d200af890 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2014f3f0 con 0x7f9d200b5af0 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 0x7f9d200b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d24942640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200af890 0x7f9d20148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 0x7f9d200b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55530/0 (socket says 172.21.15.3:55530) 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 -- 172.21.15.3:0/153950649 learned_addr learned my addr 172.21.15.3:0/153950649 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:45.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d1ffff640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9d200b5af0 0x7f9d20157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 -- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9d200b5af0 msgr2=0x7f9d20157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9d200b5af0 0x7f9d20157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 -- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200af890 msgr2=0x7f9d20148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200af890 0x7f9d20148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 -- 172.21.15.3:0/153950649 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c009420 con 0x7f9d200cac10 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d25143640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 0x7f9d200b33f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c760 tx=0x7f9d1800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18003b80 con 0x7f9d200cac10 2023-05-17T11:46:45.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18003ce0 con 0x7f9d200cac10 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800aa30 con 0x7f9d200cac10 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.298+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200ce8a0 con 0x7f9d200cac10 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2015e850 con 0x7f9d200cac10 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d200cf780 con 0x7f9d200cac10 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d1800ab90 con 0x7f9d200cac10 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d1d7fa640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9d04066280 0x7f9d04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d18083a10 con 0x7f9d200cac10 2023-05-17T11:46:45.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d24942640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9d04066280 0x7f9d04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.302+0000 7f9d24942640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9d04066280 0x7f9d04068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006ae0 tx=0x7f9d14001d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:45.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.306+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9d18050ea0 con 0x7f9d200cac10 2023-05-17T11:46:45.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.462+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d2004de80 con 0x7f9d200cac10 2023-05-17T11:46:45.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.462+0000 7f9d1d7fa640 1 -- 172.21.15.3:0/153950649 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f9d180544c0 con 0x7f9d200cac10 2023-05-17T11:46:45.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:45.470 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":37,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","created":"2023-05-17T11:45:09.544334+0000","modified":"2023-05-17T11:46:42.749648+0000","last_up_change":"2023-05-17T11:45:21.594732+0000","last_in_change":"2023-05-17T11:45:12.074066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T11:45:22.595654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T11:45:28.386583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T11:46:39.465215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T11:46:40.743260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f327564-3482-4c16-adc2-9cfaf32fbd12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6801","nonce":1433398339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6803","nonce":1433398339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6807","nonce":1433398339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":1433398339},{"type":"v1","addr":"172.21.15.3:6805","nonce":1433398339}]},"public_addr":"172.21.15.3:6801/1433398339","cluster_addr":"172.21.15.3:6803/1433398339","heartbeat_back_addr":"172.21.15.3:6807/1433398339","heartbeat_front_addr":"172.21.15.3:6805/1433398339","state":["exists","up"]},{"osd":1,"uuid":"4f4f60b7-c63b-41d1-b575-7b361981285b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6815","nonce":2665961272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6822","nonce":2665961272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6829","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6831","nonce":2665961272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6825","nonce":2665961272},{"type":"v1","addr":"172.21.15.3:6827","nonce":2665961272}]},"public_addr":"172.21.15.3:6815/2665961272","cluster_addr":"172.21.15.3:6822/2665961272","heartbeat_back_addr":"172.21.15.3:6831/2665961272","heartbeat_front_addr":"172.21.15.3:6827/2665961272","state":["exists","up"]},{"osd":2,"uuid":"b19844ff-c2c7-4e4a-8bdd-8bc884d45b62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6812","nonce":1833145018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6817","nonce":1833145018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6830","nonce":1833145018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":1833145018},{"type":"v1","addr":"172.21.15.3:6824","nonce":1833145018}]},"public_addr":"172.21.15.3:6812/1833145018","cluster_addr":"172.21.15.3:6817/1833145018","heartbeat_back_addr":"172.21.15.3:6830/1833145018","heartbeat_front_addr":"172.21.15.3:6824/1833145018","state":["exists","up"]},{"osd":3,"uuid":"4466356c-5db6-42f9-ad9d-312db19fe8d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6810","nonce":2348065528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6816","nonce":2348065528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6826","nonce":2348065528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":2348065528},{"type":"v1","addr":"172.21.15.3:6820","nonce":2348065528}]},"public_addr":"172.21.15.3:6810/2348065528","cluster_addr":"172.21.15.3:6816/2348065528","heartbeat_back_addr":"172.21.15.3:6826/2348065528","heartbeat_front_addr":"172.21.15.3:6820/2348065528","state":["exists","up"]},{"osd":4,"uuid":"2121ec95-308e-4941-8c8f-8816f378719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6811","nonce":325718632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6815","nonce":325718632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6822","nonce":325718632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":325718632},{"type":"v1","addr":"172.21.15.60:6819","nonce":325718632}]},"public_addr":"172.21.15.60:6811/325718632","cluster_addr":"172.21.15.60:6815/325718632","heartbeat_back_addr":"172.21.15.60:6822/325718632","heartbeat_front_addr":"172.21.15.60:6819/325718632","state":["exists","up"]},{"osd":5,"uuid":"564d4297-058b-4128-9038-72e47135c28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6801","nonce":205590027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6803","nonce":205590027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6807","nonce":205590027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":205590027},{"type":"v1","addr":"172.21.15.60:6805","nonce":205590027}]},"public_addr":"172.21.15.60:6801/205590027","cluster_addr":"172.21.15.60:6803/205590027","heartbeat_back_addr":"172.21.15.60:6807/205590027","heartbeat_front_addr":"172.21.15.60:6805/205590027","state":["exists","up"]},{"osd":6,"uuid":"d6e5ad89-fc7b-44e9-be69-d1f8d08c9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6810","nonce":3529818869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6814","nonce":3529818869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6823","nonce":3529818869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":3529818869},{"type":"v1","addr":"172.21.15.60:6818","nonce":3529818869}]},"public_addr":"172.21.15.60:6810/3529818869","cluster_addr":"172.21.15.60:6814/3529818869","heartbeat_back_addr":"172.21.15.60:6823/3529818869","heartbeat_front_addr":"172.21.15.60:6818/3529818869","state":["exists","up"]},{"osd":7,"uuid":"7ddc02d2-46ec-420c-aabb-5573379f1ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6825","nonce":1617182656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6827","nonce":1617182656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6831","nonce":1617182656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1617182656},{"type":"v1","addr":"172.21.15.60:6829","nonce":1617182656}]},"public_addr":"172.21.15.60:6825/1617182656","cluster_addr":"172.21.15.60:6827/1617182656","heartbeat_back_addr":"172.21.15.60:6831/1617182656","heartbeat_front_addr":"172.21.15.60:6829/1617182656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.806156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.693010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.805323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.852422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.681977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.754571+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.743315+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T11:45:17.564114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T11:46:45.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9d04066280 msgr2=0x7f9d04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9d04066280 0x7f9d04068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006ae0 tx=0x7f9d14001d30 comp rx=0 tx=0).stop 2023-05-17T11:46:45.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 msgr2=0x7f9d200b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 0x7f9d200b33f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c760 tx=0x7f9d1800cc20 comp rx=0 tx=0).stop 2023-05-17T11:46:45.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 shutdown_connections 2023-05-17T11:46:45.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f9d04066280 0x7f9d04068730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d200cac10 0x7f9d200b33f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f9d200b5af0 0x7f9d20157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 --2- 172.21.15.3:0/153950649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d200af890 0x7f9d20148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 >> 172.21.15.3:0/153950649 conn(0x7f9d2006eac0 msgr2=0x7f9d201590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:45.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 shutdown_connections 2023-05-17T11:46:45.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.466+0000 7f9d26ba6640 1 -- 172.21.15.3:0/153950649 wait complete. 2023-05-17T11:46:45.490 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T11:46:45.491 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T11:46:45.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.622+0000 7f1a03efc640 1 Processor -- start 2023-05-17T11:46:45.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.622+0000 7f1a03efc640 1 -- start start 2023-05-17T11:46:45.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a03efc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19fc158f10 0x7f19fc070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a03efc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a03efc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f19fc0cc4c0 0x7f19fc06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a03efc640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19fc0c92f0 con 0x7f19fc0cc4c0 2023-05-17T11:46:45.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a03efc640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19fc071480 con 0x7f19fc158f10 2023-05-17T11:46:45.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a03efc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c8a00 con 0x7f19fc071c10 2023-05-17T11:46:45.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f19fc0cc4c0 0x7f19fc06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f19fc0cc4c0 0x7f19fc06bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55532/0 (socket says 172.21.15.3:55532) 2023-05-17T11:46:45.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 -- 172.21.15.3:0/3061613688 learned_addr learned my addr 172.21.15.3:0/3061613688 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:45.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a01c98640 1 --2- 172.21.15.3:0/3061613688 >> v2:172.21.15.60:3300/0 conn(0x7f19fc158f10 0x7f19fc070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a01497640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 -- 172.21.15.3:0/3061613688 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 msgr2=0x7f19fc0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:45.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc0cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 -- 172.21.15.3:0/3061613688 >> v2:172.21.15.60:3300/0 conn(0x7f19fc158f10 msgr2=0x7f19fc070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:45.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 --2- 172.21.15.3:0/3061613688 >> v2:172.21.15.60:3300/0 conn(0x7f19fc158f10 0x7f19fc070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 -- 172.21.15.3:0/3061613688 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0716e0 con 0x7f19fc0cc4c0 2023-05-17T11:46:45.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a01c98640 1 --2- 172.21.15.3:0/3061613688 >> v2:172.21.15.60:3300/0 conn(0x7f19fc158f10 0x7f19fc070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:45.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a01497640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:46:45.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.626+0000 7f1a02499640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc06bc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f19fc06e090 tx=0x7f19f401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab916fea0451d4d1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:45.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a00c96640 1 -- 172.21.15.3:0/3061613688 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40090d0 con 0x7f19fc0cc4c0 2023-05-17T11:46:45.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a00c96640 1 -- 172.21.15.3:0/3061613688 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4009230 con 0x7f19fc0cc4c0 2023-05-17T11:46:45.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a00c96640 1 -- 172.21.15.3:0/3061613688 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40aa650 con 0x7f19fc0cc4c0 2023-05-17T11:46:45.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- 172.21.15.3:0/3061613688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc0cc4c0 msgr2=0x7f19fc06bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc06bc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f19fc06e090 tx=0x7f19f401c9d0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- 172.21.15.3:0/3061613688 shutdown_connections 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc06bc30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3061613688 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3061613688 >> v2:172.21.15.60:3300/0 conn(0x7f19fc158f10 0x7f19fc070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- 172.21.15.3:0/3061613688 >> 172.21.15.3:0/3061613688 conn(0x7f19fc0b0b30 msgr2=0x7f19fc0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- 172.21.15.3:0/3061613688 shutdown_connections 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- 172.21.15.3:0/3061613688 wait complete. 2023-05-17T11:46:45.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 Processor -- start 2023-05-17T11:46:45.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- start start 2023-05-17T11:46:45.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 0x7f19fc1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c4080 con 0x7f19fc158f10 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c3470 con 0x7f19fc0cc4c0 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a03efc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c3750 con 0x7f19fc071c10 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a02499640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 0x7f19fc1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a02499640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 0x7f19fc1548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55546/0 (socket says 172.21.15.3:55546) 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.630+0000 7f1a02499640 1 -- 172.21.15.3:0/3536375775 learned_addr learned my addr 172.21.15.3:0/3536375775 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a01497640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a01c98640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a02499640 1 -- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 msgr2=0x7f19fc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a02499640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a02499640 1 -- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc0cc4c0 msgr2=0x7f19fc0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a02499640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a02499640 1 -- 172.21.15.3:0/3536375775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4009b30 con 0x7f19fc158f10 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a01497640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a02499640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 0x7f19fc1548a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f19f40ac040 tx=0x7f19f4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:45.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40aaaa0 con 0x7f19fc158f10 2023-05-17T11:46:45.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f40b7070 con 0x7f19fc158f10 2023-05-17T11:46:45.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc15c920 con 0x7f19fc158f10 2023-05-17T11:46:45.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40aae60 con 0x7f19fc158f10 2023-05-17T11:46:45.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc06c580 con 0x7f19fc158f10 2023-05-17T11:46:45.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc15cab0 con 0x7f19fc158f10 2023-05-17T11:46:45.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19f40b33f0 con 0x7f19fc158f10 2023-05-17T11:46:45.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f19f27fc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19e0066280 0x7f19e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:45.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19f411dda0 con 0x7f19fc158f10 2023-05-17T11:46:45.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.634+0000 7f1a01c98640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19e0066280 0x7f19e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:45.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.638+0000 7f1a01c98640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19e0066280 0x7f19e0068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006fd0 tx=0x7f19f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:45.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.638+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f19f40eecb0 con 0x7f19fc158f10 2023-05-17T11:46:45.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.790+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 --> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19fc04de80 con 0x7f19e0066280 2023-05-17T11:46:45.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.802+0000 7f19f27fc640 1 -- 172.21.15.3:0/3536375775 <== mgr.4110 v2:172.21.15.3:6832/2126677587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311153 (secure 0 0 0) 0x7f19fc04de80 con 0x7f19e0066280 2023-05-17T11:46:45.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:45.812 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-05-17T11:46:45.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19e0066280 msgr2=0x7f19e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19e0066280 0x7f19e0068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006fd0 tx=0x7f19f8008040 comp rx=0 tx=0).stop 2023-05-17T11:46:45.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 msgr2=0x7f19fc1548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:45.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 0x7f19fc1548a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f19f40ac040 tx=0x7f19f4019770 comp rx=0 tx=0).stop 2023-05-17T11:46:45.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 shutdown_connections 2023-05-17T11:46:45.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f19e0066280 0x7f19e0068730 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19fc158f10 0x7f19fc1548a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc0cc4c0 0x7f19fc0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 --2- 172.21.15.3:0/3536375775 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f19fc071c10 0x7f19fc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 >> 172.21.15.3:0/3536375775 conn(0x7f19fc0b0b30 msgr2=0x7f19fc0cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 shutdown_connections 2023-05-17T11:46:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:45.806+0000 7f1a03efc640 1 -- 172.21.15.3:0/3536375775 wait complete. 2023-05-17T11:46:45.830 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-05-17T11:46:44.540126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":86128,"kb_used_data":4400,"kb_used_omap":0,"kb_used_meta":81664,"kb_avail":754888592,"statfs":{"total":773094113280,"available":773005918208,"internally_reserved":0,"allocated":4505600,"data_stored":2528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83623936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.192409"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786266+0000","last_change":"2023-05-17T11:46:41.780155+0000","last_active":"2023-05-17T11:46:41.786266+0000","last_peered":"2023-05-17T11:46:41.786266+0000","last_clean":"2023-05-17T11:46:41.786266+0000","last_became_active":"2023-05-17T11:46:41.779883+0000","last_became_peered":"2023-05-17T11:46:41.779883+0000","last_unstale":"2023-05-17T11:46:41.786266+0000","last_undegraded":"2023-05-17T11:46:41.786266+0000","last_fullsized":"2023-05-17T11:46:41.786266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:09.477889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786214+0000","last_change":"2023-05-17T11:46:41.780886+0000","last_active":"2023-05-17T11:46:41.786214+0000","last_peered":"2023-05-17T11:46:41.786214+0000","last_clean":"2023-05-17T11:46:41.786214+0000","last_became_active":"2023-05-17T11:46:41.780042+0000","last_became_peered":"2023-05-17T11:46:41.780042+0000","last_unstale":"2023-05-17T11:46:41.786214+0000","last_undegraded":"2023-05-17T11:46:41.786214+0000","last_fullsized":"2023-05-17T11:46:41.786214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:38:35.471164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.789364+0000","last_change":"2023-05-17T11:46:41.787516+0000","last_active":"2023-05-17T11:46:41.789364+0000","last_peered":"2023-05-17T11:46:41.789364+0000","last_clean":"2023-05-17T11:46:41.789364+0000","last_became_active":"2023-05-17T11:46:41.787246+0000","last_became_peered":"2023-05-17T11:46:41.787246+0000","last_unstale":"2023-05-17T11:46:41.789364+0000","last_undegraded":"2023-05-17T11:46:41.789364+0000","last_fullsized":"2023-05-17T11:46:41.789364+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:07:01.553055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.778888+0000","last_change":"2023-05-17T11:46:41.775300+0000","last_active":"2023-05-17T11:46:41.778888+0000","last_peered":"2023-05-17T11:46:41.778888+0000","last_clean":"2023-05-17T11:46:41.778888+0000","last_became_active":"2023-05-17T11:46:41.775029+0000","last_became_peered":"2023-05-17T11:46:41.775029+0000","last_unstale":"2023-05-17T11:46:41.778888+0000","last_undegraded":"2023-05-17T11:46:41.778888+0000","last_fullsized":"2023-05-17T11:46:41.778888+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:09:25.276960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.770565+0000","last_change":"2023-05-17T11:46:41.765620+0000","last_active":"2023-05-17T11:46:41.770565+0000","last_peered":"2023-05-17T11:46:41.770565+0000","last_clean":"2023-05-17T11:46:41.770565+0000","last_became_active":"2023-05-17T11:46:41.765271+0000","last_became_peered":"2023-05-17T11:46:41.765271+0000","last_unstale":"2023-05-17T11:46:41.770565+0000","last_undegraded":"2023-05-17T11:46:41.770565+0000","last_fullsized":"2023-05-17T11:46:41.770565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:18:22.343075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.781906+0000","last_change":"2023-05-17T11:46:41.780214+0000","last_active":"2023-05-17T11:46:41.781906+0000","last_peered":"2023-05-17T11:46:41.781906+0000","last_clean":"2023-05-17T11:46:41.781906+0000","last_became_active":"2023-05-17T11:46:41.779912+0000","last_became_peered":"2023-05-17T11:46:41.779912+0000","last_unstale":"2023-05-17T11:46:41.781906+0000","last_undegraded":"2023-05-17T11:46:41.781906+0000","last_fullsized":"2023-05-17T11:46:41.781906+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:54.714061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.794059+0000","last_change":"2023-05-17T11:46:41.787680+0000","last_active":"2023-05-17T11:46:41.794059+0000","last_peered":"2023-05-17T11:46:41.794059+0000","last_clean":"2023-05-17T11:46:41.794059+0000","last_became_active":"2023-05-17T11:46:41.787177+0000","last_became_peered":"2023-05-17T11:46:41.787177+0000","last_unstale":"2023-05-17T11:46:41.794059+0000","last_undegraded":"2023-05-17T11:46:41.794059+0000","last_fullsized":"2023-05-17T11:46:41.794059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:33:31.783031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793606+0000","last_change":"2023-05-17T11:46:41.792427+0000","last_active":"2023-05-17T11:46:41.793606+0000","last_peered":"2023-05-17T11:46:41.793606+0000","last_clean":"2023-05-17T11:46:41.793606+0000","last_became_active":"2023-05-17T11:46:41.792137+0000","last_became_peered":"2023-05-17T11:46:41.792137+0000","last_unstale":"2023-05-17T11:46:41.793606+0000","last_undegraded":"2023-05-17T11:46:41.793606+0000","last_fullsized":"2023-05-17T11:46:41.793606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:28.677161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.789898+0000","last_change":"2023-05-17T11:46:41.788343+0000","last_active":"2023-05-17T11:46:41.789898+0000","last_peered":"2023-05-17T11:46:41.789898+0000","last_clean":"2023-05-17T11:46:41.789898+0000","last_became_active":"2023-05-17T11:46:41.788086+0000","last_became_peered":"2023-05-17T11:46:41.788086+0000","last_unstale":"2023-05-17T11:46:41.789898+0000","last_undegraded":"2023-05-17T11:46:41.789898+0000","last_fullsized":"2023-05-17T11:46:41.789898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:13.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792061+0000","last_change":"2023-05-17T11:46:41.785036+0000","last_active":"2023-05-17T11:46:41.792061+0000","last_peered":"2023-05-17T11:46:41.792061+0000","last_clean":"2023-05-17T11:46:41.792061+0000","last_became_active":"2023-05-17T11:46:41.784748+0000","last_became_peered":"2023-05-17T11:46:41.784748+0000","last_unstale":"2023-05-17T11:46:41.792061+0000","last_undegraded":"2023-05-17T11:46:41.792061+0000","last_fullsized":"2023-05-17T11:46:41.792061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:10:03.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792005+0000","last_change":"2023-05-17T11:46:41.776387+0000","last_active":"2023-05-17T11:46:41.792005+0000","last_peered":"2023-05-17T11:46:41.792005+0000","last_clean":"2023-05-17T11:46:41.792005+0000","last_became_active":"2023-05-17T11:46:41.776093+0000","last_became_peered":"2023-05-17T11:46:41.776093+0000","last_unstale":"2023-05-17T11:46:41.792005+0000","last_undegraded":"2023-05-17T11:46:41.792005+0000","last_fullsized":"2023-05-17T11:46:41.792005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:25.513081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768095+0000","last_change":"2023-05-17T11:46:41.764475+0000","last_active":"2023-05-17T11:46:41.768095+0000","last_peered":"2023-05-17T11:46:41.768095+0000","last_clean":"2023-05-17T11:46:41.768095+0000","last_became_active":"2023-05-17T11:46:41.764191+0000","last_became_peered":"2023-05-17T11:46:41.764191+0000","last_unstale":"2023-05-17T11:46:41.768095+0000","last_undegraded":"2023-05-17T11:46:41.768095+0000","last_fullsized":"2023-05-17T11:46:41.768095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:26:22.624438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792147+0000","last_change":"2023-05-17T11:46:41.783713+0000","last_active":"2023-05-17T11:46:41.792147+0000","last_peered":"2023-05-17T11:46:41.792147+0000","last_clean":"2023-05-17T11:46:41.792147+0000","last_became_active":"2023-05-17T11:46:41.783505+0000","last_became_peered":"2023-05-17T11:46:41.783505+0000","last_unstale":"2023-05-17T11:46:41.792147+0000","last_undegraded":"2023-05-17T11:46:41.792147+0000","last_fullsized":"2023-05-17T11:46:41.792147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:38:58.301353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.776572+0000","last_change":"2023-05-17T11:46:41.772715+0000","last_active":"2023-05-17T11:46:41.776572+0000","last_peered":"2023-05-17T11:46:41.776572+0000","last_clean":"2023-05-17T11:46:41.776572+0000","last_became_active":"2023-05-17T11:46:41.772474+0000","last_became_peered":"2023-05-17T11:46:41.772474+0000","last_unstale":"2023-05-17T11:46:41.776572+0000","last_undegraded":"2023-05-17T11:46:41.776572+0000","last_fullsized":"2023-05-17T11:46:41.776572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:18.598303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791872+0000","last_change":"2023-05-17T11:46:41.776954+0000","last_active":"2023-05-17T11:46:41.791872+0000","last_peered":"2023-05-17T11:46:41.791872+0000","last_clean":"2023-05-17T11:46:41.791872+0000","last_became_active":"2023-05-17T11:46:41.776588+0000","last_became_peered":"2023-05-17T11:46:41.776588+0000","last_unstale":"2023-05-17T11:46:41.791872+0000","last_undegraded":"2023-05-17T11:46:41.791872+0000","last_fullsized":"2023-05-17T11:46:41.791872+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:26.073821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793148+0000","last_change":"2023-05-17T11:46:41.788666+0000","last_active":"2023-05-17T11:46:41.793148+0000","last_peered":"2023-05-17T11:46:41.793148+0000","last_clean":"2023-05-17T11:46:41.793148+0000","last_became_active":"2023-05-17T11:46:41.788060+0000","last_became_peered":"2023-05-17T11:46:41.788060+0000","last_unstale":"2023-05-17T11:46:41.793148+0000","last_undegraded":"2023-05-17T11:46:41.793148+0000","last_fullsized":"2023-05-17T11:46:41.793148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:03:17.779688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793130+0000","last_change":"2023-05-17T11:46:41.789117+0000","last_active":"2023-05-17T11:46:41.793130+0000","last_peered":"2023-05-17T11:46:41.793130+0000","last_clean":"2023-05-17T11:46:41.793130+0000","last_became_active":"2023-05-17T11:46:41.788785+0000","last_became_peered":"2023-05-17T11:46:41.788785+0000","last_unstale":"2023-05-17T11:46:41.793130+0000","last_undegraded":"2023-05-17T11:46:41.793130+0000","last_fullsized":"2023-05-17T11:46:41.793130+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:13.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.772462+0000","last_change":"2023-05-17T11:46:41.767319+0000","last_active":"2023-05-17T11:46:41.772462+0000","last_peered":"2023-05-17T11:46:41.772462+0000","last_clean":"2023-05-17T11:46:41.772462+0000","last_became_active":"2023-05-17T11:46:41.767044+0000","last_became_peered":"2023-05-17T11:46:41.767044+0000","last_unstale":"2023-05-17T11:46:41.772462+0000","last_undegraded":"2023-05-17T11:46:41.772462+0000","last_fullsized":"2023-05-17T11:46:41.772462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:39:21.877171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768397+0000","last_change":"2023-05-17T11:46:41.765242+0000","last_active":"2023-05-17T11:46:41.768397+0000","last_peered":"2023-05-17T11:46:41.768397+0000","last_clean":"2023-05-17T11:46:41.768397+0000","last_became_active":"2023-05-17T11:46:41.764919+0000","last_became_peered":"2023-05-17T11:46:41.764919+0000","last_unstale":"2023-05-17T11:46:41.768397+0000","last_undegraded":"2023-05-17T11:46:41.768397+0000","last_fullsized":"2023-05-17T11:46:41.768397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:04.225010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.780641+0000","last_change":"2023-05-17T11:46:41.772719+0000","last_active":"2023-05-17T11:46:41.780641+0000","last_peered":"2023-05-17T11:46:41.780641+0000","last_clean":"2023-05-17T11:46:41.780641+0000","last_became_active":"2023-05-17T11:46:41.771976+0000","last_became_peered":"2023-05-17T11:46:41.771976+0000","last_unstale":"2023-05-17T11:46:41.780641+0000","last_undegraded":"2023-05-17T11:46:41.780641+0000","last_fullsized":"2023-05-17T11:46:41.780641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:19:09.154644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791903+0000","last_change":"2023-05-17T11:46:41.775803+0000","last_active":"2023-05-17T11:46:41.791903+0000","last_peered":"2023-05-17T11:46:41.791903+0000","last_clean":"2023-05-17T11:46:41.791903+0000","last_became_active":"2023-05-17T11:46:41.775462+0000","last_became_peered":"2023-05-17T11:46:41.775462+0000","last_unstale":"2023-05-17T11:46:41.791903+0000","last_undegraded":"2023-05-17T11:46:41.791903+0000","last_fullsized":"2023-05-17T11:46:41.791903+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:18.598303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.779922+0000","last_change":"2023-05-17T11:46:41.777900+0000","last_active":"2023-05-17T11:46:41.779922+0000","last_peered":"2023-05-17T11:46:41.779922+0000","last_clean":"2023-05-17T11:46:41.779922+0000","last_became_active":"2023-05-17T11:46:41.777633+0000","last_became_peered":"2023-05-17T11:46:41.777633+0000","last_unstale":"2023-05-17T11:46:41.779922+0000","last_undegraded":"2023-05-17T11:46:41.779922+0000","last_fullsized":"2023-05-17T11:46:41.779922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:25.513081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791196+0000","last_change":"2023-05-17T11:46:41.783259+0000","last_active":"2023-05-17T11:46:41.791196+0000","last_peered":"2023-05-17T11:46:41.791196+0000","last_clean":"2023-05-17T11:46:41.791196+0000","last_became_active":"2023-05-17T11:46:41.780874+0000","last_became_peered":"2023-05-17T11:46:41.780874+0000","last_unstale":"2023-05-17T11:46:41.791196+0000","last_undegraded":"2023-05-17T11:46:41.791196+0000","last_fullsized":"2023-05-17T11:46:41.791196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:38:35.471164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.770605+0000","last_change":"2023-05-17T11:46:41.767354+0000","last_active":"2023-05-17T11:46:41.770605+0000","last_peered":"2023-05-17T11:46:41.770605+0000","last_clean":"2023-05-17T11:46:41.770605+0000","last_became_active":"2023-05-17T11:46:41.766976+0000","last_became_peered":"2023-05-17T11:46:41.766976+0000","last_unstale":"2023-05-17T11:46:41.770605+0000","last_undegraded":"2023-05-17T11:46:41.770605+0000","last_fullsized":"2023-05-17T11:46:41.770605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:47:41.977285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768128+0000","last_change":"2023-05-17T11:46:41.765948+0000","last_active":"2023-05-17T11:46:41.768128+0000","last_peered":"2023-05-17T11:46:41.768128+0000","last_clean":"2023-05-17T11:46:41.768128+0000","last_became_active":"2023-05-17T11:46:41.764833+0000","last_became_peered":"2023-05-17T11:46:41.764833+0000","last_unstale":"2023-05-17T11:46:41.768128+0000","last_undegraded":"2023-05-17T11:46:41.768128+0000","last_fullsized":"2023-05-17T11:46:41.768128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:37.576699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790473+0000","last_change":"2023-05-17T11:46:41.788232+0000","last_active":"2023-05-17T11:46:41.790473+0000","last_peered":"2023-05-17T11:46:41.790473+0000","last_clean":"2023-05-17T11:46:41.790473+0000","last_became_active":"2023-05-17T11:46:41.787842+0000","last_became_peered":"2023-05-17T11:46:41.787842+0000","last_unstale":"2023-05-17T11:46:41.790473+0000","last_undegraded":"2023-05-17T11:46:41.790473+0000","last_fullsized":"2023-05-17T11:46:41.790473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:07:01.553055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.766333+0000","last_change":"2023-05-17T11:46:41.764301+0000","last_active":"2023-05-17T11:46:41.766333+0000","last_peered":"2023-05-17T11:46:41.766333+0000","last_clean":"2023-05-17T11:46:41.766333+0000","last_became_active":"2023-05-17T11:46:41.763905+0000","last_became_peered":"2023-05-17T11:46:41.763905+0000","last_unstale":"2023-05-17T11:46:41.766333+0000","last_undegraded":"2023-05-17T11:46:41.766333+0000","last_fullsized":"2023-05-17T11:46:41.766333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:00:45.169656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791971+0000","last_change":"2023-05-17T11:46:41.783035+0000","last_active":"2023-05-17T11:46:41.791971+0000","last_peered":"2023-05-17T11:46:41.791971+0000","last_clean":"2023-05-17T11:46:41.791971+0000","last_became_active":"2023-05-17T11:46:41.777970+0000","last_became_peered":"2023-05-17T11:46:41.777970+0000","last_unstale":"2023-05-17T11:46:41.791971+0000","last_undegraded":"2023-05-17T11:46:41.791971+0000","last_fullsized":"2023-05-17T11:46:41.791971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:53:01.125693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.766346+0000","last_change":"2023-05-17T11:46:41.764298+0000","last_active":"2023-05-17T11:46:41.766346+0000","last_peered":"2023-05-17T11:46:41.766346+0000","last_clean":"2023-05-17T11:46:41.766346+0000","last_became_active":"2023-05-17T11:46:41.764010+0000","last_became_peered":"2023-05-17T11:46:41.764010+0000","last_unstale":"2023-05-17T11:46:41.766346+0000","last_undegraded":"2023-05-17T11:46:41.766346+0000","last_fullsized":"2023-05-17T11:46:41.766346+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:40:56.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786827+0000","last_change":"2023-05-17T11:46:41.780786+0000","last_active":"2023-05-17T11:46:41.786827+0000","last_peered":"2023-05-17T11:46:41.786827+0000","last_clean":"2023-05-17T11:46:41.786827+0000","last_became_active":"2023-05-17T11:46:41.780418+0000","last_became_peered":"2023-05-17T11:46:41.780418+0000","last_unstale":"2023-05-17T11:46:41.786827+0000","last_undegraded":"2023-05-17T11:46:41.786827+0000","last_fullsized":"2023-05-17T11:46:41.786827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:04.225010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791362+0000","last_change":"2023-05-17T11:46:41.784172+0000","last_active":"2023-05-17T11:46:41.791362+0000","last_peered":"2023-05-17T11:46:41.791362+0000","last_clean":"2023-05-17T11:46:41.791362+0000","last_became_active":"2023-05-17T11:46:41.781266+0000","last_became_peered":"2023-05-17T11:46:41.781266+0000","last_unstale":"2023-05-17T11:46:41.791362+0000","last_undegraded":"2023-05-17T11:46:41.791362+0000","last_fullsized":"2023-05-17T11:46:41.791362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:10:03.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768183+0000","last_change":"2023-05-17T11:46:41.763975+0000","last_active":"2023-05-17T11:46:41.768183+0000","last_peered":"2023-05-17T11:46:41.768183+0000","last_clean":"2023-05-17T11:46:41.768183+0000","last_became_active":"2023-05-17T11:46:41.763678+0000","last_became_peered":"2023-05-17T11:46:41.763678+0000","last_unstale":"2023-05-17T11:46:41.768183+0000","last_undegraded":"2023-05-17T11:46:41.768183+0000","last_fullsized":"2023-05-17T11:46:41.768183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:17:26.906909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793084+0000","last_change":"2023-05-17T11:46:41.788265+0000","last_active":"2023-05-17T11:46:41.793084+0000","last_peered":"2023-05-17T11:46:41.793084+0000","last_clean":"2023-05-17T11:46:41.793084+0000","last_became_active":"2023-05-17T11:46:41.787991+0000","last_became_peered":"2023-05-17T11:46:41.787991+0000","last_unstale":"2023-05-17T11:46:41.793084+0000","last_undegraded":"2023-05-17T11:46:41.793084+0000","last_fullsized":"2023-05-17T11:46:41.793084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:54:02.050478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.780926+0000","last_change":"2023-05-17T11:46:41.375688+0000","last_active":"2023-05-17T11:46:41.780926+0000","last_peered":"2023-05-17T11:46:41.780926+0000","last_clean":"2023-05-17T11:46:41.780926+0000","last_became_active":"2023-05-17T11:46:41.375403+0000","last_became_peered":"2023-05-17T11:46:41.375403+0000","last_unstale":"2023-05-17T11:46:41.780926+0000","last_undegraded":"2023-05-17T11:46:41.780926+0000","last_fullsized":"2023-05-17T11:46:41.780926+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:25.808116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.789855+0000","last_change":"2023-05-17T11:46:41.787495+0000","last_active":"2023-05-17T11:46:41.789855+0000","last_peered":"2023-05-17T11:46:41.789855+0000","last_clean":"2023-05-17T11:46:41.789855+0000","last_became_active":"2023-05-17T11:46:41.787198+0000","last_became_peered":"2023-05-17T11:46:41.787198+0000","last_unstale":"2023-05-17T11:46:41.789855+0000","last_undegraded":"2023-05-17T11:46:41.789855+0000","last_fullsized":"2023-05-17T11:46:41.789855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:22.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786329+0000","last_change":"2023-05-17T11:46:41.380839+0000","last_active":"2023-05-17T11:46:41.786329+0000","last_peered":"2023-05-17T11:46:41.786329+0000","last_clean":"2023-05-17T11:46:41.786329+0000","last_became_active":"2023-05-17T11:46:41.380485+0000","last_became_peered":"2023-05-17T11:46:41.380485+0000","last_unstale":"2023-05-17T11:46:41.786329+0000","last_undegraded":"2023-05-17T11:46:41.786329+0000","last_fullsized":"2023-05-17T11:46:41.786329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:14:13.641256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.779053+0000","last_change":"2023-05-17T11:46:41.775080+0000","last_active":"2023-05-17T11:46:41.779053+0000","last_peered":"2023-05-17T11:46:41.779053+0000","last_clean":"2023-05-17T11:46:41.779053+0000","last_became_active":"2023-05-17T11:46:41.774776+0000","last_became_peered":"2023-05-17T11:46:41.774776+0000","last_unstale":"2023-05-17T11:46:41.779053+0000","last_undegraded":"2023-05-17T11:46:41.779053+0000","last_fullsized":"2023-05-17T11:46:41.779053+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:51:41.586107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.776440+0000","last_change":"2023-05-17T11:46:41.379331+0000","last_active":"2023-05-17T11:46:41.776440+0000","last_peered":"2023-05-17T11:46:41.776440+0000","last_clean":"2023-05-17T11:46:41.776440+0000","last_became_active":"2023-05-17T11:46:41.379028+0000","last_became_peered":"2023-05-17T11:46:41.379028+0000","last_unstale":"2023-05-17T11:46:41.776440+0000","last_undegraded":"2023-05-17T11:46:41.776440+0000","last_fullsized":"2023-05-17T11:46:41.776440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:37:02.650209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786248+0000","last_change":"2023-05-17T11:46:41.776300+0000","last_active":"2023-05-17T11:46:41.786248+0000","last_peered":"2023-05-17T11:46:41.786248+0000","last_clean":"2023-05-17T11:46:41.786248+0000","last_became_active":"2023-05-17T11:46:41.776044+0000","last_became_peered":"2023-05-17T11:46:41.776044+0000","last_unstale":"2023-05-17T11:46:41.786248+0000","last_undegraded":"2023-05-17T11:46:41.786248+0000","last_fullsized":"2023-05-17T11:46:41.786248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:10:03.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.783700+0000","last_change":"2023-05-17T11:46:41.379448+0000","last_active":"2023-05-17T11:46:41.783700+0000","last_peered":"2023-05-17T11:46:41.783700+0000","last_clean":"2023-05-17T11:46:41.783700+0000","last_became_active":"2023-05-17T11:46:41.379140+0000","last_became_peered":"2023-05-17T11:46:41.379140+0000","last_unstale":"2023-05-17T11:46:41.783700+0000","last_undegraded":"2023-05-17T11:46:41.783700+0000","last_fullsized":"2023-05-17T11:46:41.783700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:24:32.618974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.766656+0000","last_change":"2023-05-17T11:46:41.762776+0000","last_active":"2023-05-17T11:46:41.766656+0000","last_peered":"2023-05-17T11:46:41.766656+0000","last_clean":"2023-05-17T11:46:41.766656+0000","last_became_active":"2023-05-17T11:46:41.762487+0000","last_became_peered":"2023-05-17T11:46:41.762487+0000","last_unstale":"2023-05-17T11:46:41.766656+0000","last_undegraded":"2023-05-17T11:46:41.766656+0000","last_fullsized":"2023-05-17T11:46:41.766656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:40:57.873649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791821+0000","last_change":"2023-05-17T11:46:41.377202+0000","last_active":"2023-05-17T11:46:41.791821+0000","last_peered":"2023-05-17T11:46:41.791821+0000","last_clean":"2023-05-17T11:46:41.791821+0000","last_became_active":"2023-05-17T11:46:41.376898+0000","last_became_peered":"2023-05-17T11:46:41.376898+0000","last_unstale":"2023-05-17T11:46:41.791821+0000","last_undegraded":"2023-05-17T11:46:41.791821+0000","last_fullsized":"2023-05-17T11:46:41.791821+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:51:40.582767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791799+0000","last_change":"2023-05-17T11:46:41.776039+0000","last_active":"2023-05-17T11:46:41.791799+0000","last_peered":"2023-05-17T11:46:41.791799+0000","last_clean":"2023-05-17T11:46:41.791799+0000","last_became_active":"2023-05-17T11:46:41.773894+0000","last_became_peered":"2023-05-17T11:46:41.773894+0000","last_unstale":"2023-05-17T11:46:41.791799+0000","last_undegraded":"2023-05-17T11:46:41.791799+0000","last_fullsized":"2023-05-17T11:46:41.791799+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:31.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.784050+0000","last_change":"2023-05-17T11:46:41.378049+0000","last_active":"2023-05-17T11:46:41.784050+0000","last_peered":"2023-05-17T11:46:41.784050+0000","last_clean":"2023-05-17T11:46:41.784050+0000","last_became_active":"2023-05-17T11:46:41.377760+0000","last_became_peered":"2023-05-17T11:46:41.377760+0000","last_unstale":"2023-05-17T11:46:41.784050+0000","last_undegraded":"2023-05-17T11:46:41.784050+0000","last_fullsized":"2023-05-17T11:46:41.784050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:27.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791521+0000","last_change":"2023-05-17T11:46:41.788151+0000","last_active":"2023-05-17T11:46:41.791521+0000","last_peered":"2023-05-17T11:46:41.791521+0000","last_clean":"2023-05-17T11:46:41.791521+0000","last_became_active":"2023-05-17T11:46:41.787842+0000","last_became_peered":"2023-05-17T11:46:41.787842+0000","last_unstale":"2023-05-17T11:46:41.791521+0000","last_undegraded":"2023-05-17T11:46:41.791521+0000","last_fullsized":"2023-05-17T11:46:41.791521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:31.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.753024+0000","last_change":"2023-05-17T11:46:41.377768+0000","last_active":"2023-05-17T11:46:41.753024+0000","last_peered":"2023-05-17T11:46:41.753024+0000","last_clean":"2023-05-17T11:46:41.753024+0000","last_became_active":"2023-05-17T11:46:41.377449+0000","last_became_peered":"2023-05-17T11:46:41.377449+0000","last_unstale":"2023-05-17T11:46:41.753024+0000","last_undegraded":"2023-05-17T11:46:41.753024+0000","last_fullsized":"2023-05-17T11:46:41.753024+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:35:50.011357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790223+0000","last_change":"2023-05-17T11:46:41.789045+0000","last_active":"2023-05-17T11:46:41.790223+0000","last_peered":"2023-05-17T11:46:41.790223+0000","last_clean":"2023-05-17T11:46:41.790223+0000","last_became_active":"2023-05-17T11:46:41.788629+0000","last_became_peered":"2023-05-17T11:46:41.788629+0000","last_unstale":"2023-05-17T11:46:41.790223+0000","last_undegraded":"2023-05-17T11:46:41.790223+0000","last_fullsized":"2023-05-17T11:46:41.790223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:49:41.953523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768429+0000","last_change":"2023-05-17T11:46:41.374528+0000","last_active":"2023-05-17T11:46:41.768429+0000","last_peered":"2023-05-17T11:46:41.768429+0000","last_clean":"2023-05-17T11:46:41.768429+0000","last_became_active":"2023-05-17T11:46:41.373741+0000","last_became_peered":"2023-05-17T11:46:41.373741+0000","last_unstale":"2023-05-17T11:46:41.768429+0000","last_undegraded":"2023-05-17T11:46:41.768429+0000","last_fullsized":"2023-05-17T11:46:41.768429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:06:22.266358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.773031+0000","last_change":"2023-05-17T11:46:41.770504+0000","last_active":"2023-05-17T11:46:41.773031+0000","last_peered":"2023-05-17T11:46:41.773031+0000","last_clean":"2023-05-17T11:46:41.773031+0000","last_became_active":"2023-05-17T11:46:41.770239+0000","last_became_peered":"2023-05-17T11:46:41.770239+0000","last_unstale":"2023-05-17T11:46:41.773031+0000","last_undegraded":"2023-05-17T11:46:41.773031+0000","last_fullsized":"2023-05-17T11:46:41.773031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:40:56.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.769460+0000","last_change":"2023-05-17T11:46:41.383529+0000","last_active":"2023-05-17T11:46:41.769460+0000","last_peered":"2023-05-17T11:46:41.769460+0000","last_clean":"2023-05-17T11:46:41.769460+0000","last_became_active":"2023-05-17T11:46:41.383235+0000","last_became_peered":"2023-05-17T11:46:41.383235+0000","last_unstale":"2023-05-17T11:46:41.769460+0000","last_undegraded":"2023-05-17T11:46:41.769460+0000","last_fullsized":"2023-05-17T11:46:41.769460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:56.085432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787625+0000","last_change":"2023-05-17T11:46:41.780164+0000","last_active":"2023-05-17T11:46:41.787625+0000","last_peered":"2023-05-17T11:46:41.787625+0000","last_clean":"2023-05-17T11:46:41.787625+0000","last_became_active":"2023-05-17T11:46:41.779597+0000","last_became_peered":"2023-05-17T11:46:41.779597+0000","last_unstale":"2023-05-17T11:46:41.787625+0000","last_undegraded":"2023-05-17T11:46:41.787625+0000","last_fullsized":"2023-05-17T11:46:41.787625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:28:19.336212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754722+0000","last_change":"2023-05-17T11:46:41.385770+0000","last_active":"2023-05-17T11:46:41.754722+0000","last_peered":"2023-05-17T11:46:41.754722+0000","last_clean":"2023-05-17T11:46:41.754722+0000","last_became_active":"2023-05-17T11:46:41.384990+0000","last_became_peered":"2023-05-17T11:46:41.384990+0000","last_unstale":"2023-05-17T11:46:41.754722+0000","last_undegraded":"2023-05-17T11:46:41.754722+0000","last_fullsized":"2023-05-17T11:46:41.754722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:28:18.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786005+0000","last_change":"2023-05-17T11:46:41.781809+0000","last_active":"2023-05-17T11:46:41.786005+0000","last_peered":"2023-05-17T11:46:41.786005+0000","last_clean":"2023-05-17T11:46:41.786005+0000","last_became_active":"2023-05-17T11:46:41.781557+0000","last_became_peered":"2023-05-17T11:46:41.781557+0000","last_unstale":"2023-05-17T11:46:41.786005+0000","last_undegraded":"2023-05-17T11:46:41.786005+0000","last_fullsized":"2023-05-17T11:46:41.786005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:37:03.653549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791951+0000","last_change":"2023-05-17T11:46:41.378340+0000","last_active":"2023-05-17T11:46:41.791951+0000","last_peered":"2023-05-17T11:46:41.791951+0000","last_clean":"2023-05-17T11:46:41.791951+0000","last_became_active":"2023-05-17T11:46:41.378054+0000","last_became_peered":"2023-05-17T11:46:41.378054+0000","last_unstale":"2023-05-17T11:46:41.791951+0000","last_undegraded":"2023-05-17T11:46:41.791951+0000","last_fullsized":"2023-05-17T11:46:41.791951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:20:34.121121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.776671+0000","last_change":"2023-05-17T11:46:41.772420+0000","last_active":"2023-05-17T11:46:41.776671+0000","last_peered":"2023-05-17T11:46:41.776671+0000","last_clean":"2023-05-17T11:46:41.776671+0000","last_became_active":"2023-05-17T11:46:41.772109+0000","last_became_peered":"2023-05-17T11:46:41.772109+0000","last_unstale":"2023-05-17T11:46:41.776671+0000","last_undegraded":"2023-05-17T11:46:41.776671+0000","last_fullsized":"2023-05-17T11:46:41.776671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:38:58.301353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793781+0000","last_change":"2023-05-17T11:46:41.379696+0000","last_active":"2023-05-17T11:46:41.793781+0000","last_peered":"2023-05-17T11:46:41.793781+0000","last_clean":"2023-05-17T11:46:41.793781+0000","last_became_active":"2023-05-17T11:46:41.379434+0000","last_became_peered":"2023-05-17T11:46:41.379434+0000","last_unstale":"2023-05-17T11:46:41.793781+0000","last_undegraded":"2023-05-17T11:46:41.793781+0000","last_fullsized":"2023-05-17T11:46:41.793781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:14:18.860400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.779294+0000","last_change":"2023-05-17T11:46:41.774720+0000","last_active":"2023-05-17T11:46:41.779294+0000","last_peered":"2023-05-17T11:46:41.779294+0000","last_clean":"2023-05-17T11:46:41.779294+0000","last_became_active":"2023-05-17T11:46:41.774432+0000","last_became_peered":"2023-05-17T11:46:41.774432+0000","last_unstale":"2023-05-17T11:46:41.779294+0000","last_undegraded":"2023-05-17T11:46:41.779294+0000","last_fullsized":"2023-05-17T11:46:41.779294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:02:40.178044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786438+0000","last_change":"2023-05-17T11:46:41.380390+0000","last_active":"2023-05-17T11:46:41.786438+0000","last_peered":"2023-05-17T11:46:41.786438+0000","last_clean":"2023-05-17T11:46:41.786438+0000","last_became_active":"2023-05-17T11:46:41.380098+0000","last_became_peered":"2023-05-17T11:46:41.380098+0000","last_unstale":"2023-05-17T11:46:41.786438+0000","last_undegraded":"2023-05-17T11:46:41.786438+0000","last_fullsized":"2023-05-17T11:46:41.786438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:28:18.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786218+0000","last_change":"2023-05-17T11:46:41.781261+0000","last_active":"2023-05-17T11:46:41.786218+0000","last_peered":"2023-05-17T11:46:41.786218+0000","last_clean":"2023-05-17T11:46:41.786218+0000","last_became_active":"2023-05-17T11:46:41.780963+0000","last_became_peered":"2023-05-17T11:46:41.780963+0000","last_unstale":"2023-05-17T11:46:41.786218+0000","last_undegraded":"2023-05-17T11:46:41.786218+0000","last_fullsized":"2023-05-17T11:46:41.786218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:53:01.125693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.753526+0000","last_change":"2023-05-17T11:46:41.385862+0000","last_active":"2023-05-17T11:46:41.753526+0000","last_peered":"2023-05-17T11:46:41.753526+0000","last_clean":"2023-05-17T11:46:41.753526+0000","last_became_active":"2023-05-17T11:46:41.385643+0000","last_became_peered":"2023-05-17T11:46:41.385643+0000","last_unstale":"2023-05-17T11:46:41.753526+0000","last_undegraded":"2023-05-17T11:46:41.753526+0000","last_fullsized":"2023-05-17T11:46:41.753526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:40:56.870310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791285+0000","last_change":"2023-05-17T11:46:41.783643+0000","last_active":"2023-05-17T11:46:41.791285+0000","last_peered":"2023-05-17T11:46:41.791285+0000","last_clean":"2023-05-17T11:46:41.791285+0000","last_became_active":"2023-05-17T11:46:41.783233+0000","last_became_peered":"2023-05-17T11:46:41.783233+0000","last_unstale":"2023-05-17T11:46:41.791285+0000","last_undegraded":"2023-05-17T11:46:41.791285+0000","last_fullsized":"2023-05-17T11:46:41.791285+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:57.088772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754290+0000","last_change":"2023-05-17T11:46:41.376867+0000","last_active":"2023-05-17T11:46:41.754290+0000","last_peered":"2023-05-17T11:46:41.754290+0000","last_clean":"2023-05-17T11:46:41.754290+0000","last_became_active":"2023-05-17T11:46:41.376548+0000","last_became_peered":"2023-05-17T11:46:41.376548+0000","last_unstale":"2023-05-17T11:46:41.754290+0000","last_undegraded":"2023-05-17T11:46:41.754290+0000","last_fullsized":"2023-05-17T11:46:41.754290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:29:19.726681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787712+0000","last_change":"2023-05-17T11:46:41.784281+0000","last_active":"2023-05-17T11:46:41.787712+0000","last_peered":"2023-05-17T11:46:41.787712+0000","last_clean":"2023-05-17T11:46:41.787712+0000","last_became_active":"2023-05-17T11:46:41.784013+0000","last_became_peered":"2023-05-17T11:46:41.784013+0000","last_unstale":"2023-05-17T11:46:41.787712+0000","last_undegraded":"2023-05-17T11:46:41.787712+0000","last_fullsized":"2023-05-17T11:46:41.787712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:59:21.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793083+0000","last_change":"2023-05-17T11:46:41.380881+0000","last_active":"2023-05-17T11:46:41.793083+0000","last_peered":"2023-05-17T11:46:41.793083+0000","last_clean":"2023-05-17T11:46:41.793083+0000","last_became_active":"2023-05-17T11:46:41.380410+0000","last_became_peered":"2023-05-17T11:46:41.380410+0000","last_unstale":"2023-05-17T11:46:41.793083+0000","last_undegraded":"2023-05-17T11:46:41.793083+0000","last_fullsized":"2023-05-17T11:46:41.793083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:59:20.278177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786554+0000","last_change":"2023-05-17T11:46:41.777346+0000","last_active":"2023-05-17T11:46:41.786554+0000","last_peered":"2023-05-17T11:46:41.786554+0000","last_clean":"2023-05-17T11:46:41.786554+0000","last_became_active":"2023-05-17T11:46:41.777067+0000","last_became_peered":"2023-05-17T11:46:41.777067+0000","last_unstale":"2023-05-17T11:46:41.786554+0000","last_undegraded":"2023-05-17T11:46:41.786554+0000","last_fullsized":"2023-05-17T11:46:41.786554+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:26:22.624438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787789+0000","last_change":"2023-05-17T11:46:41.383786+0000","last_active":"2023-05-17T11:46:41.787789+0000","last_peered":"2023-05-17T11:46:41.787789+0000","last_clean":"2023-05-17T11:46:41.787789+0000","last_became_active":"2023-05-17T11:46:41.379606+0000","last_became_peered":"2023-05-17T11:46:41.379606+0000","last_unstale":"2023-05-17T11:46:41.787789+0000","last_undegraded":"2023-05-17T11:46:41.787789+0000","last_fullsized":"2023-05-17T11:46:41.787789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:54:01.047138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792028+0000","last_change":"2023-05-17T11:46:41.778037+0000","last_active":"2023-05-17T11:46:41.792028+0000","last_peered":"2023-05-17T11:46:41.792028+0000","last_clean":"2023-05-17T11:46:41.792028+0000","last_became_active":"2023-05-17T11:46:41.777755+0000","last_became_peered":"2023-05-17T11:46:41.777755+0000","last_unstale":"2023-05-17T11:46:41.792028+0000","last_undegraded":"2023-05-17T11:46:41.792028+0000","last_fullsized":"2023-05-17T11:46:41.792028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:46:35.152312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792329+0000","last_change":"2023-05-17T11:46:41.382725+0000","last_active":"2023-05-17T11:46:41.792329+0000","last_peered":"2023-05-17T11:46:41.792329+0000","last_clean":"2023-05-17T11:46:41.792329+0000","last_became_active":"2023-05-17T11:46:41.382436+0000","last_became_peered":"2023-05-17T11:46:41.382436+0000","last_unstale":"2023-05-17T11:46:41.792329+0000","last_undegraded":"2023-05-17T11:46:41.792329+0000","last_fullsized":"2023-05-17T11:46:41.792329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:33:30.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.770871+0000","last_change":"2023-05-17T11:46:41.767519+0000","last_active":"2023-05-17T11:46:41.770871+0000","last_peered":"2023-05-17T11:46:41.770871+0000","last_clean":"2023-05-17T11:46:41.770871+0000","last_became_active":"2023-05-17T11:46:41.767185+0000","last_became_peered":"2023-05-17T11:46:41.767185+0000","last_unstale":"2023-05-17T11:46:41.770871+0000","last_undegraded":"2023-05-17T11:46:41.770871+0000","last_fullsized":"2023-05-17T11:46:41.770871+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:50:24.439106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787722+0000","last_change":"2023-05-17T11:46:41.380798+0000","last_active":"2023-05-17T11:46:41.787722+0000","last_peered":"2023-05-17T11:46:41.787722+0000","last_clean":"2023-05-17T11:46:41.787722+0000","last_became_active":"2023-05-17T11:46:41.380491+0000","last_became_peered":"2023-05-17T11:46:41.380491+0000","last_unstale":"2023-05-17T11:46:41.787722+0000","last_undegraded":"2023-05-17T11:46:41.787722+0000","last_fullsized":"2023-05-17T11:46:41.787722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:29:19.726681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.784035+0000","last_change":"2023-05-17T11:46:41.781295+0000","last_active":"2023-05-17T11:46:41.784035+0000","last_peered":"2023-05-17T11:46:41.784035+0000","last_clean":"2023-05-17T11:46:41.784035+0000","last_became_active":"2023-05-17T11:46:41.781006+0000","last_became_peered":"2023-05-17T11:46:41.781006+0000","last_unstale":"2023-05-17T11:46:41.784035+0000","last_undegraded":"2023-05-17T11:46:41.784035+0000","last_fullsized":"2023-05-17T11:46:41.784035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:00:45.169656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754133+0000","last_change":"2023-05-17T11:46:41.377082+0000","last_active":"2023-05-17T11:46:41.754133+0000","last_peered":"2023-05-17T11:46:41.754133+0000","last_clean":"2023-05-17T11:46:41.754133+0000","last_became_active":"2023-05-17T11:46:41.376773+0000","last_became_peered":"2023-05-17T11:46:41.376773+0000","last_unstale":"2023-05-17T11:46:41.754133+0000","last_undegraded":"2023-05-17T11:46:41.754133+0000","last_fullsized":"2023-05-17T11:46:41.754133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:02:39.174704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.785183+0000","last_change":"2023-05-17T11:46:41.768105+0000","last_active":"2023-05-17T11:46:41.785183+0000","last_peered":"2023-05-17T11:46:41.785183+0000","last_clean":"2023-05-17T11:46:41.785183+0000","last_became_active":"2023-05-17T11:46:41.767656+0000","last_became_peered":"2023-05-17T11:46:41.767656+0000","last_unstale":"2023-05-17T11:46:41.785183+0000","last_undegraded":"2023-05-17T11:46:41.785183+0000","last_fullsized":"2023-05-17T11:46:41.785183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:14:19.863740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.778934+0000","last_change":"2023-05-17T11:46:41.376654+0000","last_active":"2023-05-17T11:46:41.778934+0000","last_peered":"2023-05-17T11:46:41.778934+0000","last_clean":"2023-05-17T11:46:41.778934+0000","last_became_active":"2023-05-17T11:46:41.376386+0000","last_became_peered":"2023-05-17T11:46:41.376386+0000","last_unstale":"2023-05-17T11:46:41.778934+0000","last_undegraded":"2023-05-17T11:46:41.778934+0000","last_fullsized":"2023-05-17T11:46:41.778934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:24:22.722987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786016+0000","last_change":"2023-05-17T11:46:41.781864+0000","last_active":"2023-05-17T11:46:41.786016+0000","last_peered":"2023-05-17T11:46:41.786016+0000","last_clean":"2023-05-17T11:46:41.786016+0000","last_became_active":"2023-05-17T11:46:41.781605+0000","last_became_peered":"2023-05-17T11:46:41.781605+0000","last_unstale":"2023-05-17T11:46:41.786016+0000","last_undegraded":"2023-05-17T11:46:41.786016+0000","last_fullsized":"2023-05-17T11:46:41.786016+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:50:39.845325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.752135+0000","last_change":"2023-05-17T11:46:41.374773+0000","last_active":"2023-05-17T11:46:41.752135+0000","last_peered":"2023-05-17T11:46:41.752135+0000","last_clean":"2023-05-17T11:46:41.752135+0000","last_became_active":"2023-05-17T11:46:41.374450+0000","last_became_peered":"2023-05-17T11:46:41.374450+0000","last_unstale":"2023-05-17T11:46:41.752135+0000","last_undegraded":"2023-05-17T11:46:41.752135+0000","last_fullsized":"2023-05-17T11:46:41.752135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:33:57.239002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792067+0000","last_change":"2023-05-17T11:46:41.777413+0000","last_active":"2023-05-17T11:46:41.792067+0000","last_peered":"2023-05-17T11:46:41.792067+0000","last_clean":"2023-05-17T11:46:41.792067+0000","last_became_active":"2023-05-17T11:46:41.774133+0000","last_became_peered":"2023-05-17T11:46:41.774133+0000","last_unstale":"2023-05-17T11:46:41.792067+0000","last_undegraded":"2023-05-17T11:46:41.792067+0000","last_fullsized":"2023-05-17T11:46:41.792067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:38:35.471164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.760844+0000","last_change":"2023-05-17T11:46:41.378204+0000","last_active":"2023-05-17T11:46:41.760844+0000","last_peered":"2023-05-17T11:46:41.760844+0000","last_clean":"2023-05-17T11:46:41.760844+0000","last_became_active":"2023-05-17T11:46:41.377919+0000","last_became_peered":"2023-05-17T11:46:41.377919+0000","last_unstale":"2023-05-17T11:46:41.760844+0000","last_undegraded":"2023-05-17T11:46:41.760844+0000","last_fullsized":"2023-05-17T11:46:41.760844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:53:00.122353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790205+0000","last_change":"2023-05-17T11:46:41.788881+0000","last_active":"2023-05-17T11:46:41.790205+0000","last_peered":"2023-05-17T11:46:41.790205+0000","last_clean":"2023-05-17T11:46:41.790205+0000","last_became_active":"2023-05-17T11:46:41.788296+0000","last_became_peered":"2023-05-17T11:46:41.788296+0000","last_unstale":"2023-05-17T11:46:41.790205+0000","last_undegraded":"2023-05-17T11:46:41.790205+0000","last_fullsized":"2023-05-17T11:46:41.790205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:13.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.751856+0000","last_change":"2023-05-17T11:46:41.377511+0000","last_active":"2023-05-17T11:46:41.751856+0000","last_peered":"2023-05-17T11:46:41.751856+0000","last_clean":"2023-05-17T11:46:41.751856+0000","last_became_active":"2023-05-17T11:46:41.376099+0000","last_became_peered":"2023-05-17T11:46:41.376099+0000","last_unstale":"2023-05-17T11:46:41.751856+0000","last_undegraded":"2023-05-17T11:46:41.751856+0000","last_fullsized":"2023-05-17T11:46:41.751856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:35:44.270303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792089+0000","last_change":"2023-05-17T11:46:41.784356+0000","last_active":"2023-05-17T11:46:41.792089+0000","last_peered":"2023-05-17T11:46:41.792089+0000","last_clean":"2023-05-17T11:46:41.792089+0000","last_became_active":"2023-05-17T11:46:41.783840+0000","last_became_peered":"2023-05-17T11:46:41.783840+0000","last_unstale":"2023-05-17T11:46:41.792089+0000","last_undegraded":"2023-05-17T11:46:41.792089+0000","last_fullsized":"2023-05-17T11:46:41.792089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:28.677161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.762734+0000","last_change":"2023-05-17T11:46:41.383820+0000","last_active":"2023-05-17T11:46:41.762734+0000","last_peered":"2023-05-17T11:46:41.762734+0000","last_clean":"2023-05-17T11:46:41.762734+0000","last_became_active":"2023-05-17T11:46:41.383493+0000","last_became_peered":"2023-05-17T11:46:41.383493+0000","last_unstale":"2023-05-17T11:46:41.762734+0000","last_undegraded":"2023-05-17T11:46:41.762734+0000","last_fullsized":"2023-05-17T11:46:41.762734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:25.070481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.759808+0000","last_change":"2023-05-17T11:45:23.894807+0000","last_active":"2023-05-17T11:46:41.759808+0000","last_peered":"2023-05-17T11:46:41.759808+0000","last_clean":"2023-05-17T11:46:41.759808+0000","last_became_active":"2023-05-17T11:45:23.894516+0000","last_became_peered":"2023-05-17T11:45:23.894516+0000","last_unstale":"2023-05-17T11:46:41.759808+0000","last_undegraded":"2023-05-17T11:46:41.759808+0000","last_fullsized":"2023-05-17T11:46:41.759808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_clean_scrub_stamp":"2023-05-17T11:45:22.596969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:35:50.727386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.756873+0000","last_change":"2023-05-17T11:45:30.089866+0000","last_active":"2023-05-17T11:46:41.756873+0000","last_peered":"2023-05-17T11:46:41.756873+0000","last_clean":"2023-05-17T11:46:41.756873+0000","last_became_active":"2023-05-17T11:45:30.089207+0000","last_became_peered":"2023-05-17T11:45:30.089207+0000","last_unstale":"2023-05-17T11:46:41.756873+0000","last_undegraded":"2023-05-17T11:46:41.756873+0000","last_fullsized":"2023-05-17T11:46:41.756873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:12.159288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790491+0000","last_change":"2023-05-17T11:46:41.788546+0000","last_active":"2023-05-17T11:46:41.790491+0000","last_peered":"2023-05-17T11:46:41.790491+0000","last_clean":"2023-05-17T11:46:41.790491+0000","last_became_active":"2023-05-17T11:46:41.788244+0000","last_became_peered":"2023-05-17T11:46:41.788244+0000","last_unstale":"2023-05-17T11:46:41.790491+0000","last_undegraded":"2023-05-17T11:46:41.790491+0000","last_fullsized":"2023-05-17T11:46:41.790491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:28:31.544396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787713+0000","last_change":"2023-05-17T11:46:41.385079+0000","last_active":"2023-05-17T11:46:41.787713+0000","last_peered":"2023-05-17T11:46:41.787713+0000","last_clean":"2023-05-17T11:46:41.787713+0000","last_became_active":"2023-05-17T11:46:41.384766+0000","last_became_peered":"2023-05-17T11:46:41.384766+0000","last_unstale":"2023-05-17T11:46:41.787713+0000","last_undegraded":"2023-05-17T11:46:41.787713+0000","last_fullsized":"2023-05-17T11:46:41.787713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:47:10.069177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.759399+0000","last_change":"2023-05-17T11:45:30.093107+0000","last_active":"2023-05-17T11:46:41.759399+0000","last_peered":"2023-05-17T11:46:41.759399+0000","last_clean":"2023-05-17T11:46:41.759399+0000","last_became_active":"2023-05-17T11:45:30.092684+0000","last_became_peered":"2023-05-17T11:45:30.092684+0000","last_unstale":"2023-05-17T11:46:41.759399+0000","last_undegraded":"2023-05-17T11:46:41.759399+0000","last_fullsized":"2023-05-17T11:46:41.759399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:29.673706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787644+0000","last_change":"2023-05-17T11:46:41.780382+0000","last_active":"2023-05-17T11:46:41.787644+0000","last_peered":"2023-05-17T11:46:41.787644+0000","last_clean":"2023-05-17T11:46:41.787644+0000","last_became_active":"2023-05-17T11:46:41.779897+0000","last_became_peered":"2023-05-17T11:46:41.779897+0000","last_unstale":"2023-05-17T11:46:41.787644+0000","last_undegraded":"2023-05-17T11:46:41.787644+0000","last_fullsized":"2023-05-17T11:46:41.787644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:25.513081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.753033+0000","last_change":"2023-05-17T11:46:41.381397+0000","last_active":"2023-05-17T11:46:41.753033+0000","last_peered":"2023-05-17T11:46:41.753033+0000","last_clean":"2023-05-17T11:46:41.753033+0000","last_became_active":"2023-05-17T11:46:41.381135+0000","last_became_peered":"2023-05-17T11:46:41.381135+0000","last_unstale":"2023-05-17T11:46:41.753033+0000","last_undegraded":"2023-05-17T11:46:41.753033+0000","last_fullsized":"2023-05-17T11:46:41.753033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:04.390228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.751951+0000","last_change":"2023-05-17T11:45:30.096072+0000","last_active":"2023-05-17T11:46:41.751951+0000","last_peered":"2023-05-17T11:46:41.751951+0000","last_clean":"2023-05-17T11:46:41.751951+0000","last_became_active":"2023-05-17T11:45:30.095647+0000","last_became_peered":"2023-05-17T11:45:30.095647+0000","last_unstale":"2023-05-17T11:46:41.751951+0000","last_undegraded":"2023-05-17T11:46:41.751951+0000","last_fullsized":"2023-05-17T11:46:41.751951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:34:37.536490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786125+0000","last_change":"2023-05-17T11:46:41.780504+0000","last_active":"2023-05-17T11:46:41.786125+0000","last_peered":"2023-05-17T11:46:41.786125+0000","last_clean":"2023-05-17T11:46:41.786125+0000","last_became_active":"2023-05-17T11:46:41.779673+0000","last_became_peered":"2023-05-17T11:46:41.779673+0000","last_unstale":"2023-05-17T11:46:41.786125+0000","last_undegraded":"2023-05-17T11:46:41.786125+0000","last_fullsized":"2023-05-17T11:46:41.786125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:03:17.779688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755952+0000","last_change":"2023-05-17T11:46:41.375555+0000","last_active":"2023-05-17T11:46:41.755952+0000","last_peered":"2023-05-17T11:46:41.755952+0000","last_clean":"2023-05-17T11:46:41.755952+0000","last_became_active":"2023-05-17T11:46:41.375256+0000","last_became_peered":"2023-05-17T11:46:41.375256+0000","last_unstale":"2023-05-17T11:46:41.755952+0000","last_undegraded":"2023-05-17T11:46:41.755952+0000","last_fullsized":"2023-05-17T11:46:41.755952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:21.747445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754324+0000","last_change":"2023-05-17T11:45:30.084716+0000","last_active":"2023-05-17T11:46:41.754324+0000","last_peered":"2023-05-17T11:46:41.754324+0000","last_clean":"2023-05-17T11:46:41.754324+0000","last_became_active":"2023-05-17T11:45:30.084340+0000","last_became_peered":"2023-05-17T11:45:30.084340+0000","last_unstale":"2023-05-17T11:46:41.754324+0000","last_undegraded":"2023-05-17T11:46:41.754324+0000","last_fullsized":"2023-05-17T11:46:41.754324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:01:44.808955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786042+0000","last_change":"2023-05-17T11:46:41.781497+0000","last_active":"2023-05-17T11:46:41.786042+0000","last_peered":"2023-05-17T11:46:41.786042+0000","last_clean":"2023-05-17T11:46:41.786042+0000","last_became_active":"2023-05-17T11:46:41.781240+0000","last_became_peered":"2023-05-17T11:46:41.781240+0000","last_unstale":"2023-05-17T11:46:41.786042+0000","last_undegraded":"2023-05-17T11:46:41.786042+0000","last_fullsized":"2023-05-17T11:46:41.786042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:54.714061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755316+0000","last_change":"2023-05-17T11:46:41.372348+0000","last_active":"2023-05-17T11:46:41.755316+0000","last_peered":"2023-05-17T11:46:41.755316+0000","last_clean":"2023-05-17T11:46:41.755316+0000","last_became_active":"2023-05-17T11:46:41.372011+0000","last_became_peered":"2023-05-17T11:46:41.372011+0000","last_unstale":"2023-05-17T11:46:41.755316+0000","last_undegraded":"2023-05-17T11:46:41.755316+0000","last_fullsized":"2023-05-17T11:46:41.755316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:28:30.541056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754206+0000","last_change":"2023-05-17T11:45:30.647020+0000","last_active":"2023-05-17T11:46:41.754206+0000","last_peered":"2023-05-17T11:46:41.754206+0000","last_clean":"2023-05-17T11:46:41.754206+0000","last_became_active":"2023-05-17T11:45:30.646621+0000","last_became_peered":"2023-05-17T11:45:30.646621+0000","last_unstale":"2023-05-17T11:46:41.754206+0000","last_undegraded":"2023-05-17T11:46:41.754206+0000","last_fullsized":"2023-05-17T11:46:41.754206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:49:27.565508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.763009+0000","last_change":"2023-05-17T11:46:41.761633+0000","last_active":"2023-05-17T11:46:41.763009+0000","last_peered":"2023-05-17T11:46:41.763009+0000","last_clean":"2023-05-17T11:46:41.763009+0000","last_became_active":"2023-05-17T11:46:41.761283+0000","last_became_peered":"2023-05-17T11:46:41.761283+0000","last_unstale":"2023-05-17T11:46:41.763009+0000","last_undegraded":"2023-05-17T11:46:41.763009+0000","last_fullsized":"2023-05-17T11:46:41.763009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:34:01.644443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754430+0000","last_change":"2023-05-17T11:46:41.377179+0000","last_active":"2023-05-17T11:46:41.754430+0000","last_peered":"2023-05-17T11:46:41.754430+0000","last_clean":"2023-05-17T11:46:41.754430+0000","last_became_active":"2023-05-17T11:46:41.374816+0000","last_became_peered":"2023-05-17T11:46:41.374816+0000","last_unstale":"2023-05-17T11:46:41.754430+0000","last_undegraded":"2023-05-17T11:46:41.754430+0000","last_fullsized":"2023-05-17T11:46:41.754430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:04.390228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.763017+0000","last_change":"2023-05-17T11:45:30.647758+0000","last_active":"2023-05-17T11:46:41.763017+0000","last_peered":"2023-05-17T11:46:41.763017+0000","last_clean":"2023-05-17T11:46:41.763017+0000","last_became_active":"2023-05-17T11:45:30.647423+0000","last_became_peered":"2023-05-17T11:45:30.647423+0000","last_unstale":"2023-05-17T11:46:41.763017+0000","last_undegraded":"2023-05-17T11:46:41.763017+0000","last_fullsized":"2023-05-17T11:46:41.763017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:46.021536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.784353+0000","last_change":"2023-05-17T11:46:41.781607+0000","last_active":"2023-05-17T11:46:41.784353+0000","last_peered":"2023-05-17T11:46:41.784353+0000","last_clean":"2023-05-17T11:46:41.784353+0000","last_became_active":"2023-05-17T11:46:41.781179+0000","last_became_peered":"2023-05-17T11:46:41.781179+0000","last_unstale":"2023-05-17T11:46:41.784353+0000","last_undegraded":"2023-05-17T11:46:41.784353+0000","last_fullsized":"2023-05-17T11:46:41.784353+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:47:11.072517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768128+0000","last_change":"2023-05-17T11:46:41.379594+0000","last_active":"2023-05-17T11:46:41.768128+0000","last_peered":"2023-05-17T11:46:41.768128+0000","last_clean":"2023-05-17T11:46:41.768128+0000","last_became_active":"2023-05-17T11:46:41.379283+0000","last_became_peered":"2023-05-17T11:46:41.379283+0000","last_unstale":"2023-05-17T11:46:41.768128+0000","last_undegraded":"2023-05-17T11:46:41.768128+0000","last_fullsized":"2023-05-17T11:46:41.768128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:20:34.121121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755387+0000","last_change":"2023-05-17T11:45:30.087244+0000","last_active":"2023-05-17T11:46:41.755387+0000","last_peered":"2023-05-17T11:46:41.755387+0000","last_clean":"2023-05-17T11:46:41.755387+0000","last_became_active":"2023-05-17T11:45:30.086890+0000","last_became_peered":"2023-05-17T11:45:30.086890+0000","last_unstale":"2023-05-17T11:46:41.755387+0000","last_undegraded":"2023-05-17T11:46:41.755387+0000","last_fullsized":"2023-05-17T11:46:41.755387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:13:02.364778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787905+0000","last_change":"2023-05-17T11:46:41.780421+0000","last_active":"2023-05-17T11:46:41.787905+0000","last_peered":"2023-05-17T11:46:41.787905+0000","last_clean":"2023-05-17T11:46:41.787905+0000","last_became_active":"2023-05-17T11:46:41.780098+0000","last_became_peered":"2023-05-17T11:46:41.780098+0000","last_unstale":"2023-05-17T11:46:41.787905+0000","last_undegraded":"2023-05-17T11:46:41.787905+0000","last_fullsized":"2023-05-17T11:46:41.787905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:46:35.152312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.769785+0000","last_change":"2023-05-17T11:46:41.378221+0000","last_active":"2023-05-17T11:46:41.769785+0000","last_peered":"2023-05-17T11:46:41.769785+0000","last_clean":"2023-05-17T11:46:41.769785+0000","last_became_active":"2023-05-17T11:46:41.377900+0000","last_became_peered":"2023-05-17T11:46:41.377900+0000","last_unstale":"2023-05-17T11:46:41.769785+0000","last_undegraded":"2023-05-17T11:46:41.769785+0000","last_fullsized":"2023-05-17T11:46:41.769785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:46:34.148972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755989+0000","last_change":"2023-05-17T11:45:30.088456+0000","last_active":"2023-05-17T11:46:41.755989+0000","last_peered":"2023-05-17T11:46:41.755989+0000","last_clean":"2023-05-17T11:46:41.755989+0000","last_became_active":"2023-05-17T11:45:30.088082+0000","last_became_peered":"2023-05-17T11:45:30.088082+0000","last_unstale":"2023-05-17T11:46:41.755989+0000","last_undegraded":"2023-05-17T11:46:41.755989+0000","last_fullsized":"2023-05-17T11:46:41.755989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:55:11.039331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13676,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358164,"statfs":{"total":96636764160,"available":96622759936,"internally_reserved":0,"allocated":1019904,"data_stored":760729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.745}]},{"osd":2,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.877}]},{"osd":4,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78700000000000003}]},{"osd":5,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.96199999999999997}]},{"osd":6,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":413696,"data_stored":169309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.73099999999999998}]},{"osd":1,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73699999999999999}]},{"osd":4,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.504},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.68000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12504,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359336,"statfs":{"total":96636764160,"available":96623960064,"internally_reserved":0,"allocated":409600,"data_stored":168727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.629}]},{"osd":2,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.72999999999999998}]},{"osd":4,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.745}]},{"osd":7,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12704,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359136,"statfs":{"total":96636764160,"available":96623755264,"internally_reserved":0,"allocated":417792,"data_stored":169331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.745}]},{"osd":3,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":425984,"data_stored":170325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.436}]},{"osd":1,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.46400000000000002}]},{"osd":2,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.628}]},{"osd":6,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":413696,"data_stored":168797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.433}]},{"osd":4,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.752}]},{"osd":7,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.83599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":168817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.439}]},{"osd":4,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.69199999999999995}]},{"osd":5,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":751967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.505},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T11:46:45.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T11:46:46.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e3762d640 1 Processor -- start 2023-05-17T11:46:46.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e3762d640 1 -- start start 2023-05-17T11:46:46.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e3762d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e30065690 0x7f3e3006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e3762d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e30158d20 con 0x7f3e30071040 2023-05-17T11:46:46.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e3762d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3015cce0 con 0x7f3e301588d0 2023-05-17T11:46:46.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e3762d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3015cfc0 con 0x7f3e30065690 2023-05-17T11:46:46.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e353c9640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3e30071040 0x7f3e30069ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57126/0 (socket says 172.21.15.3:57126) 2023-05-17T11:46:46.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e353c9640 1 -- 172.21.15.3:0/3280776734 learned_addr learned my addr 172.21.15.3:0/3280776734 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:46.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3280776734 >> v2:172.21.15.60:3300/0 conn(0x7f3e30065690 0x7f3e3006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401504877 0 0) 0x7f3e30158d20 con 0x7f3e30071040 2023-05-17T11:46:46.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e1c005740 con 0x7f3e30071040 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708061599 0 0) 0x7f3e3015cce0 con 0x7f3e301588d0 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e30158d20 con 0x7f3e301588d0 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2809635889 0 0) 0x7f3e1c005740 con 0x7f3e30071040 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 >> v2:172.21.15.60:3300/0 conn(0x7f3e30065690 msgr2=0x7f3e3006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 --2- 172.21.15.3:0/3280776734 >> v2:172.21.15.60:3300/0 conn(0x7f3e30065690 0x7f3e3006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 >> v1:172.21.15.60:6789/0 conn(0x7f3e301588d0 legacy=0x7f3e3015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3015d2a0 con 0x7f3e30071040 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f3e2c001680 con 0x7f3e30071040 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 >> v1:172.21.15.3:6789/0 conn(0x7f3e30071040 legacy=0x7f3e30069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e1c005d90 0x7f3e1c006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0069e0 0x7f3e1c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e1c007390 0x7f3e1c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3015cfc0 con 0x7f3e1c007390 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c00e270 con 0x7f3e1c0069e0 2023-05-17T11:46:46.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c00e430 con 0x7f3e1c005d90 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e1c007390 0x7f3e1c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e353c9640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e1c005d90 0x7f3e1c006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e34bc8640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0069e0 0x7f3e1c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 -- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e1c005d90 msgr2=0x7f3e1c006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e1c005d90 0x7f3e1c006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 -- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0069e0 msgr2=0x7f3e1c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0069e0 0x7f3e1c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e35bca640 1 -- 172.21.15.3:0/3280776734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c005740 con 0x7f3e1c007390 2023-05-17T11:46:46.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e353c9640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e1c005d90 0x7f3e1c006180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:46.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.006+0000 7f3e34bc8640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0069e0 0x7f3e1c006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:46.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e35bca640 1 -- 172.21.15.3:0/3280776734 reap_dead start 2023-05-17T11:46:46.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e1c007390 0x7f3e1c00dba0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009f90 tx=0x7f3e2801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee47905f83166e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28003ba0 con 0x7f3e1c007390 2023-05-17T11:46:46.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2800f040 con 0x7f3e1c007390 2023-05-17T11:46:46.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e27fff640 1 -- 172.21.15.3:0/3280776734 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280a5960 con 0x7f3e1c007390 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 -- 172.21.15.3:0/3280776734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e1c007390 msgr2=0x7f3e1c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e1c007390 0x7f3e1c00dba0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009f90 tx=0x7f3e2801cc60 comp rx=0 tx=0).stop 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 -- 172.21.15.3:0/3280776734 shutdown_connections 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3280776734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e1c007390 0x7f3e1c00dba0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 -- 172.21.15.3:0/3280776734 >> 172.21.15.3:0/3280776734 conn(0x7f3e300b1530 msgr2=0x7f3e300cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 -- 172.21.15.3:0/3280776734 shutdown_connections 2023-05-17T11:46:46.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.010+0000 7f3e3762d640 1 -- 172.21.15.3:0/3280776734 wait complete. 2023-05-17T11:46:46.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 Processor -- start 2023-05-17T11:46:46.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 -- start start 2023-05-17T11:46:46.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c007390 0x7f3e30159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e30153b30 0x7f3e300b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 0x7f3e301f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300af5f0 con 0x7f3e30153fa0 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3015a0b0 con 0x7f3e1c007390 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300b3240 con 0x7f3e30153b30 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 0x7f3e301f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 0x7f3e301f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55566/0 (socket says 172.21.15.3:55566) 2023-05-17T11:46:46.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 -- 172.21.15.3:0/3886857342 learned_addr learned my addr 172.21.15.3:0/3886857342 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e353c9640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c007390 0x7f3e30159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e34bc8640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e30153b30 0x7f3e300b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 -- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e30153b30 msgr2=0x7f3e300b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e30153b30 0x7f3e300b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 -- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c007390 msgr2=0x7f3e30159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c007390 0x7f3e30159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 -- 172.21.15.3:0/3886857342 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300c9600 con 0x7f3e30153fa0 2023-05-17T11:46:46.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e35bca640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 0x7f3e301f1960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e2801d500 tx=0x7f3e28009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280a5b60 con 0x7f3e30153fa0 2023-05-17T11:46:46.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e280a5cc0 con 0x7f3e30153fa0 2023-05-17T11:46:46.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e300c99e0 con 0x7f3e30153fa0 2023-05-17T11:46:46.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28004140 con 0x7f3e30153fa0 2023-05-17T11:46:46.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.014+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e300c9790 con 0x7f3e30153fa0 2023-05-17T11:46:46.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.018+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3004de80 con 0x7f3e30153fa0 2023-05-17T11:46:46.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.018+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e280042a0 con 0x7f3e30153fa0 2023-05-17T11:46:46.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.018+0000 7f3e25ffb640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e14066280 0x7f3e14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.018+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e2811ec30 con 0x7f3e30153fa0 2023-05-17T11:46:46.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.018+0000 7f3e353c9640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e14066280 0x7f3e14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.018+0000 7f3e353c9640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e14066280 0x7f3e14068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c10 tx=0x7f3e2c001c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.022+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3e280ec010 con 0x7f3e30153fa0 2023-05-17T11:46:46.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.174+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 --> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e300cf4b0 con 0x7f3e14066280 2023-05-17T11:46:46.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.182+0000 7f3e25ffb640 1 -- 172.21.15.3:0/3886857342 <== mgr.4110 v2:172.21.15.3:6832/2126677587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311153 (secure 0 0 0) 0x7f3e300cf4b0 con 0x7f3e14066280 2023-05-17T11:46:46.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:46.193 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-05-17T11:46:46.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e14066280 msgr2=0x7f3e14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e14066280 0x7f3e14068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c10 tx=0x7f3e2c001c50 comp rx=0 tx=0).stop 2023-05-17T11:46:46.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 msgr2=0x7f3e301f1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 0x7f3e301f1960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e2801d500 tx=0x7f3e28009750 comp rx=0 tx=0).stop 2023-05-17T11:46:46.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 shutdown_connections 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f3e14066280 0x7f3e14068730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e30153fa0 0x7f3e301f1960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f3e30153b30 0x7f3e300b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 --2- 172.21.15.3:0/3886857342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c007390 0x7f3e30159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 >> 172.21.15.3:0/3886857342 conn(0x7f3e300b1530 msgr2=0x7f3e3006a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 shutdown_connections 2023-05-17T11:46:46.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.186+0000 7f3e3762d640 1 -- 172.21.15.3:0/3886857342 wait complete. 2023-05-17T11:46:46.212 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-05-17T11:46:44.540126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":86128,"kb_used_data":4400,"kb_used_omap":0,"kb_used_meta":81664,"kb_avail":754888592,"statfs":{"total":773094113280,"available":773005918208,"internally_reserved":0,"allocated":4505600,"data_stored":2528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83623936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.192409"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786266+0000","last_change":"2023-05-17T11:46:41.780155+0000","last_active":"2023-05-17T11:46:41.786266+0000","last_peered":"2023-05-17T11:46:41.786266+0000","last_clean":"2023-05-17T11:46:41.786266+0000","last_became_active":"2023-05-17T11:46:41.779883+0000","last_became_peered":"2023-05-17T11:46:41.779883+0000","last_unstale":"2023-05-17T11:46:41.786266+0000","last_undegraded":"2023-05-17T11:46:41.786266+0000","last_fullsized":"2023-05-17T11:46:41.786266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:09.477889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786214+0000","last_change":"2023-05-17T11:46:41.780886+0000","last_active":"2023-05-17T11:46:41.786214+0000","last_peered":"2023-05-17T11:46:41.786214+0000","last_clean":"2023-05-17T11:46:41.786214+0000","last_became_active":"2023-05-17T11:46:41.780042+0000","last_became_peered":"2023-05-17T11:46:41.780042+0000","last_unstale":"2023-05-17T11:46:41.786214+0000","last_undegraded":"2023-05-17T11:46:41.786214+0000","last_fullsized":"2023-05-17T11:46:41.786214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:38:35.471164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.789364+0000","last_change":"2023-05-17T11:46:41.787516+0000","last_active":"2023-05-17T11:46:41.789364+0000","last_peered":"2023-05-17T11:46:41.789364+0000","last_clean":"2023-05-17T11:46:41.789364+0000","last_became_active":"2023-05-17T11:46:41.787246+0000","last_became_peered":"2023-05-17T11:46:41.787246+0000","last_unstale":"2023-05-17T11:46:41.789364+0000","last_undegraded":"2023-05-17T11:46:41.789364+0000","last_fullsized":"2023-05-17T11:46:41.789364+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:07:01.553055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.778888+0000","last_change":"2023-05-17T11:46:41.775300+0000","last_active":"2023-05-17T11:46:41.778888+0000","last_peered":"2023-05-17T11:46:41.778888+0000","last_clean":"2023-05-17T11:46:41.778888+0000","last_became_active":"2023-05-17T11:46:41.775029+0000","last_became_peered":"2023-05-17T11:46:41.775029+0000","last_unstale":"2023-05-17T11:46:41.778888+0000","last_undegraded":"2023-05-17T11:46:41.778888+0000","last_fullsized":"2023-05-17T11:46:41.778888+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:09:25.276960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.770565+0000","last_change":"2023-05-17T11:46:41.765620+0000","last_active":"2023-05-17T11:46:41.770565+0000","last_peered":"2023-05-17T11:46:41.770565+0000","last_clean":"2023-05-17T11:46:41.770565+0000","last_became_active":"2023-05-17T11:46:41.765271+0000","last_became_peered":"2023-05-17T11:46:41.765271+0000","last_unstale":"2023-05-17T11:46:41.770565+0000","last_undegraded":"2023-05-17T11:46:41.770565+0000","last_fullsized":"2023-05-17T11:46:41.770565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:18:22.343075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.781906+0000","last_change":"2023-05-17T11:46:41.780214+0000","last_active":"2023-05-17T11:46:41.781906+0000","last_peered":"2023-05-17T11:46:41.781906+0000","last_clean":"2023-05-17T11:46:41.781906+0000","last_became_active":"2023-05-17T11:46:41.779912+0000","last_became_peered":"2023-05-17T11:46:41.779912+0000","last_unstale":"2023-05-17T11:46:41.781906+0000","last_undegraded":"2023-05-17T11:46:41.781906+0000","last_fullsized":"2023-05-17T11:46:41.781906+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:54.714061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.794059+0000","last_change":"2023-05-17T11:46:41.787680+0000","last_active":"2023-05-17T11:46:41.794059+0000","last_peered":"2023-05-17T11:46:41.794059+0000","last_clean":"2023-05-17T11:46:41.794059+0000","last_became_active":"2023-05-17T11:46:41.787177+0000","last_became_peered":"2023-05-17T11:46:41.787177+0000","last_unstale":"2023-05-17T11:46:41.794059+0000","last_undegraded":"2023-05-17T11:46:41.794059+0000","last_fullsized":"2023-05-17T11:46:41.794059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:33:31.783031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793606+0000","last_change":"2023-05-17T11:46:41.792427+0000","last_active":"2023-05-17T11:46:41.793606+0000","last_peered":"2023-05-17T11:46:41.793606+0000","last_clean":"2023-05-17T11:46:41.793606+0000","last_became_active":"2023-05-17T11:46:41.792137+0000","last_became_peered":"2023-05-17T11:46:41.792137+0000","last_unstale":"2023-05-17T11:46:41.793606+0000","last_undegraded":"2023-05-17T11:46:41.793606+0000","last_fullsized":"2023-05-17T11:46:41.793606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:28.677161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.789898+0000","last_change":"2023-05-17T11:46:41.788343+0000","last_active":"2023-05-17T11:46:41.789898+0000","last_peered":"2023-05-17T11:46:41.789898+0000","last_clean":"2023-05-17T11:46:41.789898+0000","last_became_active":"2023-05-17T11:46:41.788086+0000","last_became_peered":"2023-05-17T11:46:41.788086+0000","last_unstale":"2023-05-17T11:46:41.789898+0000","last_undegraded":"2023-05-17T11:46:41.789898+0000","last_fullsized":"2023-05-17T11:46:41.789898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:13.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792061+0000","last_change":"2023-05-17T11:46:41.785036+0000","last_active":"2023-05-17T11:46:41.792061+0000","last_peered":"2023-05-17T11:46:41.792061+0000","last_clean":"2023-05-17T11:46:41.792061+0000","last_became_active":"2023-05-17T11:46:41.784748+0000","last_became_peered":"2023-05-17T11:46:41.784748+0000","last_unstale":"2023-05-17T11:46:41.792061+0000","last_undegraded":"2023-05-17T11:46:41.792061+0000","last_fullsized":"2023-05-17T11:46:41.792061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:10:03.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792005+0000","last_change":"2023-05-17T11:46:41.776387+0000","last_active":"2023-05-17T11:46:41.792005+0000","last_peered":"2023-05-17T11:46:41.792005+0000","last_clean":"2023-05-17T11:46:41.792005+0000","last_became_active":"2023-05-17T11:46:41.776093+0000","last_became_peered":"2023-05-17T11:46:41.776093+0000","last_unstale":"2023-05-17T11:46:41.792005+0000","last_undegraded":"2023-05-17T11:46:41.792005+0000","last_fullsized":"2023-05-17T11:46:41.792005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:25.513081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768095+0000","last_change":"2023-05-17T11:46:41.764475+0000","last_active":"2023-05-17T11:46:41.768095+0000","last_peered":"2023-05-17T11:46:41.768095+0000","last_clean":"2023-05-17T11:46:41.768095+0000","last_became_active":"2023-05-17T11:46:41.764191+0000","last_became_peered":"2023-05-17T11:46:41.764191+0000","last_unstale":"2023-05-17T11:46:41.768095+0000","last_undegraded":"2023-05-17T11:46:41.768095+0000","last_fullsized":"2023-05-17T11:46:41.768095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:26:22.624438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792147+0000","last_change":"2023-05-17T11:46:41.783713+0000","last_active":"2023-05-17T11:46:41.792147+0000","last_peered":"2023-05-17T11:46:41.792147+0000","last_clean":"2023-05-17T11:46:41.792147+0000","last_became_active":"2023-05-17T11:46:41.783505+0000","last_became_peered":"2023-05-17T11:46:41.783505+0000","last_unstale":"2023-05-17T11:46:41.792147+0000","last_undegraded":"2023-05-17T11:46:41.792147+0000","last_fullsized":"2023-05-17T11:46:41.792147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:38:58.301353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.776572+0000","last_change":"2023-05-17T11:46:41.772715+0000","last_active":"2023-05-17T11:46:41.776572+0000","last_peered":"2023-05-17T11:46:41.776572+0000","last_clean":"2023-05-17T11:46:41.776572+0000","last_became_active":"2023-05-17T11:46:41.772474+0000","last_became_peered":"2023-05-17T11:46:41.772474+0000","last_unstale":"2023-05-17T11:46:41.776572+0000","last_undegraded":"2023-05-17T11:46:41.776572+0000","last_fullsized":"2023-05-17T11:46:41.776572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:18.598303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791872+0000","last_change":"2023-05-17T11:46:41.776954+0000","last_active":"2023-05-17T11:46:41.791872+0000","last_peered":"2023-05-17T11:46:41.791872+0000","last_clean":"2023-05-17T11:46:41.791872+0000","last_became_active":"2023-05-17T11:46:41.776588+0000","last_became_peered":"2023-05-17T11:46:41.776588+0000","last_unstale":"2023-05-17T11:46:41.791872+0000","last_undegraded":"2023-05-17T11:46:41.791872+0000","last_fullsized":"2023-05-17T11:46:41.791872+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:26.073821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793148+0000","last_change":"2023-05-17T11:46:41.788666+0000","last_active":"2023-05-17T11:46:41.793148+0000","last_peered":"2023-05-17T11:46:41.793148+0000","last_clean":"2023-05-17T11:46:41.793148+0000","last_became_active":"2023-05-17T11:46:41.788060+0000","last_became_peered":"2023-05-17T11:46:41.788060+0000","last_unstale":"2023-05-17T11:46:41.793148+0000","last_undegraded":"2023-05-17T11:46:41.793148+0000","last_fullsized":"2023-05-17T11:46:41.793148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:03:17.779688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793130+0000","last_change":"2023-05-17T11:46:41.789117+0000","last_active":"2023-05-17T11:46:41.793130+0000","last_peered":"2023-05-17T11:46:41.793130+0000","last_clean":"2023-05-17T11:46:41.793130+0000","last_became_active":"2023-05-17T11:46:41.788785+0000","last_became_peered":"2023-05-17T11:46:41.788785+0000","last_unstale":"2023-05-17T11:46:41.793130+0000","last_undegraded":"2023-05-17T11:46:41.793130+0000","last_fullsized":"2023-05-17T11:46:41.793130+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:13.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.772462+0000","last_change":"2023-05-17T11:46:41.767319+0000","last_active":"2023-05-17T11:46:41.772462+0000","last_peered":"2023-05-17T11:46:41.772462+0000","last_clean":"2023-05-17T11:46:41.772462+0000","last_became_active":"2023-05-17T11:46:41.767044+0000","last_became_peered":"2023-05-17T11:46:41.767044+0000","last_unstale":"2023-05-17T11:46:41.772462+0000","last_undegraded":"2023-05-17T11:46:41.772462+0000","last_fullsized":"2023-05-17T11:46:41.772462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:39:21.877171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768397+0000","last_change":"2023-05-17T11:46:41.765242+0000","last_active":"2023-05-17T11:46:41.768397+0000","last_peered":"2023-05-17T11:46:41.768397+0000","last_clean":"2023-05-17T11:46:41.768397+0000","last_became_active":"2023-05-17T11:46:41.764919+0000","last_became_peered":"2023-05-17T11:46:41.764919+0000","last_unstale":"2023-05-17T11:46:41.768397+0000","last_undegraded":"2023-05-17T11:46:41.768397+0000","last_fullsized":"2023-05-17T11:46:41.768397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:04.225010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.780641+0000","last_change":"2023-05-17T11:46:41.772719+0000","last_active":"2023-05-17T11:46:41.780641+0000","last_peered":"2023-05-17T11:46:41.780641+0000","last_clean":"2023-05-17T11:46:41.780641+0000","last_became_active":"2023-05-17T11:46:41.771976+0000","last_became_peered":"2023-05-17T11:46:41.771976+0000","last_unstale":"2023-05-17T11:46:41.780641+0000","last_undegraded":"2023-05-17T11:46:41.780641+0000","last_fullsized":"2023-05-17T11:46:41.780641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:19:09.154644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791903+0000","last_change":"2023-05-17T11:46:41.775803+0000","last_active":"2023-05-17T11:46:41.791903+0000","last_peered":"2023-05-17T11:46:41.791903+0000","last_clean":"2023-05-17T11:46:41.791903+0000","last_became_active":"2023-05-17T11:46:41.775462+0000","last_became_peered":"2023-05-17T11:46:41.775462+0000","last_unstale":"2023-05-17T11:46:41.791903+0000","last_undegraded":"2023-05-17T11:46:41.791903+0000","last_fullsized":"2023-05-17T11:46:41.791903+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:18.598303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.779922+0000","last_change":"2023-05-17T11:46:41.777900+0000","last_active":"2023-05-17T11:46:41.779922+0000","last_peered":"2023-05-17T11:46:41.779922+0000","last_clean":"2023-05-17T11:46:41.779922+0000","last_became_active":"2023-05-17T11:46:41.777633+0000","last_became_peered":"2023-05-17T11:46:41.777633+0000","last_unstale":"2023-05-17T11:46:41.779922+0000","last_undegraded":"2023-05-17T11:46:41.779922+0000","last_fullsized":"2023-05-17T11:46:41.779922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:25.513081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791196+0000","last_change":"2023-05-17T11:46:41.783259+0000","last_active":"2023-05-17T11:46:41.791196+0000","last_peered":"2023-05-17T11:46:41.791196+0000","last_clean":"2023-05-17T11:46:41.791196+0000","last_became_active":"2023-05-17T11:46:41.780874+0000","last_became_peered":"2023-05-17T11:46:41.780874+0000","last_unstale":"2023-05-17T11:46:41.791196+0000","last_undegraded":"2023-05-17T11:46:41.791196+0000","last_fullsized":"2023-05-17T11:46:41.791196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:38:35.471164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.770605+0000","last_change":"2023-05-17T11:46:41.767354+0000","last_active":"2023-05-17T11:46:41.770605+0000","last_peered":"2023-05-17T11:46:41.770605+0000","last_clean":"2023-05-17T11:46:41.770605+0000","last_became_active":"2023-05-17T11:46:41.766976+0000","last_became_peered":"2023-05-17T11:46:41.766976+0000","last_unstale":"2023-05-17T11:46:41.770605+0000","last_undegraded":"2023-05-17T11:46:41.770605+0000","last_fullsized":"2023-05-17T11:46:41.770605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:47:41.977285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768128+0000","last_change":"2023-05-17T11:46:41.765948+0000","last_active":"2023-05-17T11:46:41.768128+0000","last_peered":"2023-05-17T11:46:41.768128+0000","last_clean":"2023-05-17T11:46:41.768128+0000","last_became_active":"2023-05-17T11:46:41.764833+0000","last_became_peered":"2023-05-17T11:46:41.764833+0000","last_unstale":"2023-05-17T11:46:41.768128+0000","last_undegraded":"2023-05-17T11:46:41.768128+0000","last_fullsized":"2023-05-17T11:46:41.768128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:53:37.576699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790473+0000","last_change":"2023-05-17T11:46:41.788232+0000","last_active":"2023-05-17T11:46:41.790473+0000","last_peered":"2023-05-17T11:46:41.790473+0000","last_clean":"2023-05-17T11:46:41.790473+0000","last_became_active":"2023-05-17T11:46:41.787842+0000","last_became_peered":"2023-05-17T11:46:41.787842+0000","last_unstale":"2023-05-17T11:46:41.790473+0000","last_undegraded":"2023-05-17T11:46:41.790473+0000","last_fullsized":"2023-05-17T11:46:41.790473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:07:01.553055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.766333+0000","last_change":"2023-05-17T11:46:41.764301+0000","last_active":"2023-05-17T11:46:41.766333+0000","last_peered":"2023-05-17T11:46:41.766333+0000","last_clean":"2023-05-17T11:46:41.766333+0000","last_became_active":"2023-05-17T11:46:41.763905+0000","last_became_peered":"2023-05-17T11:46:41.763905+0000","last_unstale":"2023-05-17T11:46:41.766333+0000","last_undegraded":"2023-05-17T11:46:41.766333+0000","last_fullsized":"2023-05-17T11:46:41.766333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:00:45.169656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791971+0000","last_change":"2023-05-17T11:46:41.783035+0000","last_active":"2023-05-17T11:46:41.791971+0000","last_peered":"2023-05-17T11:46:41.791971+0000","last_clean":"2023-05-17T11:46:41.791971+0000","last_became_active":"2023-05-17T11:46:41.777970+0000","last_became_peered":"2023-05-17T11:46:41.777970+0000","last_unstale":"2023-05-17T11:46:41.791971+0000","last_undegraded":"2023-05-17T11:46:41.791971+0000","last_fullsized":"2023-05-17T11:46:41.791971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:53:01.125693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.766346+0000","last_change":"2023-05-17T11:46:41.764298+0000","last_active":"2023-05-17T11:46:41.766346+0000","last_peered":"2023-05-17T11:46:41.766346+0000","last_clean":"2023-05-17T11:46:41.766346+0000","last_became_active":"2023-05-17T11:46:41.764010+0000","last_became_peered":"2023-05-17T11:46:41.764010+0000","last_unstale":"2023-05-17T11:46:41.766346+0000","last_undegraded":"2023-05-17T11:46:41.766346+0000","last_fullsized":"2023-05-17T11:46:41.766346+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:40:56.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786827+0000","last_change":"2023-05-17T11:46:41.780786+0000","last_active":"2023-05-17T11:46:41.786827+0000","last_peered":"2023-05-17T11:46:41.786827+0000","last_clean":"2023-05-17T11:46:41.786827+0000","last_became_active":"2023-05-17T11:46:41.780418+0000","last_became_peered":"2023-05-17T11:46:41.780418+0000","last_unstale":"2023-05-17T11:46:41.786827+0000","last_undegraded":"2023-05-17T11:46:41.786827+0000","last_fullsized":"2023-05-17T11:46:41.786827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:04.225010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791362+0000","last_change":"2023-05-17T11:46:41.784172+0000","last_active":"2023-05-17T11:46:41.791362+0000","last_peered":"2023-05-17T11:46:41.791362+0000","last_clean":"2023-05-17T11:46:41.791362+0000","last_became_active":"2023-05-17T11:46:41.781266+0000","last_became_peered":"2023-05-17T11:46:41.781266+0000","last_unstale":"2023-05-17T11:46:41.791362+0000","last_undegraded":"2023-05-17T11:46:41.791362+0000","last_fullsized":"2023-05-17T11:46:41.791362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:10:03.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768183+0000","last_change":"2023-05-17T11:46:41.763975+0000","last_active":"2023-05-17T11:46:41.768183+0000","last_peered":"2023-05-17T11:46:41.768183+0000","last_clean":"2023-05-17T11:46:41.768183+0000","last_became_active":"2023-05-17T11:46:41.763678+0000","last_became_peered":"2023-05-17T11:46:41.763678+0000","last_unstale":"2023-05-17T11:46:41.768183+0000","last_undegraded":"2023-05-17T11:46:41.768183+0000","last_fullsized":"2023-05-17T11:46:41.768183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:17:26.906909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793084+0000","last_change":"2023-05-17T11:46:41.788265+0000","last_active":"2023-05-17T11:46:41.793084+0000","last_peered":"2023-05-17T11:46:41.793084+0000","last_clean":"2023-05-17T11:46:41.793084+0000","last_became_active":"2023-05-17T11:46:41.787991+0000","last_became_peered":"2023-05-17T11:46:41.787991+0000","last_unstale":"2023-05-17T11:46:41.793084+0000","last_undegraded":"2023-05-17T11:46:41.793084+0000","last_fullsized":"2023-05-17T11:46:41.793084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:54:02.050478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.780926+0000","last_change":"2023-05-17T11:46:41.375688+0000","last_active":"2023-05-17T11:46:41.780926+0000","last_peered":"2023-05-17T11:46:41.780926+0000","last_clean":"2023-05-17T11:46:41.780926+0000","last_became_active":"2023-05-17T11:46:41.375403+0000","last_became_peered":"2023-05-17T11:46:41.375403+0000","last_unstale":"2023-05-17T11:46:41.780926+0000","last_undegraded":"2023-05-17T11:46:41.780926+0000","last_fullsized":"2023-05-17T11:46:41.780926+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:59:25.808116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.789855+0000","last_change":"2023-05-17T11:46:41.787495+0000","last_active":"2023-05-17T11:46:41.789855+0000","last_peered":"2023-05-17T11:46:41.789855+0000","last_clean":"2023-05-17T11:46:41.789855+0000","last_became_active":"2023-05-17T11:46:41.787198+0000","last_became_peered":"2023-05-17T11:46:41.787198+0000","last_unstale":"2023-05-17T11:46:41.789855+0000","last_undegraded":"2023-05-17T11:46:41.789855+0000","last_fullsized":"2023-05-17T11:46:41.789855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:22.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786329+0000","last_change":"2023-05-17T11:46:41.380839+0000","last_active":"2023-05-17T11:46:41.786329+0000","last_peered":"2023-05-17T11:46:41.786329+0000","last_clean":"2023-05-17T11:46:41.786329+0000","last_became_active":"2023-05-17T11:46:41.380485+0000","last_became_peered":"2023-05-17T11:46:41.380485+0000","last_unstale":"2023-05-17T11:46:41.786329+0000","last_undegraded":"2023-05-17T11:46:41.786329+0000","last_fullsized":"2023-05-17T11:46:41.786329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:14:13.641256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.779053+0000","last_change":"2023-05-17T11:46:41.775080+0000","last_active":"2023-05-17T11:46:41.779053+0000","last_peered":"2023-05-17T11:46:41.779053+0000","last_clean":"2023-05-17T11:46:41.779053+0000","last_became_active":"2023-05-17T11:46:41.774776+0000","last_became_peered":"2023-05-17T11:46:41.774776+0000","last_unstale":"2023-05-17T11:46:41.779053+0000","last_undegraded":"2023-05-17T11:46:41.779053+0000","last_fullsized":"2023-05-17T11:46:41.779053+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:51:41.586107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.776440+0000","last_change":"2023-05-17T11:46:41.379331+0000","last_active":"2023-05-17T11:46:41.776440+0000","last_peered":"2023-05-17T11:46:41.776440+0000","last_clean":"2023-05-17T11:46:41.776440+0000","last_became_active":"2023-05-17T11:46:41.379028+0000","last_became_peered":"2023-05-17T11:46:41.379028+0000","last_unstale":"2023-05-17T11:46:41.776440+0000","last_undegraded":"2023-05-17T11:46:41.776440+0000","last_fullsized":"2023-05-17T11:46:41.776440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:37:02.650209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786248+0000","last_change":"2023-05-17T11:46:41.776300+0000","last_active":"2023-05-17T11:46:41.786248+0000","last_peered":"2023-05-17T11:46:41.786248+0000","last_clean":"2023-05-17T11:46:41.786248+0000","last_became_active":"2023-05-17T11:46:41.776044+0000","last_became_peered":"2023-05-17T11:46:41.776044+0000","last_unstale":"2023-05-17T11:46:41.786248+0000","last_undegraded":"2023-05-17T11:46:41.786248+0000","last_fullsized":"2023-05-17T11:46:41.786248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:10:03.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.783700+0000","last_change":"2023-05-17T11:46:41.379448+0000","last_active":"2023-05-17T11:46:41.783700+0000","last_peered":"2023-05-17T11:46:41.783700+0000","last_clean":"2023-05-17T11:46:41.783700+0000","last_became_active":"2023-05-17T11:46:41.379140+0000","last_became_peered":"2023-05-17T11:46:41.379140+0000","last_unstale":"2023-05-17T11:46:41.783700+0000","last_undegraded":"2023-05-17T11:46:41.783700+0000","last_fullsized":"2023-05-17T11:46:41.783700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:24:32.618974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.766656+0000","last_change":"2023-05-17T11:46:41.762776+0000","last_active":"2023-05-17T11:46:41.766656+0000","last_peered":"2023-05-17T11:46:41.766656+0000","last_clean":"2023-05-17T11:46:41.766656+0000","last_became_active":"2023-05-17T11:46:41.762487+0000","last_became_peered":"2023-05-17T11:46:41.762487+0000","last_unstale":"2023-05-17T11:46:41.766656+0000","last_undegraded":"2023-05-17T11:46:41.766656+0000","last_fullsized":"2023-05-17T11:46:41.766656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:40:57.873649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791821+0000","last_change":"2023-05-17T11:46:41.377202+0000","last_active":"2023-05-17T11:46:41.791821+0000","last_peered":"2023-05-17T11:46:41.791821+0000","last_clean":"2023-05-17T11:46:41.791821+0000","last_became_active":"2023-05-17T11:46:41.376898+0000","last_became_peered":"2023-05-17T11:46:41.376898+0000","last_unstale":"2023-05-17T11:46:41.791821+0000","last_undegraded":"2023-05-17T11:46:41.791821+0000","last_fullsized":"2023-05-17T11:46:41.791821+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:51:40.582767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791799+0000","last_change":"2023-05-17T11:46:41.776039+0000","last_active":"2023-05-17T11:46:41.791799+0000","last_peered":"2023-05-17T11:46:41.791799+0000","last_clean":"2023-05-17T11:46:41.791799+0000","last_became_active":"2023-05-17T11:46:41.773894+0000","last_became_peered":"2023-05-17T11:46:41.773894+0000","last_unstale":"2023-05-17T11:46:41.791799+0000","last_undegraded":"2023-05-17T11:46:41.791799+0000","last_fullsized":"2023-05-17T11:46:41.791799+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:31.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.784050+0000","last_change":"2023-05-17T11:46:41.378049+0000","last_active":"2023-05-17T11:46:41.784050+0000","last_peered":"2023-05-17T11:46:41.784050+0000","last_clean":"2023-05-17T11:46:41.784050+0000","last_became_active":"2023-05-17T11:46:41.377760+0000","last_became_peered":"2023-05-17T11:46:41.377760+0000","last_unstale":"2023-05-17T11:46:41.784050+0000","last_undegraded":"2023-05-17T11:46:41.784050+0000","last_fullsized":"2023-05-17T11:46:41.784050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:27.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791521+0000","last_change":"2023-05-17T11:46:41.788151+0000","last_active":"2023-05-17T11:46:41.791521+0000","last_peered":"2023-05-17T11:46:41.791521+0000","last_clean":"2023-05-17T11:46:41.791521+0000","last_became_active":"2023-05-17T11:46:41.787842+0000","last_became_peered":"2023-05-17T11:46:41.787842+0000","last_unstale":"2023-05-17T11:46:41.791521+0000","last_undegraded":"2023-05-17T11:46:41.791521+0000","last_fullsized":"2023-05-17T11:46:41.791521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:31.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.753024+0000","last_change":"2023-05-17T11:46:41.377768+0000","last_active":"2023-05-17T11:46:41.753024+0000","last_peered":"2023-05-17T11:46:41.753024+0000","last_clean":"2023-05-17T11:46:41.753024+0000","last_became_active":"2023-05-17T11:46:41.377449+0000","last_became_peered":"2023-05-17T11:46:41.377449+0000","last_unstale":"2023-05-17T11:46:41.753024+0000","last_undegraded":"2023-05-17T11:46:41.753024+0000","last_fullsized":"2023-05-17T11:46:41.753024+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:35:50.011357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790223+0000","last_change":"2023-05-17T11:46:41.789045+0000","last_active":"2023-05-17T11:46:41.790223+0000","last_peered":"2023-05-17T11:46:41.790223+0000","last_clean":"2023-05-17T11:46:41.790223+0000","last_became_active":"2023-05-17T11:46:41.788629+0000","last_became_peered":"2023-05-17T11:46:41.788629+0000","last_unstale":"2023-05-17T11:46:41.790223+0000","last_undegraded":"2023-05-17T11:46:41.790223+0000","last_fullsized":"2023-05-17T11:46:41.790223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:49:41.953523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768429+0000","last_change":"2023-05-17T11:46:41.374528+0000","last_active":"2023-05-17T11:46:41.768429+0000","last_peered":"2023-05-17T11:46:41.768429+0000","last_clean":"2023-05-17T11:46:41.768429+0000","last_became_active":"2023-05-17T11:46:41.373741+0000","last_became_peered":"2023-05-17T11:46:41.373741+0000","last_unstale":"2023-05-17T11:46:41.768429+0000","last_undegraded":"2023-05-17T11:46:41.768429+0000","last_fullsized":"2023-05-17T11:46:41.768429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:06:22.266358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.773031+0000","last_change":"2023-05-17T11:46:41.770504+0000","last_active":"2023-05-17T11:46:41.773031+0000","last_peered":"2023-05-17T11:46:41.773031+0000","last_clean":"2023-05-17T11:46:41.773031+0000","last_became_active":"2023-05-17T11:46:41.770239+0000","last_became_peered":"2023-05-17T11:46:41.770239+0000","last_unstale":"2023-05-17T11:46:41.773031+0000","last_undegraded":"2023-05-17T11:46:41.773031+0000","last_fullsized":"2023-05-17T11:46:41.773031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:40:56.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.769460+0000","last_change":"2023-05-17T11:46:41.383529+0000","last_active":"2023-05-17T11:46:41.769460+0000","last_peered":"2023-05-17T11:46:41.769460+0000","last_clean":"2023-05-17T11:46:41.769460+0000","last_became_active":"2023-05-17T11:46:41.383235+0000","last_became_peered":"2023-05-17T11:46:41.383235+0000","last_unstale":"2023-05-17T11:46:41.769460+0000","last_undegraded":"2023-05-17T11:46:41.769460+0000","last_fullsized":"2023-05-17T11:46:41.769460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:56.085432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787625+0000","last_change":"2023-05-17T11:46:41.780164+0000","last_active":"2023-05-17T11:46:41.787625+0000","last_peered":"2023-05-17T11:46:41.787625+0000","last_clean":"2023-05-17T11:46:41.787625+0000","last_became_active":"2023-05-17T11:46:41.779597+0000","last_became_peered":"2023-05-17T11:46:41.779597+0000","last_unstale":"2023-05-17T11:46:41.787625+0000","last_undegraded":"2023-05-17T11:46:41.787625+0000","last_fullsized":"2023-05-17T11:46:41.787625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:28:19.336212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754722+0000","last_change":"2023-05-17T11:46:41.385770+0000","last_active":"2023-05-17T11:46:41.754722+0000","last_peered":"2023-05-17T11:46:41.754722+0000","last_clean":"2023-05-17T11:46:41.754722+0000","last_became_active":"2023-05-17T11:46:41.384990+0000","last_became_peered":"2023-05-17T11:46:41.384990+0000","last_unstale":"2023-05-17T11:46:41.754722+0000","last_undegraded":"2023-05-17T11:46:41.754722+0000","last_fullsized":"2023-05-17T11:46:41.754722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:28:18.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786005+0000","last_change":"2023-05-17T11:46:41.781809+0000","last_active":"2023-05-17T11:46:41.786005+0000","last_peered":"2023-05-17T11:46:41.786005+0000","last_clean":"2023-05-17T11:46:41.786005+0000","last_became_active":"2023-05-17T11:46:41.781557+0000","last_became_peered":"2023-05-17T11:46:41.781557+0000","last_unstale":"2023-05-17T11:46:41.786005+0000","last_undegraded":"2023-05-17T11:46:41.786005+0000","last_fullsized":"2023-05-17T11:46:41.786005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:37:03.653549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791951+0000","last_change":"2023-05-17T11:46:41.378340+0000","last_active":"2023-05-17T11:46:41.791951+0000","last_peered":"2023-05-17T11:46:41.791951+0000","last_clean":"2023-05-17T11:46:41.791951+0000","last_became_active":"2023-05-17T11:46:41.378054+0000","last_became_peered":"2023-05-17T11:46:41.378054+0000","last_unstale":"2023-05-17T11:46:41.791951+0000","last_undegraded":"2023-05-17T11:46:41.791951+0000","last_fullsized":"2023-05-17T11:46:41.791951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:20:34.121121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.776671+0000","last_change":"2023-05-17T11:46:41.772420+0000","last_active":"2023-05-17T11:46:41.776671+0000","last_peered":"2023-05-17T11:46:41.776671+0000","last_clean":"2023-05-17T11:46:41.776671+0000","last_became_active":"2023-05-17T11:46:41.772109+0000","last_became_peered":"2023-05-17T11:46:41.772109+0000","last_unstale":"2023-05-17T11:46:41.776671+0000","last_undegraded":"2023-05-17T11:46:41.776671+0000","last_fullsized":"2023-05-17T11:46:41.776671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:38:58.301353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793781+0000","last_change":"2023-05-17T11:46:41.379696+0000","last_active":"2023-05-17T11:46:41.793781+0000","last_peered":"2023-05-17T11:46:41.793781+0000","last_clean":"2023-05-17T11:46:41.793781+0000","last_became_active":"2023-05-17T11:46:41.379434+0000","last_became_peered":"2023-05-17T11:46:41.379434+0000","last_unstale":"2023-05-17T11:46:41.793781+0000","last_undegraded":"2023-05-17T11:46:41.793781+0000","last_fullsized":"2023-05-17T11:46:41.793781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:14:18.860400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.779294+0000","last_change":"2023-05-17T11:46:41.774720+0000","last_active":"2023-05-17T11:46:41.779294+0000","last_peered":"2023-05-17T11:46:41.779294+0000","last_clean":"2023-05-17T11:46:41.779294+0000","last_became_active":"2023-05-17T11:46:41.774432+0000","last_became_peered":"2023-05-17T11:46:41.774432+0000","last_unstale":"2023-05-17T11:46:41.779294+0000","last_undegraded":"2023-05-17T11:46:41.779294+0000","last_fullsized":"2023-05-17T11:46:41.779294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:02:40.178044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786438+0000","last_change":"2023-05-17T11:46:41.380390+0000","last_active":"2023-05-17T11:46:41.786438+0000","last_peered":"2023-05-17T11:46:41.786438+0000","last_clean":"2023-05-17T11:46:41.786438+0000","last_became_active":"2023-05-17T11:46:41.380098+0000","last_became_peered":"2023-05-17T11:46:41.380098+0000","last_unstale":"2023-05-17T11:46:41.786438+0000","last_undegraded":"2023-05-17T11:46:41.786438+0000","last_fullsized":"2023-05-17T11:46:41.786438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:28:18.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786218+0000","last_change":"2023-05-17T11:46:41.781261+0000","last_active":"2023-05-17T11:46:41.786218+0000","last_peered":"2023-05-17T11:46:41.786218+0000","last_clean":"2023-05-17T11:46:41.786218+0000","last_became_active":"2023-05-17T11:46:41.780963+0000","last_became_peered":"2023-05-17T11:46:41.780963+0000","last_unstale":"2023-05-17T11:46:41.786218+0000","last_undegraded":"2023-05-17T11:46:41.786218+0000","last_fullsized":"2023-05-17T11:46:41.786218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:53:01.125693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.753526+0000","last_change":"2023-05-17T11:46:41.385862+0000","last_active":"2023-05-17T11:46:41.753526+0000","last_peered":"2023-05-17T11:46:41.753526+0000","last_clean":"2023-05-17T11:46:41.753526+0000","last_became_active":"2023-05-17T11:46:41.385643+0000","last_became_peered":"2023-05-17T11:46:41.385643+0000","last_unstale":"2023-05-17T11:46:41.753526+0000","last_undegraded":"2023-05-17T11:46:41.753526+0000","last_fullsized":"2023-05-17T11:46:41.753526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:40:56.870310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.791285+0000","last_change":"2023-05-17T11:46:41.783643+0000","last_active":"2023-05-17T11:46:41.791285+0000","last_peered":"2023-05-17T11:46:41.791285+0000","last_clean":"2023-05-17T11:46:41.791285+0000","last_became_active":"2023-05-17T11:46:41.783233+0000","last_became_peered":"2023-05-17T11:46:41.783233+0000","last_unstale":"2023-05-17T11:46:41.791285+0000","last_undegraded":"2023-05-17T11:46:41.791285+0000","last_fullsized":"2023-05-17T11:46:41.791285+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:02:57.088772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754290+0000","last_change":"2023-05-17T11:46:41.376867+0000","last_active":"2023-05-17T11:46:41.754290+0000","last_peered":"2023-05-17T11:46:41.754290+0000","last_clean":"2023-05-17T11:46:41.754290+0000","last_became_active":"2023-05-17T11:46:41.376548+0000","last_became_peered":"2023-05-17T11:46:41.376548+0000","last_unstale":"2023-05-17T11:46:41.754290+0000","last_undegraded":"2023-05-17T11:46:41.754290+0000","last_fullsized":"2023-05-17T11:46:41.754290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:29:19.726681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787712+0000","last_change":"2023-05-17T11:46:41.784281+0000","last_active":"2023-05-17T11:46:41.787712+0000","last_peered":"2023-05-17T11:46:41.787712+0000","last_clean":"2023-05-17T11:46:41.787712+0000","last_became_active":"2023-05-17T11:46:41.784013+0000","last_became_peered":"2023-05-17T11:46:41.784013+0000","last_unstale":"2023-05-17T11:46:41.787712+0000","last_undegraded":"2023-05-17T11:46:41.787712+0000","last_fullsized":"2023-05-17T11:46:41.787712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:59:21.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.793083+0000","last_change":"2023-05-17T11:46:41.380881+0000","last_active":"2023-05-17T11:46:41.793083+0000","last_peered":"2023-05-17T11:46:41.793083+0000","last_clean":"2023-05-17T11:46:41.793083+0000","last_became_active":"2023-05-17T11:46:41.380410+0000","last_became_peered":"2023-05-17T11:46:41.380410+0000","last_unstale":"2023-05-17T11:46:41.793083+0000","last_undegraded":"2023-05-17T11:46:41.793083+0000","last_fullsized":"2023-05-17T11:46:41.793083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:59:20.278177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786554+0000","last_change":"2023-05-17T11:46:41.777346+0000","last_active":"2023-05-17T11:46:41.786554+0000","last_peered":"2023-05-17T11:46:41.786554+0000","last_clean":"2023-05-17T11:46:41.786554+0000","last_became_active":"2023-05-17T11:46:41.777067+0000","last_became_peered":"2023-05-17T11:46:41.777067+0000","last_unstale":"2023-05-17T11:46:41.786554+0000","last_undegraded":"2023-05-17T11:46:41.786554+0000","last_fullsized":"2023-05-17T11:46:41.786554+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:26:22.624438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787789+0000","last_change":"2023-05-17T11:46:41.383786+0000","last_active":"2023-05-17T11:46:41.787789+0000","last_peered":"2023-05-17T11:46:41.787789+0000","last_clean":"2023-05-17T11:46:41.787789+0000","last_became_active":"2023-05-17T11:46:41.379606+0000","last_became_peered":"2023-05-17T11:46:41.379606+0000","last_unstale":"2023-05-17T11:46:41.787789+0000","last_undegraded":"2023-05-17T11:46:41.787789+0000","last_fullsized":"2023-05-17T11:46:41.787789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:54:01.047138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792028+0000","last_change":"2023-05-17T11:46:41.778037+0000","last_active":"2023-05-17T11:46:41.792028+0000","last_peered":"2023-05-17T11:46:41.792028+0000","last_clean":"2023-05-17T11:46:41.792028+0000","last_became_active":"2023-05-17T11:46:41.777755+0000","last_became_peered":"2023-05-17T11:46:41.777755+0000","last_unstale":"2023-05-17T11:46:41.792028+0000","last_undegraded":"2023-05-17T11:46:41.792028+0000","last_fullsized":"2023-05-17T11:46:41.792028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:46:35.152312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792329+0000","last_change":"2023-05-17T11:46:41.382725+0000","last_active":"2023-05-17T11:46:41.792329+0000","last_peered":"2023-05-17T11:46:41.792329+0000","last_clean":"2023-05-17T11:46:41.792329+0000","last_became_active":"2023-05-17T11:46:41.382436+0000","last_became_peered":"2023-05-17T11:46:41.382436+0000","last_unstale":"2023-05-17T11:46:41.792329+0000","last_undegraded":"2023-05-17T11:46:41.792329+0000","last_fullsized":"2023-05-17T11:46:41.792329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:33:30.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.770871+0000","last_change":"2023-05-17T11:46:41.767519+0000","last_active":"2023-05-17T11:46:41.770871+0000","last_peered":"2023-05-17T11:46:41.770871+0000","last_clean":"2023-05-17T11:46:41.770871+0000","last_became_active":"2023-05-17T11:46:41.767185+0000","last_became_peered":"2023-05-17T11:46:41.767185+0000","last_unstale":"2023-05-17T11:46:41.770871+0000","last_undegraded":"2023-05-17T11:46:41.770871+0000","last_fullsized":"2023-05-17T11:46:41.770871+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:50:24.439106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787722+0000","last_change":"2023-05-17T11:46:41.380798+0000","last_active":"2023-05-17T11:46:41.787722+0000","last_peered":"2023-05-17T11:46:41.787722+0000","last_clean":"2023-05-17T11:46:41.787722+0000","last_became_active":"2023-05-17T11:46:41.380491+0000","last_became_peered":"2023-05-17T11:46:41.380491+0000","last_unstale":"2023-05-17T11:46:41.787722+0000","last_undegraded":"2023-05-17T11:46:41.787722+0000","last_fullsized":"2023-05-17T11:46:41.787722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:29:19.726681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.784035+0000","last_change":"2023-05-17T11:46:41.781295+0000","last_active":"2023-05-17T11:46:41.784035+0000","last_peered":"2023-05-17T11:46:41.784035+0000","last_clean":"2023-05-17T11:46:41.784035+0000","last_became_active":"2023-05-17T11:46:41.781006+0000","last_became_peered":"2023-05-17T11:46:41.781006+0000","last_unstale":"2023-05-17T11:46:41.784035+0000","last_undegraded":"2023-05-17T11:46:41.784035+0000","last_fullsized":"2023-05-17T11:46:41.784035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:00:45.169656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754133+0000","last_change":"2023-05-17T11:46:41.377082+0000","last_active":"2023-05-17T11:46:41.754133+0000","last_peered":"2023-05-17T11:46:41.754133+0000","last_clean":"2023-05-17T11:46:41.754133+0000","last_became_active":"2023-05-17T11:46:41.376773+0000","last_became_peered":"2023-05-17T11:46:41.376773+0000","last_unstale":"2023-05-17T11:46:41.754133+0000","last_undegraded":"2023-05-17T11:46:41.754133+0000","last_fullsized":"2023-05-17T11:46:41.754133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:02:39.174704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.785183+0000","last_change":"2023-05-17T11:46:41.768105+0000","last_active":"2023-05-17T11:46:41.785183+0000","last_peered":"2023-05-17T11:46:41.785183+0000","last_clean":"2023-05-17T11:46:41.785183+0000","last_became_active":"2023-05-17T11:46:41.767656+0000","last_became_peered":"2023-05-17T11:46:41.767656+0000","last_unstale":"2023-05-17T11:46:41.785183+0000","last_undegraded":"2023-05-17T11:46:41.785183+0000","last_fullsized":"2023-05-17T11:46:41.785183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:14:19.863740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.778934+0000","last_change":"2023-05-17T11:46:41.376654+0000","last_active":"2023-05-17T11:46:41.778934+0000","last_peered":"2023-05-17T11:46:41.778934+0000","last_clean":"2023-05-17T11:46:41.778934+0000","last_became_active":"2023-05-17T11:46:41.376386+0000","last_became_peered":"2023-05-17T11:46:41.376386+0000","last_unstale":"2023-05-17T11:46:41.778934+0000","last_undegraded":"2023-05-17T11:46:41.778934+0000","last_fullsized":"2023-05-17T11:46:41.778934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:24:22.722987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786016+0000","last_change":"2023-05-17T11:46:41.781864+0000","last_active":"2023-05-17T11:46:41.786016+0000","last_peered":"2023-05-17T11:46:41.786016+0000","last_clean":"2023-05-17T11:46:41.786016+0000","last_became_active":"2023-05-17T11:46:41.781605+0000","last_became_peered":"2023-05-17T11:46:41.781605+0000","last_unstale":"2023-05-17T11:46:41.786016+0000","last_undegraded":"2023-05-17T11:46:41.786016+0000","last_fullsized":"2023-05-17T11:46:41.786016+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:50:39.845325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.752135+0000","last_change":"2023-05-17T11:46:41.374773+0000","last_active":"2023-05-17T11:46:41.752135+0000","last_peered":"2023-05-17T11:46:41.752135+0000","last_clean":"2023-05-17T11:46:41.752135+0000","last_became_active":"2023-05-17T11:46:41.374450+0000","last_became_peered":"2023-05-17T11:46:41.374450+0000","last_unstale":"2023-05-17T11:46:41.752135+0000","last_undegraded":"2023-05-17T11:46:41.752135+0000","last_fullsized":"2023-05-17T11:46:41.752135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:33:57.239002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792067+0000","last_change":"2023-05-17T11:46:41.777413+0000","last_active":"2023-05-17T11:46:41.792067+0000","last_peered":"2023-05-17T11:46:41.792067+0000","last_clean":"2023-05-17T11:46:41.792067+0000","last_became_active":"2023-05-17T11:46:41.774133+0000","last_became_peered":"2023-05-17T11:46:41.774133+0000","last_unstale":"2023-05-17T11:46:41.792067+0000","last_undegraded":"2023-05-17T11:46:41.792067+0000","last_fullsized":"2023-05-17T11:46:41.792067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:38:35.471164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.760844+0000","last_change":"2023-05-17T11:46:41.378204+0000","last_active":"2023-05-17T11:46:41.760844+0000","last_peered":"2023-05-17T11:46:41.760844+0000","last_clean":"2023-05-17T11:46:41.760844+0000","last_became_active":"2023-05-17T11:46:41.377919+0000","last_became_peered":"2023-05-17T11:46:41.377919+0000","last_unstale":"2023-05-17T11:46:41.760844+0000","last_undegraded":"2023-05-17T11:46:41.760844+0000","last_fullsized":"2023-05-17T11:46:41.760844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:53:00.122353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790205+0000","last_change":"2023-05-17T11:46:41.788881+0000","last_active":"2023-05-17T11:46:41.790205+0000","last_peered":"2023-05-17T11:46:41.790205+0000","last_clean":"2023-05-17T11:46:41.790205+0000","last_became_active":"2023-05-17T11:46:41.788296+0000","last_became_peered":"2023-05-17T11:46:41.788296+0000","last_unstale":"2023-05-17T11:46:41.790205+0000","last_undegraded":"2023-05-17T11:46:41.790205+0000","last_fullsized":"2023-05-17T11:46:41.790205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:13.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.751856+0000","last_change":"2023-05-17T11:46:41.377511+0000","last_active":"2023-05-17T11:46:41.751856+0000","last_peered":"2023-05-17T11:46:41.751856+0000","last_clean":"2023-05-17T11:46:41.751856+0000","last_became_active":"2023-05-17T11:46:41.376099+0000","last_became_peered":"2023-05-17T11:46:41.376099+0000","last_unstale":"2023-05-17T11:46:41.751856+0000","last_undegraded":"2023-05-17T11:46:41.751856+0000","last_fullsized":"2023-05-17T11:46:41.751856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:35:44.270303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.792089+0000","last_change":"2023-05-17T11:46:41.784356+0000","last_active":"2023-05-17T11:46:41.792089+0000","last_peered":"2023-05-17T11:46:41.792089+0000","last_clean":"2023-05-17T11:46:41.792089+0000","last_became_active":"2023-05-17T11:46:41.783840+0000","last_became_peered":"2023-05-17T11:46:41.783840+0000","last_unstale":"2023-05-17T11:46:41.792089+0000","last_undegraded":"2023-05-17T11:46:41.792089+0000","last_fullsized":"2023-05-17T11:46:41.792089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:37:28.677161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.762734+0000","last_change":"2023-05-17T11:46:41.383820+0000","last_active":"2023-05-17T11:46:41.762734+0000","last_peered":"2023-05-17T11:46:41.762734+0000","last_clean":"2023-05-17T11:46:41.762734+0000","last_became_active":"2023-05-17T11:46:41.383493+0000","last_became_peered":"2023-05-17T11:46:41.383493+0000","last_unstale":"2023-05-17T11:46:41.762734+0000","last_undegraded":"2023-05-17T11:46:41.762734+0000","last_fullsized":"2023-05-17T11:46:41.762734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:25.070481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.759808+0000","last_change":"2023-05-17T11:45:23.894807+0000","last_active":"2023-05-17T11:46:41.759808+0000","last_peered":"2023-05-17T11:46:41.759808+0000","last_clean":"2023-05-17T11:46:41.759808+0000","last_became_active":"2023-05-17T11:45:23.894516+0000","last_became_peered":"2023-05-17T11:45:23.894516+0000","last_unstale":"2023-05-17T11:46:41.759808+0000","last_undegraded":"2023-05-17T11:46:41.759808+0000","last_fullsized":"2023-05-17T11:46:41.759808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:22.596969+0000","last_clean_scrub_stamp":"2023-05-17T11:45:22.596969+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:35:50.727386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.756873+0000","last_change":"2023-05-17T11:45:30.089866+0000","last_active":"2023-05-17T11:46:41.756873+0000","last_peered":"2023-05-17T11:46:41.756873+0000","last_clean":"2023-05-17T11:46:41.756873+0000","last_became_active":"2023-05-17T11:45:30.089207+0000","last_became_peered":"2023-05-17T11:45:30.089207+0000","last_unstale":"2023-05-17T11:46:41.756873+0000","last_undegraded":"2023-05-17T11:46:41.756873+0000","last_fullsized":"2023-05-17T11:46:41.756873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:12.159288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.790491+0000","last_change":"2023-05-17T11:46:41.788546+0000","last_active":"2023-05-17T11:46:41.790491+0000","last_peered":"2023-05-17T11:46:41.790491+0000","last_clean":"2023-05-17T11:46:41.790491+0000","last_became_active":"2023-05-17T11:46:41.788244+0000","last_became_peered":"2023-05-17T11:46:41.788244+0000","last_unstale":"2023-05-17T11:46:41.790491+0000","last_undegraded":"2023-05-17T11:46:41.790491+0000","last_fullsized":"2023-05-17T11:46:41.790491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:28:31.544396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787713+0000","last_change":"2023-05-17T11:46:41.385079+0000","last_active":"2023-05-17T11:46:41.787713+0000","last_peered":"2023-05-17T11:46:41.787713+0000","last_clean":"2023-05-17T11:46:41.787713+0000","last_became_active":"2023-05-17T11:46:41.384766+0000","last_became_peered":"2023-05-17T11:46:41.384766+0000","last_unstale":"2023-05-17T11:46:41.787713+0000","last_undegraded":"2023-05-17T11:46:41.787713+0000","last_fullsized":"2023-05-17T11:46:41.787713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:47:10.069177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.759399+0000","last_change":"2023-05-17T11:45:30.093107+0000","last_active":"2023-05-17T11:46:41.759399+0000","last_peered":"2023-05-17T11:46:41.759399+0000","last_clean":"2023-05-17T11:46:41.759399+0000","last_became_active":"2023-05-17T11:45:30.092684+0000","last_became_peered":"2023-05-17T11:45:30.092684+0000","last_unstale":"2023-05-17T11:46:41.759399+0000","last_undegraded":"2023-05-17T11:46:41.759399+0000","last_fullsized":"2023-05-17T11:46:41.759399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:29.673706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787644+0000","last_change":"2023-05-17T11:46:41.780382+0000","last_active":"2023-05-17T11:46:41.787644+0000","last_peered":"2023-05-17T11:46:41.787644+0000","last_clean":"2023-05-17T11:46:41.787644+0000","last_became_active":"2023-05-17T11:46:41.779897+0000","last_became_peered":"2023-05-17T11:46:41.779897+0000","last_unstale":"2023-05-17T11:46:41.787644+0000","last_undegraded":"2023-05-17T11:46:41.787644+0000","last_fullsized":"2023-05-17T11:46:41.787644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:25.513081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.753033+0000","last_change":"2023-05-17T11:46:41.381397+0000","last_active":"2023-05-17T11:46:41.753033+0000","last_peered":"2023-05-17T11:46:41.753033+0000","last_clean":"2023-05-17T11:46:41.753033+0000","last_became_active":"2023-05-17T11:46:41.381135+0000","last_became_peered":"2023-05-17T11:46:41.381135+0000","last_unstale":"2023-05-17T11:46:41.753033+0000","last_undegraded":"2023-05-17T11:46:41.753033+0000","last_fullsized":"2023-05-17T11:46:41.753033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:04.390228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.751951+0000","last_change":"2023-05-17T11:45:30.096072+0000","last_active":"2023-05-17T11:46:41.751951+0000","last_peered":"2023-05-17T11:46:41.751951+0000","last_clean":"2023-05-17T11:46:41.751951+0000","last_became_active":"2023-05-17T11:45:30.095647+0000","last_became_peered":"2023-05-17T11:45:30.095647+0000","last_unstale":"2023-05-17T11:46:41.751951+0000","last_undegraded":"2023-05-17T11:46:41.751951+0000","last_fullsized":"2023-05-17T11:46:41.751951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:34:37.536490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786125+0000","last_change":"2023-05-17T11:46:41.780504+0000","last_active":"2023-05-17T11:46:41.786125+0000","last_peered":"2023-05-17T11:46:41.786125+0000","last_clean":"2023-05-17T11:46:41.786125+0000","last_became_active":"2023-05-17T11:46:41.779673+0000","last_became_peered":"2023-05-17T11:46:41.779673+0000","last_unstale":"2023-05-17T11:46:41.786125+0000","last_undegraded":"2023-05-17T11:46:41.786125+0000","last_fullsized":"2023-05-17T11:46:41.786125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:03:17.779688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755952+0000","last_change":"2023-05-17T11:46:41.375555+0000","last_active":"2023-05-17T11:46:41.755952+0000","last_peered":"2023-05-17T11:46:41.755952+0000","last_clean":"2023-05-17T11:46:41.755952+0000","last_became_active":"2023-05-17T11:46:41.375256+0000","last_became_peered":"2023-05-17T11:46:41.375256+0000","last_unstale":"2023-05-17T11:46:41.755952+0000","last_undegraded":"2023-05-17T11:46:41.755952+0000","last_fullsized":"2023-05-17T11:46:41.755952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:27:21.747445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754324+0000","last_change":"2023-05-17T11:45:30.084716+0000","last_active":"2023-05-17T11:46:41.754324+0000","last_peered":"2023-05-17T11:46:41.754324+0000","last_clean":"2023-05-17T11:46:41.754324+0000","last_became_active":"2023-05-17T11:45:30.084340+0000","last_became_peered":"2023-05-17T11:45:30.084340+0000","last_unstale":"2023-05-17T11:46:41.754324+0000","last_undegraded":"2023-05-17T11:46:41.754324+0000","last_fullsized":"2023-05-17T11:46:41.754324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:01:44.808955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.786042+0000","last_change":"2023-05-17T11:46:41.781497+0000","last_active":"2023-05-17T11:46:41.786042+0000","last_peered":"2023-05-17T11:46:41.786042+0000","last_clean":"2023-05-17T11:46:41.786042+0000","last_became_active":"2023-05-17T11:46:41.781240+0000","last_became_peered":"2023-05-17T11:46:41.781240+0000","last_unstale":"2023-05-17T11:46:41.786042+0000","last_undegraded":"2023-05-17T11:46:41.786042+0000","last_fullsized":"2023-05-17T11:46:41.786042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:54.714061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755316+0000","last_change":"2023-05-17T11:46:41.372348+0000","last_active":"2023-05-17T11:46:41.755316+0000","last_peered":"2023-05-17T11:46:41.755316+0000","last_clean":"2023-05-17T11:46:41.755316+0000","last_became_active":"2023-05-17T11:46:41.372011+0000","last_became_peered":"2023-05-17T11:46:41.372011+0000","last_unstale":"2023-05-17T11:46:41.755316+0000","last_undegraded":"2023-05-17T11:46:41.755316+0000","last_fullsized":"2023-05-17T11:46:41.755316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:28:30.541056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754206+0000","last_change":"2023-05-17T11:45:30.647020+0000","last_active":"2023-05-17T11:46:41.754206+0000","last_peered":"2023-05-17T11:46:41.754206+0000","last_clean":"2023-05-17T11:46:41.754206+0000","last_became_active":"2023-05-17T11:45:30.646621+0000","last_became_peered":"2023-05-17T11:45:30.646621+0000","last_unstale":"2023-05-17T11:46:41.754206+0000","last_undegraded":"2023-05-17T11:46:41.754206+0000","last_fullsized":"2023-05-17T11:46:41.754206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:49:27.565508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.763009+0000","last_change":"2023-05-17T11:46:41.761633+0000","last_active":"2023-05-17T11:46:41.763009+0000","last_peered":"2023-05-17T11:46:41.763009+0000","last_clean":"2023-05-17T11:46:41.763009+0000","last_became_active":"2023-05-17T11:46:41.761283+0000","last_became_peered":"2023-05-17T11:46:41.761283+0000","last_unstale":"2023-05-17T11:46:41.763009+0000","last_undegraded":"2023-05-17T11:46:41.763009+0000","last_fullsized":"2023-05-17T11:46:41.763009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:34:01.644443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.754430+0000","last_change":"2023-05-17T11:46:41.377179+0000","last_active":"2023-05-17T11:46:41.754430+0000","last_peered":"2023-05-17T11:46:41.754430+0000","last_clean":"2023-05-17T11:46:41.754430+0000","last_became_active":"2023-05-17T11:46:41.374816+0000","last_became_peered":"2023-05-17T11:46:41.374816+0000","last_unstale":"2023-05-17T11:46:41.754430+0000","last_undegraded":"2023-05-17T11:46:41.754430+0000","last_fullsized":"2023-05-17T11:46:41.754430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:49:04.390228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.763017+0000","last_change":"2023-05-17T11:45:30.647758+0000","last_active":"2023-05-17T11:46:41.763017+0000","last_peered":"2023-05-17T11:46:41.763017+0000","last_clean":"2023-05-17T11:46:41.763017+0000","last_became_active":"2023-05-17T11:45:30.647423+0000","last_became_peered":"2023-05-17T11:45:30.647423+0000","last_unstale":"2023-05-17T11:46:41.763017+0000","last_undegraded":"2023-05-17T11:46:41.763017+0000","last_fullsized":"2023-05-17T11:46:41.763017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:46.021536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.784353+0000","last_change":"2023-05-17T11:46:41.781607+0000","last_active":"2023-05-17T11:46:41.784353+0000","last_peered":"2023-05-17T11:46:41.784353+0000","last_clean":"2023-05-17T11:46:41.784353+0000","last_became_active":"2023-05-17T11:46:41.781179+0000","last_became_peered":"2023-05-17T11:46:41.781179+0000","last_unstale":"2023-05-17T11:46:41.784353+0000","last_undegraded":"2023-05-17T11:46:41.784353+0000","last_fullsized":"2023-05-17T11:46:41.784353+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T11:47:11.072517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.768128+0000","last_change":"2023-05-17T11:46:41.379594+0000","last_active":"2023-05-17T11:46:41.768128+0000","last_peered":"2023-05-17T11:46:41.768128+0000","last_clean":"2023-05-17T11:46:41.768128+0000","last_became_active":"2023-05-17T11:46:41.379283+0000","last_became_peered":"2023-05-17T11:46:41.379283+0000","last_unstale":"2023-05-17T11:46:41.768128+0000","last_undegraded":"2023-05-17T11:46:41.768128+0000","last_fullsized":"2023-05-17T11:46:41.768128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:20:34.121121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755387+0000","last_change":"2023-05-17T11:45:30.087244+0000","last_active":"2023-05-17T11:46:41.755387+0000","last_peered":"2023-05-17T11:46:41.755387+0000","last_clean":"2023-05-17T11:46:41.755387+0000","last_became_active":"2023-05-17T11:45:30.086890+0000","last_became_peered":"2023-05-17T11:45:30.086890+0000","last_unstale":"2023-05-17T11:46:41.755387+0000","last_undegraded":"2023-05-17T11:46:41.755387+0000","last_fullsized":"2023-05-17T11:46:41.755387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:13:02.364778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.787905+0000","last_change":"2023-05-17T11:46:41.780421+0000","last_active":"2023-05-17T11:46:41.787905+0000","last_peered":"2023-05-17T11:46:41.787905+0000","last_clean":"2023-05-17T11:46:41.787905+0000","last_became_active":"2023-05-17T11:46:41.780098+0000","last_became_peered":"2023-05-17T11:46:41.780098+0000","last_unstale":"2023-05-17T11:46:41.787905+0000","last_undegraded":"2023-05-17T11:46:41.787905+0000","last_fullsized":"2023-05-17T11:46:41.787905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:41.347472+0000","last_clean_scrub_stamp":"2023-05-17T11:46:41.347472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:46:35.152312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.769785+0000","last_change":"2023-05-17T11:46:41.378221+0000","last_active":"2023-05-17T11:46:41.769785+0000","last_peered":"2023-05-17T11:46:41.769785+0000","last_clean":"2023-05-17T11:46:41.769785+0000","last_became_active":"2023-05-17T11:46:41.377900+0000","last_became_peered":"2023-05-17T11:46:41.377900+0000","last_unstale":"2023-05-17T11:46:41.769785+0000","last_undegraded":"2023-05-17T11:46:41.769785+0000","last_fullsized":"2023-05-17T11:46:41.769785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:46:40.344132+0000","last_clean_scrub_stamp":"2023-05-17T11:46:40.344132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:46:34.148972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-17T11:46:41.755989+0000","last_change":"2023-05-17T11:45:30.088456+0000","last_active":"2023-05-17T11:46:41.755989+0000","last_peered":"2023-05-17T11:46:41.755989+0000","last_clean":"2023-05-17T11:46:41.755989+0000","last_became_active":"2023-05-17T11:45:30.088082+0000","last_became_peered":"2023-05-17T11:45:30.088082+0000","last_unstale":"2023-05-17T11:46:41.755989+0000","last_undegraded":"2023-05-17T11:46:41.755989+0000","last_fullsized":"2023-05-17T11:46:41.755989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T11:45:29.067655+0000","last_clean_scrub_stamp":"2023-05-17T11:45:29.067655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:55:11.039331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13676,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358164,"statfs":{"total":96636764160,"available":96622759936,"internally_reserved":0,"allocated":1019904,"data_stored":760729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.745}]},{"osd":2,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.877}]},{"osd":4,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78700000000000003}]},{"osd":5,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.96199999999999997}]},{"osd":6,"last update":"Wed May 17 11:46:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":413696,"data_stored":169309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.73099999999999998}]},{"osd":1,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73699999999999999}]},{"osd":4,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.504},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.68000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12504,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359336,"statfs":{"total":96636764160,"available":96623960064,"internally_reserved":0,"allocated":409600,"data_stored":168727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.629}]},{"osd":2,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.72999999999999998}]},{"osd":4,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.745}]},{"osd":7,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12704,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359136,"statfs":{"total":96636764160,"available":96623755264,"internally_reserved":0,"allocated":417792,"data_stored":169331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.745}]},{"osd":3,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":425984,"data_stored":170325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.436}]},{"osd":1,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.46400000000000002}]},{"osd":2,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.628}]},{"osd":6,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 11:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":413696,"data_stored":168797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.433}]},{"osd":4,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.752}]},{"osd":7,"last update":"Wed May 17 11:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.83599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":168817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.439}]},{"osd":4,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.69199999999999995}]},{"osd":5,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":751967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.505},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed May 17 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T11:46:46.219 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T11:46:46.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-17T11:46:46.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 Processor -- start 2023-05-17T11:46:46.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 -- start start 2023-05-17T11:46:46.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00cdcb0 0x7f6bf00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6bf00c1a10 0x7f6bf00cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00adb90 con 0x7f6bf0160590 2023-05-17T11:46:46.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00b05a0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.394+0000 7f6bf81f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0160960 con 0x7f6bf00cdcb0 2023-05-17T11:46:46.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf578b640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00cdcb0 0x7f6bf00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf5f8c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6bf0160590 0x7f6bf00c1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:59404/0 (socket says 172.21.15.3:59404) 2023-05-17T11:46:46.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf5f8c640 1 -- 172.21.15.3:0/458140730 learned_addr learned my addr 172.21.15.3:0/458140730 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:46.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf678d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6bf00c1a10 0x7f6bf00cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf678d640 1 -- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00cdcb0 msgr2=0x7f6bf00cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf678d640 1 --2- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00cdcb0 0x7f6bf00cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf678d640 1 -- 172.21.15.3:0/458140730 >> v1:172.21.15.60:6789/0 conn(0x7f6bf0160590 legacy=0x7f6bf00c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf678d640 1 -- 172.21.15.3:0/458140730 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00ad8b0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.398+0000 7f6bf678d640 1 --2- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf00c1a10 0x7f6bf00cc440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009d90 tx=0x7f6be801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=134d9f5accfbf6c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf4f8a640 1 -- 172.21.15.3:0/458140730 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80a58c0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf4f8a640 1 -- 172.21.15.3:0/458140730 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be80a5a20 con 0x7f6bf00c1a10 2023-05-17T11:46:46.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf4f8a640 1 -- 172.21.15.3:0/458140730 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80a5db0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf00c1a10 msgr2=0x7f6bf00cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf00c1a10 0x7f6bf00cc440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009d90 tx=0x7f6be801c800 comp rx=0 tx=0).stop 2023-05-17T11:46:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- 172.21.15.3:0/458140730 shutdown_connections 2023-05-17T11:46:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf00c1a10 0x7f6bf00cc440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/458140730 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00cdcb0 0x7f6bf00cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- 172.21.15.3:0/458140730 >> 172.21.15.3:0/458140730 conn(0x7f6bf006a740 msgr2=0x7f6bf00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- 172.21.15.3:0/458140730 shutdown_connections 2023-05-17T11:46:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- 172.21.15.3:0/458140730 wait complete. 2023-05-17T11:46:46.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 Processor -- start 2023-05-17T11:46:46.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- start start 2023-05-17T11:46:46.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 0x7f6bf0153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf0160590 0x7f6bf015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00adff0 0x7f6bf00ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00ae9d0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf015a030 con 0x7f6bf0160590 2023-05-17T11:46:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf81f0640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf015ae50 con 0x7f6bf00adff0 2023-05-17T11:46:46.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf5f8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 0x7f6bf0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.402+0000 7f6bf5f8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 0x7f6bf0153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45400/0 (socket says 172.21.15.3:45400) 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 -- 172.21.15.3:0/2462546143 learned_addr learned my addr 172.21.15.3:0/2462546143 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf578b640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf0160590 0x7f6bf015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf678d640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00adff0 0x7f6bf00ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 -- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00adff0 msgr2=0x7f6bf00ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00adff0 0x7f6bf00ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 -- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf0160590 msgr2=0x7f6bf015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf0160590 0x7f6bf015bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 -- 172.21.15.3:0/2462546143 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8009a70 con 0x7f6bf00c1a10 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf678d640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00adff0 0x7f6bf00ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf578b640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf0160590 0x7f6bf015bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf5f8c640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 0x7f6bf0153650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00c500 tx=0x7f6bec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec005cf0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00ccb10 con 0x7f6bf00c1a10 2023-05-17T11:46:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00cc980 con 0x7f6bf00c1a10 2023-05-17T11:46:46.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec005e50 con 0x7f6bf00c1a10 2023-05-17T11:46:46.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0072f0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf00ccca0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.406+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bec007450 con 0x7f6bf00c1a10 2023-05-17T11:46:46.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.410+0000 7f6be67fc640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bd40662b0 0x7f6bd4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.410+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bec0831c0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.410+0000 7f6bf578b640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bd40662b0 0x7f6bd4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.410+0000 7f6bf578b640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bd40662b0 0x7f6bd4068760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00c49c0 tx=0x7f6be0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.410+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6bec0506e0 con 0x7f6bf00c1a10 2023-05-17T11:46:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.622+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6bf004de80 con 0x7f6bf00c1a10 2023-05-17T11:46:46.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6be67fc640 1 -- 172.21.15.3:0/2462546143 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6bec053d00 con 0x7f6bf00c1a10 2023-05-17T11:46:46.632 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-05-17T11:46:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bd40662b0 msgr2=0x7f6bd4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bd40662b0 0x7f6bd4068760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00c49c0 tx=0x7f6be0008040 comp rx=0 tx=0).stop 2023-05-17T11:46:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 msgr2=0x7f6bf0153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 0x7f6bf0153650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00c500 tx=0x7f6bec00c9c0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 shutdown_connections 2023-05-17T11:46:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f6bd40662b0 0x7f6bd4068760 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f6bf00adff0 0x7f6bf00ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf0160590 0x7f6bf015bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 --2- 172.21.15.3:0/2462546143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf00c1a10 0x7f6bf0153650 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 >> 172.21.15.3:0/2462546143 conn(0x7f6bf006a740 msgr2=0x7f6bf006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 shutdown_connections 2023-05-17T11:46:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.626+0000 7f6bf81f0640 1 -- 172.21.15.3:0/2462546143 wait complete. 2023-05-17T11:46:46.652 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T11:46:46.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.782+0000 7f8c83274640 1 Processor -- start 2023-05-17T11:46:46.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.782+0000 7f8c83274640 1 -- start start 2023-05-17T11:46:46.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c83274640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8c7c0c9fd0 0x7f8c7c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c83274640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c0ca490 con 0x7f8c7c0716d0 2023-05-17T11:46:46.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c83274640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c0ca730 con 0x7f8c7c15a2e0 2023-05-17T11:46:46.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c83274640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cacf0 con 0x7f8c7c0c9fd0 2023-05-17T11:46:46.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81010640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8c7c0716d0 0x7f8c7c06fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59304/0 (socket says 172.21.15.3:59304) 2023-05-17T11:46:46.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81010640 1 -- 172.21.15.3:0/1006973551 learned_addr learned my addr 172.21.15.3:0/1006973551 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:46.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 --2- 172.21.15.3:0/1006973551 >> v2:172.21.15.60:3300/0 conn(0x7f8c7c0c9fd0 0x7f8c7c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832611829 0 0) 0x7f8c7c0ca490 con 0x7f8c7c0716d0 2023-05-17T11:46:46.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c68003530 con 0x7f8c7c0716d0 2023-05-17T11:46:46.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108752706 0 0) 0x7f8c68003530 con 0x7f8c7c0716d0 2023-05-17T11:46:46.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 >> v2:172.21.15.60:3300/0 conn(0x7f8c7c0c9fd0 msgr2=0x7f8c7c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 --2- 172.21.15.3:0/1006973551 >> v2:172.21.15.60:3300/0 conn(0x7f8c7c0c9fd0 0x7f8c7c0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 >> v1:172.21.15.60:6789/0 conn(0x7f8c7c15a2e0 legacy=0x7f8c7c071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0caa10 con 0x7f8c7c0716d0 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 898022645 0 0) 0x7f8c78001680 con 0x7f8c7c0716d0 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 >> v1:172.21.15.3:6789/0 conn(0x7f8c7c0716d0 legacy=0x7f8c7c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c680039f0 0x7f8c68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c680047d0 0x7f8c68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cacf0 con 0x7f8c68005180 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6800c060 con 0x7f8c680039f0 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6800c220 con 0x7f8c680047d0 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81010640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c680039f0 0x7f8c68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c8080f640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c680047d0 0x7f8c68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 -- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c680047d0 msgr2=0x7f8c68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c680047d0 0x7f8c68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 -- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c680039f0 msgr2=0x7f8c68003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:46.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c680039f0 0x7f8c68003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81811640 1 -- 172.21.15.3:0/1006973551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68003530 con 0x7f8c68005180 2023-05-17T11:46:46.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.786+0000 7f8c81010640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c680039f0 0x7f8c68003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:46.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c81811640 1 -- 172.21.15.3:0/1006973551 reap_dead start 2023-05-17T11:46:46.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c81811640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c6800b990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009f90 tx=0x7f8c7401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c096200e7df42e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740a5c70 con 0x7f8c68005180 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7400f040 con 0x7f8c68005180 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c73fff640 1 -- 172.21.15.3:0/1006973551 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740039a0 con 0x7f8c68005180 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 -- 172.21.15.3:0/1006973551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 msgr2=0x7f8c6800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c6800b990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009f90 tx=0x7f8c7401cc60 comp rx=0 tx=0).stop 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 -- 172.21.15.3:0/1006973551 shutdown_connections 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 --2- 172.21.15.3:0/1006973551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c6800b990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 -- 172.21.15.3:0/1006973551 >> 172.21.15.3:0/1006973551 conn(0x7f8c7c0b0b30 msgr2=0x7f8c7c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:46.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 -- 172.21.15.3:0/1006973551 shutdown_connections 2023-05-17T11:46:46.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 -- 172.21.15.3:0/1006973551 wait complete. 2023-05-17T11:46:46.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 Processor -- start 2023-05-17T11:46:46.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.790+0000 7f8c83274640 1 -- start start 2023-05-17T11:46:46.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c7c1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c7c0cca50 0x7f8c7c0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c0ab8f0 0x7f8c7c0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cd400 con 0x7f8c68005180 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c15a870 con 0x7f8c7c0ab8f0 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c156380 con 0x7f8c7c0cca50 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c7c1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c7c1f2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45420/0 (socket says 172.21.15.3:45420) 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 -- 172.21.15.3:0/3968244015 learned_addr learned my addr 172.21.15.3:0/3968244015 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81811640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c0ab8f0 0x7f8c7c0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c8080f640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c7c0cca50 0x7f8c7c0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 -- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c7c0cca50 msgr2=0x7f8c7c0ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c7c0cca50 0x7f8c7c0ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 -- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c0ab8f0 msgr2=0x7f8c7c0abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c0ab8f0 0x7f8c7c0abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 -- 172.21.15.3:0/3968244015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0c8e80 con 0x7f8c68005180 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c81010640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c7c1f2180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e7e0 tx=0x7f8c7800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800c6c0 con 0x7f8c68005180 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800c820 con 0x7f8c68005180 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800cb90 con 0x7f8c68005180 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c0c8ba0 con 0x7f8c68005180 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c06fc00 con 0x7f8c68005180 2023-05-17T11:46:46.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c0c5460 con 0x7f8c68005180 2023-05-17T11:46:46.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.794+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c7800ccf0 con 0x7f8c68005180 2023-05-17T11:46:46.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.798+0000 7f8c71ffb640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c60066280 0x7f8c60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:46.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.798+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c78083ba0 con 0x7f8c68005180 2023-05-17T11:46:46.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.798+0000 7f8c8080f640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c60066280 0x7f8c60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:46.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.798+0000 7f8c8080f640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c60066280 0x7f8c60068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0cd7b0 tx=0x7f8c6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:46.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.802+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8c78050fa0 con 0x7f8c68005180 2023-05-17T11:46:46.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.986+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c7c04de80 con 0x7f8c68005180 2023-05-17T11:46:46.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.986+0000 7f8c71ffb640 1 -- 172.21.15.3:0/3968244015 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f8c780545c0 con 0x7f8c68005180 2023-05-17T11:46:46.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:46:46.993 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/172630740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":172630740},{"type":"v1","addr":"172.21.15.3:6837","nonce":172630740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6834/3415937638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3415937638},{"type":"v1","addr":"172.21.15.60:6834","nonce":3415937638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3587202772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":3587202772},{"type":"v1","addr":"172.21.15.60:6835","nonce":3587202772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T11:46:41.746770+0000","modified":"2023-05-17T11:46:44.758576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3253181122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3253181122},{"type":"v1","addr":"172.21.15.3:6835","nonce":3253181122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-17T11:46:46.994 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 16 2023-05-17T11:46:46.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c60066280 msgr2=0x7f8c60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c60066280 0x7f8c60068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0cd7b0 tx=0x7f8c6c009040 comp rx=0 tx=0).stop 2023-05-17T11:46:46.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 msgr2=0x7f8c7c1f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:46.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c7c1f2180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e7e0 tx=0x7f8c7800eca0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 shutdown_connections 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f8c60066280 0x7f8c60068730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c0ab8f0 0x7f8c7c0abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f8c7c0cca50 0x7f8c7c0ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 --2- 172.21.15.3:0/3968244015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c68005180 0x7f8c7c1f2180 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 >> 172.21.15.3:0/3968244015 conn(0x7f8c7c0b0b30 msgr2=0x7f8c7c157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:46.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 shutdown_connections 2023-05-17T11:46:46.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:46.990+0000 7f8c83274640 1 -- 172.21.15.3:0/3968244015 wait complete. 2023-05-17T11:46:47.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T11:46:41.746770+0000', 'modified': '2023-05-17T11:46:44.758576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5334': {'gid': 5334, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6835/3253181122', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6834', 'nonce': 3253181122}, {'type': 'v1', 'addr': '172.21.15.3:6835', 'nonce': 3253181122}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-17T11:46:47.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T11:46:47.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-17T11:46:47.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.550+0000 7f0309a8c640 1 Processor -- start 2023-05-17T11:46:47.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.550+0000 7f0309a8c640 1 -- start start 2023-05-17T11:46:47.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0309a8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f03040ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0309a8c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040abb20 con 0x7f030406a490 2023-05-17T11:46:47.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0309a8c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030406abf0 con 0x7f030415c1e0 2023-05-17T11:46:47.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0309a8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030406aed0 con 0x7f03040c9a50 2023-05-17T11:46:47.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0303fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f030406a490 0x7f03040abfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59308/0 (socket says 172.21.15.3:59308) 2023-05-17T11:46:47.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0303fff640 1 -- 172.21.15.3:0/3335157739 learned_addr learned my addr 172.21.15.3:0/3335157739 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:47.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0302ffd640 1 --2- 172.21.15.3:0/3335157739 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f03040ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086350851 0 0) 0x7f03040abb20 con 0x7f030406a490 2023-05-17T11:46:47.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02ec003530 con 0x7f030406a490 2023-05-17T11:46:47.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570271738 0 0) 0x7f030406abf0 con 0x7f030415c1e0 2023-05-17T11:46:47.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03040abb20 con 0x7f030415c1e0 2023-05-17T11:46:47.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0302ffd640 1 -- 172.21.15.3:0/3335157739 >> v1:172.21.15.60:6789/0 conn(0x7f030415c1e0 legacy=0x7f03040c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0302ffd640 1 -- 172.21.15.3:0/3335157739 >> v1:172.21.15.3:6789/0 conn(0x7f030406a490 legacy=0x7f03040abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.554+0000 7f0302ffd640 1 -- 172.21.15.3:0/3335157739 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030406b1b0 con 0x7f03040c9a50 2023-05-17T11:46:47.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0302ffd640 1 --2- 172.21.15.3:0/3335157739 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f03040ae0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02f80097f0 tx=0x7f02f801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87fb91cc8a5621a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80aa610 con 0x7f03040c9a50 2023-05-17T11:46:47.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f80a6040 con 0x7f03040c9a50 2023-05-17T11:46:47.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f03027fc640 1 -- 172.21.15.3:0/3335157739 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80aa990 con 0x7f03040c9a50 2023-05-17T11:46:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 -- 172.21.15.3:0/3335157739 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 msgr2=0x7f03040ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 --2- 172.21.15.3:0/3335157739 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f03040ae0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02f80097f0 tx=0x7f02f801c490 comp rx=0 tx=0).stop 2023-05-17T11:46:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 -- 172.21.15.3:0/3335157739 shutdown_connections 2023-05-17T11:46:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 --2- 172.21.15.3:0/3335157739 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f03040ae0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 -- 172.21.15.3:0/3335157739 >> 172.21.15.3:0/3335157739 conn(0x7f03040cf940 msgr2=0x7f03040cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 -- 172.21.15.3:0/3335157739 shutdown_connections 2023-05-17T11:46:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 -- 172.21.15.3:0/3335157739 wait complete. 2023-05-17T11:46:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 Processor -- start 2023-05-17T11:46:47.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.558+0000 7f0309a8c640 1 -- start start 2023-05-17T11:46:47.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030406a490 0x7f03040b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f030413b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 0x7f0304152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041522b0 con 0x7f030415c1e0 2023-05-17T11:46:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040b38d0 con 0x7f030406a490 2023-05-17T11:46:47.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0304153830 con 0x7f03040c9a50 2023-05-17T11:46:47.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 0x7f0304152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 0x7f0304152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45426/0 (socket says 172.21.15.3:45426) 2023-05-17T11:46:47.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 -- 172.21.15.3:0/794309166 learned_addr learned my addr 172.21.15.3:0/794309166 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:47.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0302ffd640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f030413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f03037fe640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030406a490 0x7f03040b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 -- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 msgr2=0x7f030413b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f030413b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 -- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030406a490 msgr2=0x7f03040b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030406a490 0x7f03040b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 -- 172.21.15.3:0/794309166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8009420 con 0x7f030415c1e0 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0303fff640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 0x7f0304152d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00caf0 tx=0x7f02fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f02ebfff640 1 -- 172.21.15.3:0/794309166 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00aca0 con 0x7f030415c1e0 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f02ebfff640 1 -- 172.21.15.3:0/794309166 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc00ae00 con 0x7f030415c1e0 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f02ebfff640 1 -- 172.21.15.3:0/794309166 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc012620 con 0x7f030415c1e0 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040ad060 con 0x7f030415c1e0 2023-05-17T11:46:47.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.562+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03040aced0 con 0x7f030415c1e0 2023-05-17T11:46:47.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f02ebfff640 1 -- 172.21.15.3:0/794309166 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02fc007070 con 0x7f030415c1e0 2023-05-17T11:46:47.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f02ebfff640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f02f0066280 0x7f02f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f02ebfff640 1 -- 172.21.15.3:0/794309166 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02fc083c70 con 0x7f030415c1e0 2023-05-17T11:46:47.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f02f0066280 0x7f02f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 Processor -- start 2023-05-17T11:46:47.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 -- start start 2023-05-17T11:46:47.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f02f0066280 0x7f02f0068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f02f40011f0 tx=0x7f02f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab85db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab810ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab6db310 con 0x55fbab85d760 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab615980 con 0x55fbab811020 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbab669040 con 0x55fbab85e070 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab85db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab85db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45442/0 (socket says 172.21.15.3:45442) 2023-05-17T11:46:47.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 -- 172.21.15.3:0/1646066913 learned_addr learned my addr 172.21.15.3:0/1646066913 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:47.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f0302ffd640 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab810ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f0303fff640 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 -- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 msgr2=0x55fbab810ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab810ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 -- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 msgr2=0x55fbab8113f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8113f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 -- 172.21.15.3:0/1646066913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbab6270b0 con 0x55fbab85d760 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.566+0000 7f03037fe640 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab85db30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f02f400f8d0 tx=0x7f02f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe64b7dc933713f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f02e9ffb640 1 -- 172.21.15.3:0/1646066913 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f400fe50 con 0x55fbab85d760 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f02e9ffb640 1 -- 172.21.15.3:0/1646066913 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f4014be0 con 0x55fbab85d760 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f02e9ffb640 1 -- 172.21.15.3:0/1646066913 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4020410 con 0x55fbab85d760 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- 172.21.15.3:0/1646066913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 msgr2=0x55fbab85db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab85db30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f02f400f8d0 tx=0x7f02f4012000 comp rx=0 tx=0).stop 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- 172.21.15.3:0/1646066913 shutdown_connections 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab810ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- 172.21.15.3:0/1646066913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab85db30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- 172.21.15.3:0/1646066913 >> 172.21.15.3:0/1646066913 conn(0x55fbab83e710 msgr2=0x55fbab840af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- 172.21.15.3:0/1646066913 shutdown_connections 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- 172.21.15.3:0/1646066913 wait complete. 2023-05-17T11:46:47.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- start start 2023-05-17T11:46:47.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 Processor -- start 2023-05-17T11:46:47.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 0x55fbab816800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85d760 0x55fbab816d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab817280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab6620e0 con 0x55fbab811020 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab61ebd0 con 0x55fbab85d760 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbab61e870 con 0x55fbab85e070 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f030cde5000 10 client.0 _ll_register_callbacks cb 0x55fbab7fec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 0x55fbab816800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 0x55fbab816800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45448/0 (socket says 172.21.15.3:45448) 2023-05-17T11:46:47.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 -- 172.21.15.3:0/2950475287 learned_addr learned my addr 172.21.15.3:0/2950475287 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f0303fff640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab817280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f0302ffd640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85d760 0x55fbab816d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 -- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 msgr2=0x55fbab817280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab817280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 -- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85d760 msgr2=0x55fbab816d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85d760 0x55fbab816d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 -- 172.21.15.3:0/2950475287 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03040abb20 con 0x55fbab811020 2023-05-17T11:46:47.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f03037fe640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 0x55fbab816800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02f4021a20 tx=0x7f02f4001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504931b529995645 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.570+0000 7f02e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 1 -- 172.21.15.3:0/2950475287 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4021e00 con 0x55fbab811020 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbab65d8b0 con 0x55fbab811020 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 1 -- 172.21.15.3:0/2950475287 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02f401c040 con 0x55fbab811020 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 1 -- 172.21.15.3:0/2950475287 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f402b470 con 0x55fbab811020 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 10 client.5505 fetch_fsmap learned FSMap version 16 2023-05-17T11:46:47.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fbab35e890 con 0x55fbab811020 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 1 -- 172.21.15.3:0/2950475287 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbab65d8b0 con 0x55fbab811020 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 1 -- 172.21.15.3:0/2950475287 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f02f4012070 con 0x55fbab811020 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 10 client.5505 fetch_fsmap finished waiting for FSMap version 16 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 10 client.5505 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 20 client.5505 populate_metadata read hostname 'smithi003' 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86c7d0 0x55fbab86ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 4 client.5505 mds_command: new command op to 5334 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 --> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbab690f70 con 0x55fbab86c7d0 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f0302ffd640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86c7d0 0x55fbab86ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f0302ffd640 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86c7d0 0x55fbab86ebb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a472c07641be375 server_cookie=9831a71e66e151f9 in_seq=0 out_seq=0 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 10 client.5505 ms_handle_connect on v2:172.21.15.3:6834/3253181122 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 1 -- 172.21.15.3:0/2950475287 <== mds.0 v2:172.21.15.3:6834/3253181122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fbab690f70 con 0x55fbab86c7d0 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 10 client.5505 handle_command_reply: tid=0 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 client.5505 shutdown 2023-05-17T11:46:47.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 msgr2=0x55fbab816800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 0x55fbab816800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02f4021a20 tx=0x7f02f4001160 comp rx=0 tx=0).stop 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 shutdown_connections 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86c7d0 0x55fbab86ebb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab817280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85d760 0x55fbab816d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 --2- 172.21.15.3:0/2950475287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab811020 0x55fbab816800 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 >> 172.21.15.3:0/2950475287 conn(0x55fbab83e710 msgr2=0x55fbab840af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f02e27fc640 0 client.5505 ms_handle_reset on v2:172.21.15.3:6834/3253181122 2023-05-17T11:46:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 shutdown_connections 2023-05-17T11:46:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 1 -- 172.21.15.3:0/2950475287 wait complete. 2023-05-17T11:46:47.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.574+0000 7f030cde5000 20 client.5505 trim_cache size 0 max 16384 2023-05-17T11:46:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 Processor -- start 2023-05-17T11:46:47.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 -- start start 2023-05-17T11:46:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab811020 0x55fbab8b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab8b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85e070 0x55fbab8b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab31f940 con 0x55fbab85d760 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab65f8f0 con 0x55fbab85e070 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbab6660e0 con 0x55fbab811020 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab8b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab8b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45454/0 (socket says 172.21.15.3:45454) 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 -- 172.21.15.3:0/957196218 learned_addr learned my addr 172.21.15.3:0/957196218 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f03037fe640 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab811020 0x55fbab8b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0303fff640 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85e070 0x55fbab8b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 -- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab811020 msgr2=0x55fbab8b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab811020 0x55fbab8b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 -- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85e070 msgr2=0x55fbab8b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85e070 0x55fbab8b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 -- 172.21.15.3:0/957196218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbab627360 con 0x55fbab85d760 2023-05-17T11:46:47.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.590+0000 7f0302ffd640 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab8b6f60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f02f80190a0 tx=0x7f02f8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1bbd753dfb54ae server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02ea7fc640 1 -- 172.21.15.3:0/957196218 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80c8070 con 0x55fbab85d760 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02ea7fc640 1 -- 172.21.15.3:0/957196218 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f80c4b80 con 0x55fbab85d760 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02ea7fc640 1 -- 172.21.15.3:0/957196218 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80b9040 con 0x55fbab85d760 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/957196218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 msgr2=0x55fbab8b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab8b6f60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f02f80190a0 tx=0x7f02f8004740 comp rx=0 tx=0).stop 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/957196218 shutdown_connections 2023-05-17T11:46:47.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab85e070 0x55fbab8b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab8b6f60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- 172.21.15.3:0/957196218 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab811020 0x55fbab8b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/957196218 >> 172.21.15.3:0/957196218 conn(0x55fbab83e710 msgr2=0x55fbab85ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/957196218 shutdown_connections 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/957196218 wait complete. 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- start start 2023-05-17T11:46:47.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 Processor -- start 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab86eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab86efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab66a2d0 con 0x55fbab85d760 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbab35f1b0 con 0x55fbab811020 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbab660f70 con 0x55fbab85e070 2023-05-17T11:46:47.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 10 client.0 _ll_register_callbacks cb 0x55fbab62d3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab86eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab86eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45462/0 (socket says 172.21.15.3:45462) 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 -- 172.21.15.3:0/4091620711 learned_addr learned my addr 172.21.15.3:0/4091620711 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0303fff640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab86efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f03037fe640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 -- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 msgr2=0x55fbab86efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab86efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 -- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 msgr2=0x55fbab8b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 -- 172.21.15.3:0/4091620711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030406b1b0 con 0x55fbab85d760 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f0302ffd640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab86eaa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f02f801a0c0 tx=0x7f02f801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba7183d5fb5ce7a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02e27fc640 1 -- 172.21.15.3:0/4091620711 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80c8070 con 0x55fbab85d760 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02e27fc640 1 -- 172.21.15.3:0/4091620711 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02f80c4190 con 0x55fbab85d760 2023-05-17T11:46:47.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbab814990 con 0x55fbab85d760 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f02e27fc640 1 -- 172.21.15.3:0/4091620711 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f80b9030 con 0x55fbab85d760 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 10 client.5511 fetch_fsmap learned FSMap version 16 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.594+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fbab60cbe0 con 0x55fbab85d760 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f02e27fc640 1 -- 172.21.15.3:0/4091620711 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbab814990 con 0x55fbab85d760 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f02e27fc640 1 -- 172.21.15.3:0/4091620711 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f02f80c4350 con 0x55fbab85d760 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 10 client.5511 fetch_fsmap finished waiting for FSMap version 16 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 10 client.5511 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T11:46:47.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 20 client.5511 populate_metadata read hostname 'smithi003' 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86f520 0x55fbab86f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 4 client.5511 mds_command: new command op to 5334 tid=0[{"prefix": "status"}] 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 --> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f02f4014be0 con 0x55fbab86f520 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f03037fe640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86f520 0x55fbab86f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f03037fe640 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86f520 0x55fbab86f8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a282217190bd7331 server_cookie=caaf25a7b6e8f94f in_seq=0 out_seq=0 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f02e27fc640 10 client.5511 ms_handle_connect on v2:172.21.15.3:6834/3253181122 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f02e27fc640 1 -- 172.21.15.3:0/4091620711 <== mds.0 v2:172.21.15.3:6834/3253181122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f02f4014be0 con 0x55fbab86f520 2023-05-17T11:46:47.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f02e27fc640 10 client.5511 handle_command_reply: tid=0 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 client.5511 shutdown 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 msgr2=0x55fbab86eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab86eaa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f02f801a0c0 tx=0x7f02f801acd0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 shutdown_connections 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:6834/3253181122,v1:172.21.15.3:6835/3253181122] conn(0x55fbab86f520 0x55fbab86f8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x55fbab85e070 0x55fbab86efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fbab85d760 0x55fbab86eaa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 --2- 172.21.15.3:0/4091620711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbab811020 0x55fbab8b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f02e27fc640 0 client.5511 ms_handle_reset on v2:172.21.15.3:6834/3253181122 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 >> 172.21.15.3:0/4091620711 conn(0x55fbab83e710 msgr2=0x55fbab85c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 shutdown_connections 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 1 -- 172.21.15.3:0/4091620711 wait complete. 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f030cde5000 20 client.5511 trim_cache size 0 max 16384 2023-05-17T11:46:47.611 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-05-17T11:46:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "ae6aed9e-9392-45b7-b249-815180a4cc03", 2023-05-17T11:46:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-05-17T11:46:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5334, 2023-05-17T11:46:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-05-17T11:46:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-05-17T11:46:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-05-17T11:46:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 5.8496730880000003, 2023-05-17T11:46:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 16, 2023-05-17T11:46:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 37, 2023-05-17T11:46:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 37, 2023-05-17T11:46:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 13.639755385000001 2023-05-17T11:46:47.613 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-05-17T11:46:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f02f0066280 msgr2=0x7f02f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f02f0066280 0x7f02f0068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f02f40011f0 tx=0x7f02f4009040 comp rx=0 tx=0).stop 2023-05-17T11:46:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 msgr2=0x7f0304152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 0x7f0304152d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00caf0 tx=0x7f02fc00a060 comp rx=0 tx=0).stop 2023-05-17T11:46:47.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 shutdown_connections 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f02f0066280 0x7f02f0068730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030415c1e0 0x7f0304152d30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f03040c9a50 0x7f030413b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 --2- 172.21.15.3:0/794309166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030406a490 0x7f03040b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 >> 172.21.15.3:0/794309166 conn(0x7f03040cf940 msgr2=0x7f0304069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 shutdown_connections 2023-05-17T11:46:47.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.598+0000 7f0309a8c640 1 -- 172.21.15.3:0/794309166 wait complete. 2023-05-17T11:46:47.622 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T11:46:47.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 Processor -- start 2023-05-17T11:46:47.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 -- start start 2023-05-17T11:46:47.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80160720 0x7f5c800cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5c8006a1c0 0x7f5c800cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c801649e0 con 0x7f5c80164e70 2023-05-17T11:46:47.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c800c19e0 con 0x7f5c8006a1c0 2023-05-17T11:46:47.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.754+0000 7f5c87de1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80160af0 con 0x7f5c80160720 2023-05-17T11:46:47.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8637e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5c8006a1c0 0x7f5c800cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8537c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5c80164e70 0x7f5c80069ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59310/0 (socket says 172.21.15.3:59310) 2023-05-17T11:46:47.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8537c640 1 -- 172.21.15.3:0/3323167008 learned_addr learned my addr 172.21.15.3:0/3323167008 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:46:47.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8637e640 1 -- 172.21.15.3:0/3323167008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80160720 msgr2=0x7f5c800cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:46:47.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8637e640 1 --2- 172.21.15.3:0/3323167008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80160720 0x7f5c800cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8637e640 1 -- 172.21.15.3:0/3323167008 >> v1:172.21.15.3:6789/0 conn(0x7f5c80164e70 legacy=0x7f5c80069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8637e640 1 -- 172.21.15.3:0/3323167008 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800c8e50 con 0x7f5c8006a1c0 2023-05-17T11:46:47.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c8637e640 1 --2- 172.21.15.3:0/3323167008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c8006a1c0 0x7f5c800cbf80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009d90 tx=0x7f5c7801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac7ed120c1d2783 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c84b7b640 1 -- 172.21.15.3:0/3323167008 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780a5900 con 0x7f5c8006a1c0 2023-05-17T11:46:47.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c84b7b640 1 -- 172.21.15.3:0/3323167008 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c780a5a60 con 0x7f5c8006a1c0 2023-05-17T11:46:47.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.758+0000 7f5c84b7b640 1 -- 172.21.15.3:0/3323167008 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780a5df0 con 0x7f5c8006a1c0 2023-05-17T11:46:47.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- 172.21.15.3:0/3323167008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c8006a1c0 msgr2=0x7f5c800cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 --2- 172.21.15.3:0/3323167008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c8006a1c0 0x7f5c800cbf80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009d90 tx=0x7f5c7801c950 comp rx=0 tx=0).stop 2023-05-17T11:46:47.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- 172.21.15.3:0/3323167008 shutdown_connections 2023-05-17T11:46:47.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 --2- 172.21.15.3:0/3323167008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c8006a1c0 0x7f5c800cbf80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 --2- 172.21.15.3:0/3323167008 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80160720 0x7f5c800cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- 172.21.15.3:0/3323167008 >> 172.21.15.3:0/3323167008 conn(0x7f5c800b0b30 msgr2=0x7f5c800cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- 172.21.15.3:0/3323167008 shutdown_connections 2023-05-17T11:46:47.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- 172.21.15.3:0/3323167008 wait complete. 2023-05-17T11:46:47.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 Processor -- start 2023-05-17T11:46:47.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- start start 2023-05-17T11:46:47.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8006a1c0 0x7f5c80156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 0x7f5c80071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80164e70 0x7f5c80071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c801570e0 con 0x7f5c80160720 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800c22a0 con 0x7f5c8006a1c0 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c87de1640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80157330 con 0x7f5c80164e70 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 0x7f5c80071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 0x7f5c80071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45482/0 (socket says 172.21.15.3:45482) 2023-05-17T11:46:47.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 -- 172.21.15.3:0/545702716 learned_addr learned my addr 172.21.15.3:0/545702716 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:46:47.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8637e640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80164e70 0x7f5c80071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c85b7d640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8006a1c0 0x7f5c80156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 -- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80164e70 msgr2=0x7f5c80071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80164e70 0x7f5c80071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 -- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8006a1c0 msgr2=0x7f5c80156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8006a1c0 0x7f5c80156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8537c640 1 -- 172.21.15.3:0/545702716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009a70 con 0x7f5c80160720 2023-05-17T11:46:47.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.762+0000 7f5c8637e640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80164e70 0x7f5c80071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c8537c640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 0x7f5c80071020 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000c400 tx=0x7f5c7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70005cf0 con 0x7f5c80160720 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70005e50 con 0x7f5c80160720 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700072d0 con 0x7f5c80160720 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800ca980 con 0x7f5c80160720 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c800ca7f0 con 0x7f5c80160720 2023-05-17T11:46:47.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c800c8a00 con 0x7f5c80160720 2023-05-17T11:46:47.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c70007430 con 0x7f5c80160720 2023-05-17T11:46:47.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c767fc640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5c64066280 0x7f5c64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:46:47.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c70083290 con 0x7f5c80160720 2023-05-17T11:46:47.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.766+0000 7f5c85b7d640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5c64066280 0x7f5c64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:46:47.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.770+0000 7f5c85b7d640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5c64066280 0x7f5c64068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:46:47.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.770+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5c70050720 con 0x7f5c80160720 2023-05-17T11:46:47.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c8004de80 con 0x7f5c80160720 2023-05-17T11:46:47.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c767fc640 1 -- 172.21.15.3:0/545702716 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c70053d40 con 0x7f5c80160720 2023-05-17T11:46:47.967 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T11:46:47.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5c64066280 msgr2=0x7f5c64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5c64066280 0x7f5c64068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c008040 comp rx=0 tx=0).stop 2023-05-17T11:46:47.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 msgr2=0x7f5c80071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:46:47.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 0x7f5c80071020 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000c400 tx=0x7f5c7000c8c0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 shutdown_connections 2023-05-17T11:46:47.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5c64066280 0x7f5c64068730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f5c80164e70 0x7f5c80071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c80160720 0x7f5c80071020 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 --2- 172.21.15.3:0/545702716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8006a1c0 0x7f5c80156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:46:47.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 >> 172.21.15.3:0/545702716 conn(0x7f5c800b0b30 msgr2=0x7f5c8006fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:46:47.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 shutdown_connections 2023-05-17T11:46:47.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:46:47.962+0000 7f5c87de1640 1 -- 172.21.15.3:0/545702716 wait complete. 2023-05-17T11:46:47.987 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T11:46:47.987 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T11:46:47.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-05-17T11:46:47.988 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T11:46:47.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:47.988 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T11:46:47.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T11:46:47.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T11:46:47.989 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T11:46:47.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:47.990 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-05-17T11:46:47.998 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T11:46:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T11:46:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T11:46:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42174sec preferred_lft 42174sec 2023-05-17T11:46:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-05-17T11:46:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:50:a2:40:8c brd ff:ff:ff:ff:ff:ff 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:48.001 INFO:teuthology.orchestra.run.smithi003.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T11:46:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-05-17T11:46:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:48.003 INFO:teuthology.orchestra.run.smithi003.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T11:46:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T11:46:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-05-17T11:46:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-05-17T11:46:48.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.004 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T11:46:48.062 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-05-17T11:46:48.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.065 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-05-17T11:46:48.118 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-05-17T11:46:48.118 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T11:46:48.118 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-17T11:46:48.118 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-17T11:46:48.118 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-17T11:46:48.119 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T11:46:48.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.119 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-05-17T11:46:48.119 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-05-17T11:46:48.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T11:46:48.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T11:46:48.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T11:46:48.121 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-05-17T11:46:48.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.214 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-05-17T11:46:48.261 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T11:46:48.261 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T11:46:48.262 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T11:46:48.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-05-17T11:46:48.324 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-17T11:46:48.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:46:48.325 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:48.377 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-17T11:46:48.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T11:46:48.378 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:48.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:46:48.484 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:46:48.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:46:48.543 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:46:48.544 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:46:48.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.545 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:46:48.593 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T11:46:48.593 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-17T11:46:48.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:46:48.655 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:46:48.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:46:48.715 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:46:48.716 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:46:48.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:48.717 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:46:48.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-05-17T11:46:48.722+0000 7fbbdad05580 -1 init, newargv = 0x561099b296c0 newargc=15 2023-05-17T11:46:48.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[47720]: starting ceph client 2023-05-17T11:46:48.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[47720]: starting fuse 2023-05-17T11:46:49.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-05-17T11:46:49.862 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T11:46:49.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T11:46:49.924 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T11:46:49.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T11:46:49.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:49.927 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-05-17T11:46:49.978 INFO:teuthology.orchestra.run.smithi003.stdout:42 2023-05-17T11:46:49.978 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-17T11:46:49.979 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T11:46:49.979 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-05-17T11:46:49.979 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-05-17T11:46:49.980 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-05-17T11:46:49.980 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-05-17T11:46:49.980 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:46:49.980 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-05-17T11:46:49.981 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-17T11:46:49.981 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-05-17T11:46:49.981 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-17T11:46:49.982 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:46:49.982 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-05-17T11:46:49.982 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-05-17T11:46:49.983 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-05-17T11:46:49.983 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-05-17T11:46:49.983 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:46:49.983 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-05-17T11:46:49.984 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T11:46:49.984 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T11:46:49.984 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T11:46:49.985 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-05-17T11:46:49.985 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-05-17T11:46:49.985 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-05-17T11:46:49.985 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T11:46:49.986 DEBUG:teuthology.orchestra.run.smithi003:> 2023-05-17T11:46:49.986 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-05-17T11:46:49.986 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-05-17T11:46:50.109 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.47720.asok 2023-05-17T11:46:50.292 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47720.asok 2023-05-17T11:46:50.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:50.293 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47720.asok status 2023-05-17T11:46:50.472 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-05-17T11:46:50.472 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "47720", 2023-05-17T11:46:50.473 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5529, 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-05-17T11:46:50.474 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 5529 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3146048718 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-05-17T11:46:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3146048718 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.5529 192.168.0.1:0/3146048718", 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/3146048718", 2023-05-17T11:46:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-05-17T11:46:50.477 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 16, 2023-05-17T11:46:50.477 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 37, 2023-05-17T11:46:50.477 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-05-17T11:46:50.477 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-05-17T11:46:50.477 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-05-17T11:46:50.477 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-05-17T11:46:50.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:50.487 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-05-17T11:46:50.488 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:50.496 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-05-17T11:46:50.496 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:50.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:50.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T11:46:50.557 DEBUG:teuthology.orchestra.run.smithi003:> mktemp -d --suffix=xfstests-dev 2023-05-17T11:46:50.604 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.wZOEk1XGhTxfstests-dev 2023-05-17T11:46:50.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:50.605 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.wZOEk1XGhTxfstests-dev) 2023-05-17T11:46:50.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:50.670 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.wZOEk1XGhTxfstests-dev) 2023-05-17T11:46:50.726 INFO:teuthology.orchestra.run.smithi003.stderr:Cloning into '/tmp/tmp.wZOEk1XGhTxfstests-dev'... 2023-05-17T11:46:51.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:51.603 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-17T11:46:51.661 DEBUG:teuthology.orchestra.run.smithi003:> mktemp -d --suffix=test 2023-05-17T11:46:51.709 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.byg0vFAYA5test 2023-05-17T11:46:51.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:46:51.710 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-17T11:46:51.764 DEBUG:teuthology.orchestra.run.smithi003:> mktemp -d --suffix=scratch 2023-05-17T11:46:51.812 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.onEbcuImNJscratch 2023-05-17T11:46:51.813 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-05-17T11:46:51.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-05-17T11:46:51.926 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-05-17T11:46:52.083 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-05-17T11:46:52.084 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-05-17T11:46:52.226 INFO:teuthology.orchestra.run.smithi003.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-05-17T11:46:52.226 INFO:teuthology.orchestra.run.smithi003.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:gawk is already the newest version (1:5.1.0-1build3). 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:gcc set to manually installed. 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-05-17T11:46:52.227 INFO:teuthology.orchestra.run.smithi003.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:make is already the newest version (4.3-4.1build1). 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:make set to manually installed. 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:quota is already the newest version (4.06-1build2). 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-05-17T11:46:52.228 INFO:teuthology.orchestra.run.smithi003.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout:dbench is already the newest version (4.0-2build1). 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout:python2 is already the newest version (2.7.18-3). 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout:python2 set to manually installed. 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-05-17T11:46:52.229 INFO:teuthology.orchestra.run.smithi003.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-05-17T11:46:52.230 INFO:teuthology.orchestra.run.smithi003.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-05-17T11:46:52.230 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-17T11:46:52.230 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-05-17T11:46:52.231 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemblk1 2023-05-17T11:46:52.231 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-05-17T11:46:52.231 INFO:teuthology.orchestra.run.smithi003.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-05-17T11:46:52.260 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-05-17T11:46:52.261 INFO:teuthology.orchestra.run.smithi003.stdout: fio libgdbm-dev libpmemblk1 sqlite3 2023-05-17T11:46:52.455 INFO:teuthology.orchestra.run.smithi003.stdout:0 upgraded, 4 newly installed, 0 to remove and 147 not upgraded. 2023-05-17T11:46:52.456 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 4,997 kB of archives. 2023-05-17T11:46:52.456 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 9,949 kB of additional disk space will be used. 2023-05-17T11:46:52.456 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-05-17T11:46:52.785 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-05-17T11:46:59.935 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-05-17T11:47:00.148 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-05-17T11:47:02.005 INFO:teuthology.orchestra.run.smithi003.stderr:debconf: unable to initialize frontend: Dialog 2023-05-17T11:47:02.005 INFO:teuthology.orchestra.run.smithi003.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-05-17T11:47:02.006 INFO:teuthology.orchestra.run.smithi003.stderr:debconf: falling back to frontend: Readline 2023-05-17T11:47:02.024 INFO:teuthology.orchestra.run.smithi003.stderr:debconf: unable to initialize frontend: Readline 2023-05-17T11:47:02.025 INFO:teuthology.orchestra.run.smithi003.stderr:debconf: (This frontend requires a controlling tty.) 2023-05-17T11:47:02.025 INFO:teuthology.orchestra.run.smithi003.stderr:debconf: falling back to frontend: Teletype 2023-05-17T11:47:02.031 INFO:teuthology.orchestra.run.smithi003.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-05-17T11:47:02.071 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 4,997 kB in 9s (528 kB/s) 2023-05-17T11:47:02.243 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-05-17T11:47:02.319 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142706 files and directories currently installed.) 2023-05-17T11:47:02.323 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-05-17T11:47:02.407 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-05-17T11:47:02.735 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package fio. 2023-05-17T11:47:02.749 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-05-17T11:47:02.802 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking fio (3.28-1) ... 2023-05-17T11:47:03.223 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-05-17T11:47:03.236 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../libgdbm-dev_1.23-1_amd64.deb ... 2023-05-17T11:47:03.273 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-05-17T11:47:03.577 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package sqlite3. 2023-05-17T11:47:03.590 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-05-17T11:47:03.626 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-05-17T11:47:03.897 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-05-17T11:47:04.022 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-05-17T11:47:04.148 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-05-17T11:47:04.258 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up fio (3.28-1) ... 2023-05-17T11:47:04.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:47:04.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:47:05.012 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-17T11:47:05.171 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-17T11:47:06.919 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-17T11:47:07.678 DEBUG:teuthology.orchestra.run.smithi003:> sudo useradd -m fsgqa 2023-05-17T11:47:07.696 INFO:teuthology.orchestra.run.smithi003.stderr:useradd: user 'fsgqa' already exists 2023-05-17T11:47:07.698 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-17T11:47:07.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo groupadd fsgqa 2023-05-17T11:47:07.758 INFO:teuthology.orchestra.run.smithi003.stderr:groupadd: group 'fsgqa' already exists 2023-05-17T11:47:07.759 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-17T11:47:07.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo useradd fsgqa2 2023-05-17T11:47:08.116 DEBUG:teuthology.orchestra.run.smithi003:> sudo useradd 123456-fsgqa 2023-05-17T11:47:08.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-17T11:47:08.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 Processor -- start 2023-05-17T11:47:08.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 -- start start 2023-05-17T11:47:08.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43d00b1d30 0x7f43d006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:08.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00d0a40 0x7f43d00cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:08.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d006b3c0 con 0x7f43d00cf190 2023-05-17T11:47:08.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b2100 con 0x7f43d00b1d30 2023-05-17T11:47:08.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43d49be640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d006b5f0 con 0x7f43d00d0a40 2023-05-17T11:47:08.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cffff640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00d0a40 0x7f43d00cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43ceffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43d00cf190 0x7f43d00d0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.3:38054/0 (socket says 172.21.15.3:38054) 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43ceffd640 1 -- 172.21.15.3:0/3846490181 learned_addr learned my addr 172.21.15.3:0/3846490181 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cf7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43d00b1d30 0x7f43d006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43ce7fc640 1 -- 172.21.15.3:0/3846490181 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632794172 0 0) 0x7f43d006b3c0 con 0x7f43d00cf190 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43ce7fc640 1 -- 172.21.15.3:0/3846490181 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b8003530 con 0x7f43d00cf190 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cffff640 1 -- 172.21.15.3:0/3846490181 >> v2:172.21.15.60:3300/0 conn(0x7f43d00b1d30 msgr2=0x7f43d006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T11:47:08.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cffff640 1 --2- 172.21.15.3:0/3846490181 >> v2:172.21.15.60:3300/0 conn(0x7f43d00b1d30 0x7f43d006ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cffff640 1 -- 172.21.15.3:0/3846490181 >> v1:172.21.15.60:6789/0 conn(0x7f43d00cf190 legacy=0x7f43d00d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:08.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cffff640 1 -- 172.21.15.3:0/3846490181 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d006b8d0 con 0x7f43d00d0a40 2023-05-17T11:47:08.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.634+0000 7f43cf7fe640 1 --2- 172.21.15.3:0/3846490181 >> v2:172.21.15.60:3300/0 conn(0x7f43d00b1d30 0x7f43d006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T11:47:08.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.638+0000 7f43cffff640 1 --2- 172.21.15.3:0/3846490181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00d0a40 0x7f43d00cd350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009d90 tx=0x7f43c801f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126dcedc0498b426 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:47:08.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43ce7fc640 1 -- 172.21.15.3:0/3846490181 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80af600 con 0x7f43d00d0a40 2023-05-17T11:47:08.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43ce7fc640 1 -- 172.21.15.3:0/3846490181 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80ab050 con 0x7f43d00d0a40 2023-05-17T11:47:08.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43ce7fc640 1 -- 172.21.15.3:0/3846490181 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80af980 con 0x7f43d00d0a40 2023-05-17T11:47:08.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- 172.21.15.3:0/3846490181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00d0a40 msgr2=0x7f43d00cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:08.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 --2- 172.21.15.3:0/3846490181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00d0a40 0x7f43d00cd350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009d90 tx=0x7f43c801f130 comp rx=0 tx=0).stop 2023-05-17T11:47:08.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- 172.21.15.3:0/3846490181 shutdown_connections 2023-05-17T11:47:08.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 --2- 172.21.15.3:0/3846490181 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00d0a40 0x7f43d00cd350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 --2- 172.21.15.3:0/3846490181 >> v2:172.21.15.60:3300/0 conn(0x7f43d00b1d30 0x7f43d006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- 172.21.15.3:0/3846490181 >> 172.21.15.3:0/3846490181 conn(0x7f43d0071b00 msgr2=0x7f43d009bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:47:08.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- 172.21.15.3:0/3846490181 shutdown_connections 2023-05-17T11:47:08.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- 172.21.15.3:0/3846490181 wait complete. 2023-05-17T11:47:08.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 Processor -- start 2023-05-17T11:47:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- start start 2023-05-17T11:47:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43d00b1d30 0x7f43d0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00cf190 0x7f43d00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 0x7f43d00b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01f2160 con 0x7f43d00d0a40 2023-05-17T11:47:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01f1150 con 0x7f43d00b1d30 2023-05-17T11:47:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.642+0000 7f43d49be640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b2250 con 0x7f43d00cf190 2023-05-17T11:47:08.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 0x7f43d00b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:08.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 0x7f43d00b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53028/0 (socket says 172.21.15.3:53028) 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 -- 172.21.15.3:0/526776496 learned_addr learned my addr 172.21.15.3:0/526776496 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43ceffd640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00cf190 0x7f43d00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cf7fe640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43d00b1d30 0x7f43d0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 -- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00cf190 msgr2=0x7f43d00b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00cf190 0x7f43d00b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 -- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43d00b1d30 msgr2=0x7f43d0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:08.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43d00b1d30 0x7f43d0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 -- 172.21.15.3:0/526776496 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009420 con 0x7f43d00d0a40 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43cffff640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 0x7f43d00b4c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f43c801cd60 tx=0x7f43c801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80afbf0 con 0x7f43d00d0a40 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80afd50 con 0x7f43d00d0a40 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80ba660 con 0x7f43d00d0a40 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8009a70 con 0x7f43d00d0a40 2023-05-17T11:47:08.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d00cce50 con 0x7f43d00d0a40 2023-05-17T11:47:08.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d006bbb0 con 0x7f43d00d0a40 2023-05-17T11:47:08.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.646+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43c80ba7c0 con 0x7f43d00d0a40 2023-05-17T11:47:08.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.650+0000 7f43b7fff640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43bc0662d0 0x7f43bc068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:08.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.650+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43c8122580 con 0x7f43d00d0a40 2023-05-17T11:47:08.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.650+0000 7f43cf7fe640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43bc0662d0 0x7f43bc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:08.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.650+0000 7f43cf7fe640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43bc0662d0 0x7f43bc068780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f43d015b470 tx=0x7f43c0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:47:08.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.654+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f43c80efa90 con 0x7f43d00d0a40 2023-05-17T11:47:08.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f43d006be90 con 0x7f43d00d0a40 2023-05-17T11:47:08.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43b7fff640 1 -- 172.21.15.3:0/526776496 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1264 (secure 0 0 0) 0x7f43c80f30b0 con 0x7f43d00d0a40 2023-05-17T11:47:08.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:47:08.879 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":1,"fsid":"ae6aed9e-9392-45b7-b249-815180a4cc03","modified":"2023-05-17T11:44:36.183370Z","created":"2023-05-17T11:44:36.183370Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-17T11:47:08.879 INFO:teuthology.orchestra.run.smithi003.stderr:dumped monmap epoch 1 2023-05-17T11:47:08.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43bc0662d0 msgr2=0x7f43bc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:08.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43bc0662d0 0x7f43bc068780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f43d015b470 tx=0x7f43c0009190 comp rx=0 tx=0).stop 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 msgr2=0x7f43d00b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 0x7f43d00b4c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f43c801cd60 tx=0x7f43c801bed0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 shutdown_connections 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f43bc0662d0 0x7f43bc068780 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43d00d0a40 0x7f43d00b4c40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f43d00cf190 0x7f43d00b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 --2- 172.21.15.3:0/526776496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43d00b1d30 0x7f43d0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:08.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 >> 172.21.15.3:0/526776496 conn(0x7f43d0071b00 msgr2=0x7f43d00d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:47:08.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 shutdown_connections 2023-05-17T11:47:08.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:08.874+0000 7f43d49be640 1 -- 172.21.15.3:0/526776496 wait complete. 2023-05-17T11:47:08.899 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-17T11:47:09.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.030+0000 7f556c2fc640 1 Processor -- start 2023-05-17T11:47:09.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.030+0000 7f556c2fc640 1 -- start start 2023-05-17T11:47:09.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556c2fc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640ad8a0 0x7f55640ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:09.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556c2fc640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55640c8a30 con 0x7f55640b1d70 2023-05-17T11:47:09.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556c2fc640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55640adc70 con 0x7f55640b1230 2023-05-17T11:47:09.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556c2fc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640cbcf0 con 0x7f55640ad8a0 2023-05-17T11:47:09.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556a899640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f55640b1d70 0x7f5564070220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60522/0 (socket says 172.21.15.3:60522) 2023-05-17T11:47:09.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556a899640 1 -- 172.21.15.3:0/488828918 learned_addr learned my addr 172.21.15.3:0/488828918 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-05-17T11:47:09.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556a098640 1 --2- 172.21.15.3:0/488828918 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640ad8a0 0x7f55640ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:09.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61493874 0 0) 0x7f55640c8a30 con 0x7f55640b1d70 2023-05-17T11:47:09.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5550003530 con 0x7f55640b1d70 2023-05-17T11:47:09.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 <== mon.1 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285707512 0 0) 0x7f55640adc70 con 0x7f55640b1230 2023-05-17T11:47:09.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55640c8a30 con 0x7f55640b1230 2023-05-17T11:47:09.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556a098640 1 -- 172.21.15.3:0/488828918 >> v1:172.21.15.60:6789/0 conn(0x7f55640b1230 legacy=0x7f55640b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556a098640 1 -- 172.21.15.3:0/488828918 >> v1:172.21.15.3:6789/0 conn(0x7f55640b1d70 legacy=0x7f5564070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1528844083 0 0) 0x7f5550003530 con 0x7f55640b1d70 2023-05-17T11:47:09.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.034+0000 7f556a098640 1 -- 172.21.15.3:0/488828918 --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640c8c80 con 0x7f55640ad8a0 2023-05-17T11:47:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556a098640 1 --2- 172.21.15.3:0/488828918 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640ad8a0 0x7f55640ca710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55600097d0 tx=0x7f556001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5cf22e06cbbadaa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:47:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 <== mon.2 v2:172.21.15.60:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c001a00 con 0x7f55640ad8a0 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 <== mon.2 v2:172.21.15.60:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55600ac440 con 0x7f55640ad8a0 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f5569096640 1 -- 172.21.15.3:0/488828918 <== mon.2 v2:172.21.15.60:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55600ac7d0 con 0x7f55640ad8a0 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 -- 172.21.15.3:0/488828918 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640ad8a0 msgr2=0x7f55640ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 --2- 172.21.15.3:0/488828918 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640ad8a0 0x7f55640ca710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55600097d0 tx=0x7f556001c390 comp rx=0 tx=0).stop 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 -- 172.21.15.3:0/488828918 shutdown_connections 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 --2- 172.21.15.3:0/488828918 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640ad8a0 0x7f55640ca710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 -- 172.21.15.3:0/488828918 >> 172.21.15.3:0/488828918 conn(0x7f55640b0b20 msgr2=0x7f55640cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:47:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 -- 172.21.15.3:0/488828918 shutdown_connections 2023-05-17T11:47:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 -- 172.21.15.3:0/488828918 wait complete. 2023-05-17T11:47:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.038+0000 7f556c2fc640 1 Processor -- start 2023-05-17T11:47:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- start start 2023-05-17T11:47:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 0x7f55641534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 --2- >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640b1230 0x7f55640c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55640b1d70 0x7f55640c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556409b7f0 con 0x7f55640ad8a0 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556409c000 con 0x7f55640b1d70 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- --> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55641527b0 con 0x7f55640b1230 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 0x7f55641534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 0x7f55641534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53040/0 (socket says 172.21.15.3:53040) 2023-05-17T11:47:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 -- 172.21.15.3:0/559999937 learned_addr learned my addr 172.21.15.3:0/559999937 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a899640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55640b1d70 0x7f55640c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f5569897640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640b1230 0x7f55640c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 -- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640b1230 msgr2=0x7f55640c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640b1230 0x7f55640c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 -- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55640b1d70 msgr2=0x7f55640c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55640b1d70 0x7f55640c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 -- 172.21.15.3:0/559999937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600093b0 con 0x7f55640ad8a0 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a899640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55640b1d70 0x7f55640c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f5569897640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640b1230 0x7f55640c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556a098640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 0x7f55641534e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f55600af040 tx=0x7f556001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560005ba0 con 0x7f55640ad8a0 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5560005d00 con 0x7f55640ad8a0 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5564071140 con 0x7f55640ad8a0 2023-05-17T11:47:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560006260 con 0x7f55640ad8a0 2023-05-17T11:47:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55640c9240 con 0x7f55640ad8a0 2023-05-17T11:47:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55640712d0 con 0x7f55640ad8a0 2023-05-17T11:47:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.042+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55600063c0 con 0x7f55640ad8a0 2023-05-17T11:47:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.046+0000 7f555affd640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5548066280 0x7f5548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T11:47:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.046+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f556011e4a0 con 0x7f55640ad8a0 2023-05-17T11:47:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.046+0000 7f5569897640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5548066280 0x7f5548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T11:47:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.046+0000 7f5569897640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5548066280 0x7f5548068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5564153e40 tx=0x7f5554009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T11:47:09.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.050+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f55600eb910 con 0x7f55640ad8a0 2023-05-17T11:47:09.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f556404de80 con 0x7f55640ad8a0 2023-05-17T11:47:09.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f555affd640 1 -- 172.21.15.3:0/559999937 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v15) v1 ==== 82+0+151 (secure 0 0 0) 0x7f55600eef30 con 0x7f55640ad8a0 2023-05-17T11:47:09.260 INFO:teuthology.orchestra.run.smithi003.stdout:[client.admin] 2023-05-17T11:47:09.260 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAkvmRkcD2dGBAAbGB4+Hn2JC6DZhZYiHcHfw== 2023-05-17T11:47:09.261 INFO:teuthology.orchestra.run.smithi003.stdout: caps mds = "allow *" 2023-05-17T11:47:09.261 INFO:teuthology.orchestra.run.smithi003.stdout: caps mgr = "allow *" 2023-05-17T11:47:09.261 INFO:teuthology.orchestra.run.smithi003.stdout: caps mon = "allow *" 2023-05-17T11:47:09.261 INFO:teuthology.orchestra.run.smithi003.stdout: caps osd = "allow *" 2023-05-17T11:47:09.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5548066280 msgr2=0x7f5548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5548066280 0x7f5548068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5564153e40 tx=0x7f5554009040 comp rx=0 tx=0).stop 2023-05-17T11:47:09.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 msgr2=0x7f55641534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T11:47:09.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 0x7f55641534e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f55600af040 tx=0x7f556001abd0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 shutdown_connections 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:6832/2126677587,v1:172.21.15.3:6833/2126677587] conn(0x7f5548066280 0x7f5548068730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55640b1d70 0x7f55640c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] conn(0x7f55640b1230 0x7f55640c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 --2- 172.21.15.3:0/559999937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55640ad8a0 0x7f55641534e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 >> 172.21.15.3:0/559999937 conn(0x7f55640b0b20 msgr2=0x7f55640b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 shutdown_connections 2023-05-17T11:47:09.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-05-17T11:47:09.254+0000 7f556c2fc640 1 -- 172.21.15.3:0/559999937 wait complete. 2023-05-17T11:47:09.280 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-05-17T11:47:09.288 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.qBl6n6cVEO 2023-05-17T11:47:09.289 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:47:09.289 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/tmp/tmp.qBl6n6cVEO 2023-05-17T11:47:09.340 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:47:09.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/tmp/tmp.wZOEk1XGhTxfstests-dev/local.config 2023-05-17T11:47:09.400 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.byg0vFAYA5test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.onEbcuImNJscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.3:6789 -k /tmp/tmp.qBl6n6cVEO --client_mountpoint /test" 2023-05-17T11:47:09.400 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-05-17T11:47:09.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/tmp/tmp.wZOEk1XGhTxfstests-dev/ceph.exclude 2023-05-17T11:47:09.459 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo make) 2023-05-17T11:47:09.524 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize -cfi 2023-05-17T11:47:10.053 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-17T11:47:10.053 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file './config.guess' 2023-05-17T11:47:10.061 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file './config.sub' 2023-05-17T11:47:10.088 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file './install-sh' 2023-05-17T11:47:10.098 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file './ltmain.sh' 2023-05-17T11:47:10.137 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-17T11:47:10.137 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-17T11:47:10.154 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-17T11:47:10.163 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-17T11:47:10.173 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-17T11:47:10.182 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-17T11:47:10.192 INFO:teuthology.orchestra.run.smithi003.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-17T11:47:10.194 INFO:teuthology.orchestra.run.smithi003.stdout:cp include/install-sh . 2023-05-17T11:47:10.195 INFO:teuthology.orchestra.run.smithi003.stdout:aclocal -I m4 2023-05-17T11:47:11.255 INFO:teuthology.orchestra.run.smithi003.stdout:autoheader 2023-05-17T11:47:11.623 INFO:teuthology.orchestra.run.smithi003.stdout:autoconf 2023-05-17T11:47:12.037 INFO:teuthology.orchestra.run.smithi003.stdout:./configure \ 2023-05-17T11:47:12.037 INFO:teuthology.orchestra.run.smithi003.stdout: --libexecdir=/usr/lib \ 2023-05-17T11:47:12.037 INFO:teuthology.orchestra.run.smithi003.stdout: --exec_prefix=/var/lib 2023-05-17T11:47:12.555 INFO:teuthology.orchestra.run.smithi003.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-17T11:47:12.555 INFO:teuthology.orchestra.run.smithi003.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-17T11:47:12.607 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to print strings... printf 2023-05-17T11:47:12.607 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gcc... gcc 2023-05-17T11:47:12.836 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether the C compiler works... yes 2023-05-17T11:47:12.837 INFO:teuthology.orchestra.run.smithi003.stdout:checking for C compiler default output file name... a.out 2023-05-17T11:47:12.878 INFO:teuthology.orchestra.run.smithi003.stdout:checking for suffix of executables... 2023-05-17T11:47:12.954 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether we are cross compiling... no 2023-05-17T11:47:12.979 INFO:teuthology.orchestra.run.smithi003.stdout:checking for suffix of object files... o 2023-05-17T11:47:13.001 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether the compiler supports GNU C... yes 2023-05-17T11:47:13.024 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether gcc accepts -g... yes 2023-05-17T11:47:13.133 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gcc option to enable C11 features... none needed 2023-05-17T11:47:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-05-17T11:47:13.143 INFO:teuthology.orchestra.run.smithi003.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-17T11:47:13.146 INFO:teuthology.orchestra.run.smithi003.stdout:checking for egrep... /usr/bin/grep -E 2023-05-17T11:47:13.148 INFO:teuthology.orchestra.run.smithi003.stdout:checking for fgrep... /usr/bin/grep -F 2023-05-17T11:47:13.155 INFO:teuthology.orchestra.run.smithi003.stdout:checking for ld used by gcc... /usr/bin/ld 2023-05-17T11:47:13.159 INFO:teuthology.orchestra.run.smithi003.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-05-17T11:47:13.171 INFO:teuthology.orchestra.run.smithi003.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-05-17T11:47:13.200 INFO:teuthology.orchestra.run.smithi003.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-05-17T11:47:13.200 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether ln -s works... yes 2023-05-17T11:47:13.233 INFO:teuthology.orchestra.run.smithi003.stdout:checking the maximum length of command line arguments... 1572864 2023-05-17T11:47:13.238 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-17T11:47:13.238 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-17T11:47:13.238 INFO:teuthology.orchestra.run.smithi003.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-05-17T11:47:13.239 INFO:teuthology.orchestra.run.smithi003.stdout:checking for objdump... objdump 2023-05-17T11:47:13.239 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to recognize dependent libraries... pass_all 2023-05-17T11:47:13.240 INFO:teuthology.orchestra.run.smithi003.stdout:checking for dlltool... no 2023-05-17T11:47:13.240 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-17T11:47:13.241 INFO:teuthology.orchestra.run.smithi003.stdout:checking for ar... ar 2023-05-17T11:47:13.288 INFO:teuthology.orchestra.run.smithi003.stdout:checking for archiver @FILE support... @ 2023-05-17T11:47:13.288 INFO:teuthology.orchestra.run.smithi003.stdout:checking for strip... strip 2023-05-17T11:47:13.289 INFO:teuthology.orchestra.run.smithi003.stdout:checking for ranlib... ranlib 2023-05-17T11:47:13.289 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gawk... gawk 2023-05-17T11:47:13.373 INFO:teuthology.orchestra.run.smithi003.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-05-17T11:47:13.375 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sysroot... no 2023-05-17T11:47:13.383 INFO:teuthology.orchestra.run.smithi003.stdout:checking for a working dd... /usr/bin/dd 2023-05-17T11:47:13.389 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-05-17T11:47:13.408 INFO:teuthology.orchestra.run.smithi003.stdout:checking for mt... mt 2023-05-17T11:47:13.423 INFO:teuthology.orchestra.run.smithi003.stdout:checking if mt is a manifest tool... no 2023-05-17T11:47:13.455 INFO:teuthology.orchestra.run.smithi003.stdout:checking for stdio.h... yes 2023-05-17T11:47:13.535 INFO:teuthology.orchestra.run.smithi003.stdout:checking for stdlib.h... yes 2023-05-17T11:47:13.568 INFO:teuthology.orchestra.run.smithi003.stdout:checking for string.h... yes 2023-05-17T11:47:13.612 INFO:teuthology.orchestra.run.smithi003.stdout:checking for inttypes.h... yes 2023-05-17T11:47:13.644 INFO:teuthology.orchestra.run.smithi003.stdout:checking for stdint.h... yes 2023-05-17T11:47:13.676 INFO:teuthology.orchestra.run.smithi003.stdout:checking for strings.h... yes 2023-05-17T11:47:13.713 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/stat.h... yes 2023-05-17T11:47:13.745 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/types.h... yes 2023-05-17T11:47:13.801 INFO:teuthology.orchestra.run.smithi003.stdout:checking for unistd.h... yes 2023-05-17T11:47:13.839 INFO:teuthology.orchestra.run.smithi003.stdout:checking for dlfcn.h... yes 2023-05-17T11:47:13.845 INFO:teuthology.orchestra.run.smithi003.stdout:checking for objdir... .libs 2023-05-17T11:47:13.947 INFO:teuthology.orchestra.run.smithi003.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-17T11:47:13.947 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-17T11:47:13.973 INFO:teuthology.orchestra.run.smithi003.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-17T11:47:14.195 INFO:teuthology.orchestra.run.smithi003.stdout:checking if gcc static flag -static works... yes 2023-05-17T11:47:14.233 INFO:teuthology.orchestra.run.smithi003.stdout:checking if gcc supports -c -o file.o... yes 2023-05-17T11:47:14.233 INFO:teuthology.orchestra.run.smithi003.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-17T11:47:14.246 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-17T11:47:14.280 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether -lc should be explicitly linked in... no 2023-05-17T11:47:14.383 INFO:teuthology.orchestra.run.smithi003.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-17T11:47:14.383 INFO:teuthology.orchestra.run.smithi003.stdout:checking how to hardcode library paths into programs... immediate 2023-05-17T11:47:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether stripping libraries is possible... yes 2023-05-17T11:47:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:checking if libtool supports shared libraries... yes 2023-05-17T11:47:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether to build shared libraries... yes 2023-05-17T11:47:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether to build static libraries... yes 2023-05-17T11:47:14.408 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gcc... (cached) gcc 2023-05-17T11:47:14.447 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-05-17T11:47:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-17T11:47:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-05-17T11:47:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gmake... /usr/bin/gmake 2023-05-17T11:47:14.449 INFO:teuthology.orchestra.run.smithi003.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-05-17T11:47:14.449 INFO:teuthology.orchestra.run.smithi003.stdout:checking for tar... /bin/tar 2023-05-17T11:47:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gzip... /bin/gzip 2023-05-17T11:47:14.464 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether gcc -MM is supported... yes 2023-05-17T11:47:14.464 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sort... /bin/sort 2023-05-17T11:47:14.465 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether ln -s works... yes 2023-05-17T11:47:14.465 INFO:teuthology.orchestra.run.smithi003.stdout:checking for rpm... no 2023-05-17T11:47:14.503 INFO:teuthology.orchestra.run.smithi003.stdout:checking for assert.h... yes 2023-05-17T11:47:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:checking for bstring.h... no 2023-05-17T11:47:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:checking for libgen.h... yes 2023-05-17T11:47:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:checking for dirent.h... yes 2023-05-17T11:47:14.750 INFO:teuthology.orchestra.run.smithi003.stdout:checking for errno.h... yes 2023-05-17T11:47:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:checking for malloc.h... yes 2023-05-17T11:47:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:checking for uuid.h... no 2023-05-17T11:47:14.886 INFO:teuthology.orchestra.run.smithi003.stdout:checking for uuid/uuid.h... yes 2023-05-17T11:47:14.927 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/uuid.h... no 2023-05-17T11:47:14.967 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/file.h... yes 2023-05-17T11:47:15.005 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/fcntl.h... yes 2023-05-17T11:47:15.045 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/syssgi.h... no 2023-05-17T11:47:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/param.h... yes 2023-05-17T11:47:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/stat.h... (cached) yes 2023-05-17T11:47:15.154 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/statvfs.h... yes 2023-05-17T11:47:15.191 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/time.h... yes 2023-05-17T11:47:15.237 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/ioctl.h... yes 2023-05-17T11:47:15.277 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/wait.h... yes 2023-05-17T11:47:15.277 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/types.h... (cached) yes 2023-05-17T11:47:15.278 INFO:teuthology.orchestra.run.smithi003.stdout:checking for strings.h... (cached) yes 2023-05-17T11:47:15.315 INFO:teuthology.orchestra.run.smithi003.stdout:checking for err.h... yes 2023-05-17T11:47:15.353 INFO:teuthology.orchestra.run.smithi003.stdout:checking for linux/falloc.h... yes 2023-05-17T11:47:15.397 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-17T11:47:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-17T11:47:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:checking for xfs/platform_defs.h... no 2023-05-17T11:47:15.519 INFO:teuthology.orchestra.run.smithi003.stdout:checking for btrfs/ioctl.h... no 2023-05-17T11:47:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:checking for cifs/ioctl.h... no 2023-05-17T11:47:15.598 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/mman.h... yes 2023-05-17T11:47:15.620 INFO:teuthology.orchestra.run.smithi003.stdout:checking for xfs/xfs_log_format.h... no 2023-05-17T11:47:15.676 INFO:teuthology.orchestra.run.smithi003.stdout:checking for uuid_compare... no 2023-05-17T11:47:15.723 INFO:teuthology.orchestra.run.smithi003.stdout:checking for uuid_compare in -luuid... yes 2023-05-17T11:47:15.865 INFO:teuthology.orchestra.run.smithi003.stdout:checking for xfs/xfs.h... yes 2023-05-17T11:47:15.887 INFO:teuthology.orchestra.run.smithi003.stdout:checking for xfs/libxfs.h... no 2023-05-17T11:47:15.943 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-05-17T11:47:15.973 INFO:teuthology.orchestra.run.smithi003.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-17T11:47:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:checking for xfs/xqm.h... yes 2023-05-17T11:47:16.095 INFO:teuthology.orchestra.run.smithi003.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-17T11:47:16.134 INFO:teuthology.orchestra.run.smithi003.stdout:checking for xfs/handle.h... yes 2023-05-17T11:47:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-17T11:47:16.222 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/acl.h... yes 2023-05-17T11:47:16.264 INFO:teuthology.orchestra.run.smithi003.stdout:checking for acl/libacl.h... yes 2023-05-17T11:47:16.311 INFO:teuthology.orchestra.run.smithi003.stdout:checking for acl_init in -lacl... yes 2023-05-17T11:47:16.351 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gdbm-ndbm.h... no 2023-05-17T11:47:16.394 INFO:teuthology.orchestra.run.smithi003.stdout:checking for gdbm/ndbm.h... no 2023-05-17T11:47:16.434 INFO:teuthology.orchestra.run.smithi003.stdout:checking for ndbm.h... no 2023-05-17T11:47:16.474 INFO:teuthology.orchestra.run.smithi003.stdout:checking for libaio.h... yes 2023-05-17T11:47:16.515 INFO:teuthology.orchestra.run.smithi003.stdout:checking for liburing.h... no 2023-05-17T11:47:16.556 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/capability.h... no 2023-05-17T11:47:16.594 INFO:teuthology.orchestra.run.smithi003.stdout:checking for linux/fiemap.h... yes 2023-05-17T11:47:16.643 INFO:teuthology.orchestra.run.smithi003.stdout:checking for fallocate... yes 2023-05-17T11:47:16.696 INFO:teuthology.orchestra.run.smithi003.stdout:checking for open_by_handle_at... yes 2023-05-17T11:47:16.737 INFO:teuthology.orchestra.run.smithi003.stdout:checking for sys/prctl.h... yes 2023-05-17T11:47:16.776 INFO:teuthology.orchestra.run.smithi003.stdout:checking for linux/fs.h... yes 2023-05-17T11:47:16.816 INFO:teuthology.orchestra.run.smithi003.stdout:checking for btrfsutil.h... no 2023-05-17T11:47:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:checking for copy_file_range... yes 2023-05-17T11:47:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:checking for SEEK_DATA... yes 2023-05-17T11:47:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:checking for BMV_OF_SHARED... yes 2023-05-17T11:47:17.058 INFO:teuthology.orchestra.run.smithi003.stdout:checking for nftw... yes 2023-05-17T11:47:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:checking for RLIMIT_NOFILE... yes 2023-05-17T11:47:17.143 INFO:teuthology.orchestra.run.smithi003.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-17T11:47:17.194 INFO:teuthology.orchestra.run.smithi003.stdout:checking for renameat2... yes 2023-05-17T11:47:17.243 INFO:teuthology.orchestra.run.smithi003.stdout:checking for reallocarray... yes 2023-05-17T11:47:17.292 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct mount_attr... yes 2023-05-17T11:47:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-17T11:47:17.394 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-17T11:47:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-17T11:47:17.494 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-17T11:47:17.544 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-17T11:47:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-17T11:47:17.646 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-17T11:47:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:checking for linux/btrfs.h... yes 2023-05-17T11:47:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:checking for linux/btrfs_tree.h... yes 2023-05-17T11:47:17.752 INFO:teuthology.orchestra.run.smithi003.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-05-17T11:47:17.777 INFO:teuthology.orchestra.run.smithi003.stdout:configure: creating ./config.status 2023-05-17T11:47:18.519 INFO:teuthology.orchestra.run.smithi003.stdout:config.status: creating include/builddefs 2023-05-17T11:47:18.544 INFO:teuthology.orchestra.run.smithi003.stdout:config.status: creating include/config.h 2023-05-17T11:47:18.564 INFO:teuthology.orchestra.run.smithi003.stdout:config.status: executing libtool commands 2023-05-17T11:47:18.630 INFO:teuthology.orchestra.run.smithi003.stdout:Building include 2023-05-17T11:47:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:Building lib 2023-05-17T11:47:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: [LTDEP] 2023-05-17T11:47:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dataascii.lo 2023-05-17T11:47:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] databin.lo 2023-05-17T11:47:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] datapid.lo 2023-05-17T11:47:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] file_lock.lo 2023-05-17T11:47:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] forker.lo 2023-05-17T11:47:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] pattern.lo 2023-05-17T11:47:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] open_flags.lo 2023-05-17T11:47:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] random_range.lo 2023-05-17T11:47:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] string_to_tokens.lo 2023-05-17T11:47:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] str_to_bytes.lo 2023-05-17T11:47:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] tlibio.lo 2023-05-17T11:47:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] write_log.lo 2023-05-17T11:47:20.998 INFO:teuthology.orchestra.run.smithi003.stderr:write_log.c: In function 'wlog_record_write': 2023-05-17T11:47:20.999 INFO:teuthology.orchestra.run.smithi003.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:20.999 INFO:teuthology.orchestra.run.smithi003.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-05-17T11:47:20.999 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:20.999 INFO:teuthology.orchestra.run.smithi003.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:20.999 INFO:teuthology.orchestra.run.smithi003.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-05-17T11:47:20.999 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] random.lo 2023-05-17T11:47:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: [LD] 2023-05-17T11:47:21.426 INFO:teuthology.orchestra.run.smithi003.stdout:Building ltp 2023-05-17T11:47:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: [DEP] 2023-05-17T11:47:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] doio 2023-05-17T11:47:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fsstress 2023-05-17T11:47:23.961 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fsx 2023-05-17T11:47:24.777 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] growfiles 2023-05-17T11:47:25.375 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] iogen 2023-05-17T11:47:25.533 INFO:teuthology.orchestra.run.smithi003.stderr:iogen.c: In function 'main': 2023-05-17T11:47:25.533 INFO:teuthology.orchestra.run.smithi003.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:25.534 INFO:teuthology.orchestra.run.smithi003.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-05-17T11:47:25.534 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:25.536 INFO:teuthology.orchestra.run.smithi003.stderr:iogen.c: In function 'parse_cmdline': 2023-05-17T11:47:25.536 INFO:teuthology.orchestra.run.smithi003.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:25.536 INFO:teuthology.orchestra.run.smithi003.stderr: 1535 | getcwd(fptr->f_path, 2023-05-17T11:47:25.536 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:25.537 INFO:teuthology.orchestra.run.smithi003.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-05-17T11:47:25.537 INFO:teuthology.orchestra.run.smithi003.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:25.828 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-stress 2023-05-17T11:47:25.982 INFO:teuthology.orchestra.run.smithi003.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-05-17T11:47:25.983 INFO:teuthology.orchestra.run.smithi003.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:25.983 INFO:teuthology.orchestra.run.smithi003.stderr: 1013 | ftruncate(fd, total_ram); 2023-05-17T11:47:25.983 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:26.317 INFO:teuthology.orchestra.run.smithi003.stdout:Building src 2023-05-17T11:47:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: [DEP] 2023-05-17T11:47:28.781 INFO:teuthology.orchestra.run.smithi003.stdout: [DEP] 2023-05-17T11:47:28.827 INFO:teuthology.orchestra.run.smithi003.stdout: [DEP] 2023-05-17T11:47:28.840 INFO:teuthology.orchestra.run.smithi003.stdout: [DEP] 2023-05-17T11:47:29.177 INFO:teuthology.orchestra.run.smithi003.stdout: [DEP] 2023-05-17T11:47:29.211 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dirstress 2023-05-17T11:47:29.498 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fill 2023-05-17T11:47:29.681 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fill2 2023-05-17T11:47:29.951 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] getpagesize 2023-05-17T11:47:30.116 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] holes 2023-05-17T11:47:30.349 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] lstat64 2023-05-17T11:47:30.567 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] nametest 2023-05-17T11:47:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:nametest.c: In function 'main': 2023-05-17T11:47:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:30.725 INFO:teuthology.orchestra.run.smithi003.stderr: 236 | write(1, "\n", 1); 2023-05-17T11:47:30.725 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:30.725 INFO:teuthology.orchestra.run.smithi003.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:30.725 INFO:teuthology.orchestra.run.smithi003.stderr: 238 | write(1, ".", 1); 2023-05-17T11:47:30.726 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:30.726 INFO:teuthology.orchestra.run.smithi003.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:30.726 INFO:teuthology.orchestra.run.smithi003.stderr: 288 | write(1, ".", 1); 2023-05-17T11:47:30.726 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:30.853 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] permname 2023-05-17T11:47:31.090 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] randholes 2023-05-17T11:47:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] runas 2023-05-17T11:47:31.589 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] truncfile 2023-05-17T11:47:31.805 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] usemem 2023-05-17T11:47:31.987 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] mmapcat 2023-05-17T11:47:32.125 INFO:teuthology.orchestra.run.smithi003.stderr:mmapcat.c: In function 'main': 2023-05-17T11:47:32.125 INFO:teuthology.orchestra.run.smithi003.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.125 INFO:teuthology.orchestra.run.smithi003.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-05-17T11:47:32.125 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:32.167 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] append_reader 2023-05-17T11:47:32.352 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] append_writer 2023-05-17T11:47:32.537 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dirperf 2023-05-17T11:47:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] metaperf 2023-05-17T11:47:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c: In function 'crfiles': 2023-05-17T11:47:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.953 INFO:teuthology.orchestra.run.smithi003.stderr: 166 | write(fd, buf, fsize); 2023-05-17T11:47:32.953 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:32.954 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c: In function 't_linkun': 2023-05-17T11:47:32.954 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr: 454 | link("a", *fnp); 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~ 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c: In function 't_chown': 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr: 404 | chown(*fnp, 2, -1); 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi003.stderr: 406 | chown(*fnp, 1, -1); 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c: In function 'i_chown': 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr: 291 | chown(*fnp, 1, -1); 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c: In function 'main': 2023-05-17T11:47:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:32.957 INFO:teuthology.orchestra.run.smithi003.stderr: 152 | chdir(".."); 2023-05-17T11:47:32.957 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~ 2023-05-17T11:47:33.128 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] devzero 2023-05-17T11:47:33.344 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] feature 2023-05-17T11:47:33.602 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] alloc 2023-05-17T11:47:33.758 INFO:teuthology.orchestra.run.smithi003.stderr:alloc.c: In function 'main': 2023-05-17T11:47:33.758 INFO:teuthology.orchestra.run.smithi003.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:33.758 INFO:teuthology.orchestra.run.smithi003.stderr: 247 | mkstemp(tmpfile); 2023-05-17T11:47:33.758 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:33.855 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fault 2023-05-17T11:47:34.053 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fstest 2023-05-17T11:47:34.333 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_access_root 2023-05-17T11:47:34.471 INFO:teuthology.orchestra.run.smithi003.stderr:t_access_root.c: In function 'main': 2023-05-17T11:47:34.472 INFO:teuthology.orchestra.run.smithi003.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:34.472 INFO:teuthology.orchestra.run.smithi003.stderr: 55 | system(cmd); 2023-05-17T11:47:34.472 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~ 2023-05-17T11:47:34.521 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] godown 2023-05-17T11:47:34.730 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] resvtest 2023-05-17T11:47:34.734 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:47:34.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:47:34.955 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] writemod 2023-05-17T11:47:35.131 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] writev_on_pagefault 2023-05-17T11:47:35.325 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] makeextents 2023-05-17T11:47:35.541 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] itrash 2023-05-17T11:47:35.725 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] rename 2023-05-17T11:47:35.892 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] multi_open_unlink 2023-05-17T11:47:36.093 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] unwritten_sync 2023-05-17T11:47:36.311 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] genhashnames 2023-05-17T11:47:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_holes 2023-05-17T11:47:36.713 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_writev 2023-05-17T11:47:36.895 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_truncate_cmtime 2023-05-17T11:47:37.088 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dirhash_collide 2023-05-17T11:47:37.303 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_rename_overwrite 2023-05-17T11:47:37.473 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] holetest 2023-05-17T11:47:37.621 INFO:teuthology.orchestra.run.smithi003.stderr:holetest.c: In function 'pt_write_marker': 2023-05-17T11:47:37.622 INFO:teuthology.orchestra.run.smithi003.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:37.622 INFO:teuthology.orchestra.run.smithi003.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-05-17T11:47:37.622 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:37.740 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_truncate_self 2023-05-17T11:47:37.913 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] af_unix 2023-05-17T11:47:38.111 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_stale_pmd 2023-05-17T11:47:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-05-17T11:47:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:38.252 INFO:teuthology.orchestra.run.smithi003.stderr: 42 | ftruncate(fd, 0); 2023-05-17T11:47:38.252 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:38.253 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:38.253 INFO:teuthology.orchestra.run.smithi003.stderr: 43 | ftruncate(fd, MiB(4)); 2023-05-17T11:47:38.253 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:38.253 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:38.253 INFO:teuthology.orchestra.run.smithi003.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-05-17T11:47:38.253 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:38.298 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_cow_race 2023-05-17T11:47:38.443 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_cow_race.c: In function 'main': 2023-05-17T11:47:38.443 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:38.443 INFO:teuthology.orchestra.run.smithi003.stderr: 61 | ftruncate(fd, 0); 2023-05-17T11:47:38.443 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:38.444 INFO:teuthology.orchestra.run.smithi003.stderr: 62 | ftruncate(fd, MiB(2)); 2023-05-17T11:47:38.444 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:38.498 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_fallocate 2023-05-17T11:47:38.682 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fsync-err 2023-05-17T11:47:38.903 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_write_ro 2023-05-17T11:47:39.089 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-17T11:47:39.230 INFO:teuthology.orchestra.run.smithi003.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-05-17T11:47:39.231 INFO:teuthology.orchestra.run.smithi003.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:39.231 INFO:teuthology.orchestra.run.smithi003.stderr: 61 | ftruncate(fd, 0); 2023-05-17T11:47:39.231 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:39.283 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-17T11:47:39.474 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_ofd_locks 2023-05-17T11:47:39.715 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_collision 2023-05-17T11:47:39.952 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] mmap-write-concurrent 2023-05-17T11:47:40.376 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_get_file_time 2023-05-17T11:47:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_create_short_dirs 2023-05-17T11:47:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_create_long_dirs 2023-05-17T11:47:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_enospc 2023-05-17T11:47:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_writev_overlap 2023-05-17T11:47:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] checkpoint_journal 2023-05-17T11:47:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] mmap-rw-fault 2023-05-17T11:47:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] allocstale 2023-05-17T11:47:42.013 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_cow_memory_failure 2023-05-17T11:47:42.218 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fake-dump-rootino 2023-05-17T11:47:42.401 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dio-buf-fault 2023-05-17T11:47:42.588 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] xfsctl 2023-05-17T11:47:42.817 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] bstat 2023-05-17T11:47:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mtab 2023-05-17T11:47:43.209 INFO:teuthology.orchestra.run.smithi003.stderr:t_mtab.c: In function 'update_mtab': 2023-05-17T11:47:43.209 INFO:teuthology.orchestra.run.smithi003.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:43.209 INFO:teuthology.orchestra.run.smithi003.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-05-17T11:47:43.209 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:43.290 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] getdevicesize 2023-05-17T11:47:43.464 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] preallo_rw_pattern_reader 2023-05-17T11:47:43.615 INFO:teuthology.orchestra.run.smithi003.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-05-17T11:47:43.616 INFO:teuthology.orchestra.run.smithi003.stderr:iopat.c: In function 'main': 2023-05-17T11:47:43.616 INFO:teuthology.orchestra.run.smithi003.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:43.616 INFO:teuthology.orchestra.run.smithi003.stderr: 38 | read(fd, &x, 1048576); 2023-05-17T11:47:43.616 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:43.658 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] preallo_rw_pattern_writer 2023-05-17T11:47:43.810 INFO:teuthology.orchestra.run.smithi003.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-05-17T11:47:43.810 INFO:teuthology.orchestra.run.smithi003.stderr:iopat.c: In function 'main': 2023-05-17T11:47:43.810 INFO:teuthology.orchestra.run.smithi003.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:43.810 INFO:teuthology.orchestra.run.smithi003.stderr: 34 | write(fd, &x, 1048576); 2023-05-17T11:47:43.810 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:43.851 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] ftrunc 2023-05-17T11:47:44.033 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] trunc 2023-05-17T11:47:44.232 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fs_perms 2023-05-17T11:47:44.376 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c: In function 'main': 2023-05-17T11:47:44.376 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:44.376 INFO:teuthology.orchestra.run.smithi003.stderr: 54 | system("rm -f test.file"); 2023-05-17T11:47:44.376 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:44.376 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c: In function 'testsetup': 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr: 67 | system("cp testx.file test.file"); 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:44.377 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c: In function 'testfperm': 2023-05-17T11:47:44.378 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:44.378 INFO:teuthology.orchestra.run.smithi003.stderr: 123 | seteuid(0); 2023-05-17T11:47:44.378 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~ 2023-05-17T11:47:44.378 INFO:teuthology.orchestra.run.smithi003.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:44.378 INFO:teuthology.orchestra.run.smithi003.stderr: 124 | setegid(0); 2023-05-17T11:47:44.378 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~ 2023-05-17T11:47:44.431 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] testx 2023-05-17T11:47:44.589 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] looptest 2023-05-17T11:47:44.819 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] locktest 2023-05-17T11:47:45.171 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] unwritten_mmap 2023-05-17T11:47:45.369 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] bulkstat_unlink_test 2023-05-17T11:47:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test.c: In function 'main': 2023-05-17T11:47:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:45.523 INFO:teuthology.orchestra.run.smithi003.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-05-17T11:47:45.523 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:45.523 INFO:teuthology.orchestra.run.smithi003.stderr: 178 | system(fname); 2023-05-17T11:47:45.523 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~ 2023-05-17T11:47:45.610 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] deduperace 2023-05-17T11:47:45.847 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] bulkstat_unlink_test_modified 2023-05-17T11:47:45.999 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-05-17T11:47:45.999 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:45.999 INFO:teuthology.orchestra.run.smithi003.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-05-17T11:47:45.999 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:45.999 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.000 INFO:teuthology.orchestra.run.smithi003.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-05-17T11:47:46.000 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.000 INFO:teuthology.orchestra.run.smithi003.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.000 INFO:teuthology.orchestra.run.smithi003.stderr: 185 | system(fname); 2023-05-17T11:47:46.000 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~ 2023-05-17T11:47:46.084 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_dir_offset 2023-05-17T11:47:46.264 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_futimens 2023-05-17T11:47:46.435 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_immutable 2023-05-17T11:47:46.602 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c: In function 'create_test_area': 2023-05-17T11:47:46.602 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.602 INFO:teuthology.orchestra.run.smithi003.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-05-17T11:47:46.602 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.602 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.603 INFO:teuthology.orchestra.run.smithi003.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-05-17T11:47:46.603 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c: In function 'remove_test_area': 2023-05-17T11:47:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.604 INFO:teuthology.orchestra.run.smithi003.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-05-17T11:47:46.604 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.605 INFO:teuthology.orchestra.run.smithi003.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-17T11:47:46.605 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.605 INFO:teuthology.orchestra.run.smithi003.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-05-17T11:47:46.605 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.606 INFO:teuthology.orchestra.run.smithi003.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-05-17T11:47:46.607 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c: In function 'check_test_area': 2023-05-17T11:47:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.609 INFO:teuthology.orchestra.run.smithi003.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-05-17T11:47:46.609 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.610 INFO:teuthology.orchestra.run.smithi003.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-17T11:47:46.611 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c: In function 'test_immutable': 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.613 INFO:teuthology.orchestra.run.smithi003.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr: 408 | chown(path, 0, 0); 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.614 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr: 553 | chown(path, 0, 0); 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-05-17T11:47:46.615 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.616 INFO:teuthology.orchestra.run.smithi003.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-05-17T11:47:46.616 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.616 INFO:teuthology.orchestra.run.smithi003.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-05-17T11:47:46.616 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.618 INFO:teuthology.orchestra.run.smithi003.stderr: 653 | chown(path, 0, 0); 2023-05-17T11:47:46.618 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.618 INFO:teuthology.orchestra.run.smithi003.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-17T11:47:46.618 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.619 INFO:teuthology.orchestra.run.smithi003.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-05-17T11:47:46.619 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.619 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.619 INFO:teuthology.orchestra.run.smithi003.stderr: 705 | chown(path, 0, 0); 2023-05-17T11:47:46.620 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.620 INFO:teuthology.orchestra.run.smithi003.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-17T11:47:46.620 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.623 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c: In function 'test_append': 2023-05-17T11:47:46.624 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.624 INFO:teuthology.orchestra.run.smithi003.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-05-17T11:47:46.624 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.624 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr: 1051 | chown(path, 0, 0); 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-05-17T11:47:46.625 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr: 1516 | chown(path, 0, 0); 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-05-17T11:47:46.627 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.628 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.628 INFO:teuthology.orchestra.run.smithi003.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-05-17T11:47:46.628 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.628 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.628 INFO:teuthology.orchestra.run.smithi003.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-05-17T11:47:46.628 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.629 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.630 INFO:teuthology.orchestra.run.smithi003.stderr: 1618 | chown(path, 0, 0); 2023-05-17T11:47:46.630 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.630 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.630 INFO:teuthology.orchestra.run.smithi003.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-05-17T11:47:46.630 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.630 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.631 INFO:teuthology.orchestra.run.smithi003.stderr: 1644 | chown(path, 0, 0); 2023-05-17T11:47:46.631 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.631 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.631 INFO:teuthology.orchestra.run.smithi003.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-17T11:47:46.632 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.632 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.632 INFO:teuthology.orchestra.run.smithi003.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-05-17T11:47:46.633 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.633 INFO:teuthology.orchestra.run.smithi003.stderr: 1692 | chown(path, 0, 0); 2023-05-17T11:47:46.633 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-17T11:47:46.634 INFO:teuthology.orchestra.run.smithi003.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:46.634 INFO:teuthology.orchestra.run.smithi003.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-17T11:47:46.634 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.193 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] stale_handle 2023-05-17T11:47:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:stale_handle.c: In function 'main': 2023-05-17T11:47:47.344 INFO:teuthology.orchestra.run.smithi003.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.344 INFO:teuthology.orchestra.run.smithi003.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-05-17T11:47:47.345 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] pwrite_mmap_blocked 2023-05-17T11:47:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_dir_offset2 2023-05-17T11:47:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] seek_sanity_test 2023-05-17T11:47:47.982 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c: In function 'test18': 2023-05-17T11:47:47.983 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.983 INFO:teuthology.orchestra.run.smithi003.stderr: 460 | ftruncate(fd, 0); 2023-05-17T11:47:47.983 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.985 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-05-17T11:47:47.985 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.985 INFO:teuthology.orchestra.run.smithi003.stderr: 1207 | ftruncate(fd, 0); 2023-05-17T11:47:47.986 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.986 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.986 INFO:teuthology.orchestra.run.smithi003.stderr: 1256 | ftruncate(fd, 0); 2023-05-17T11:47:47.986 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-05-17T11:47:47.987 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.988 INFO:teuthology.orchestra.run.smithi003.stderr: 88 | ftruncate(fd, 0); 2023-05-17T11:47:47.988 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.988 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.989 INFO:teuthology.orchestra.run.smithi003.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-05-17T11:47:47.989 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.989 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.989 INFO:teuthology.orchestra.run.smithi003.stderr: 98 | ftruncate(fd, 0); 2023-05-17T11:47:47.990 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-17T11:47:47.990 INFO:teuthology.orchestra.run.smithi003.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:47.990 INFO:teuthology.orchestra.run.smithi003.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-05-17T11:47:47.990 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] seek_copy_test 2023-05-17T11:47:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_readdir_1 2023-05-17T11:47:48.673 INFO:teuthology.orchestra.run.smithi003.stderr:t_readdir_1.c: In function 'main': 2023-05-17T11:47:48.673 INFO:teuthology.orchestra.run.smithi003.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:48.673 INFO:teuthology.orchestra.run.smithi003.stderr: 30 | read(fd, buf, 100); 2023-05-17T11:47:48.673 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_readdir_2 2023-05-17T11:47:48.897 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fsync-tester 2023-05-17T11:47:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:fsync-tester.c: In function 'main': 2023-05-17T11:47:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:49.041 INFO:teuthology.orchestra.run.smithi003.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-05-17T11:47:49.041 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:49.042 INFO:teuthology.orchestra.run.smithi003.stderr: 541 | system("reboot -fn"); 2023-05-17T11:47:49.042 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-05-17T11:47:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:49.042 INFO:teuthology.orchestra.run.smithi003.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-05-17T11:47:49.043 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:49.195 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] nsexec 2023-05-17T11:47:49.411 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] cloner 2023-05-17T11:47:49.626 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] renameat2 2023-05-17T11:47:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_getcwd 2023-05-17T11:47:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:t_getcwd.c: In function 'test_getcwd': 2023-05-17T11:47:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:49.970 INFO:teuthology.orchestra.run.smithi003.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-05-17T11:47:49.970 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:50.024 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] e4compact 2023-05-17T11:47:50.266 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] test-nextquota 2023-05-17T11:47:50.479 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] punch-alternating 2023-05-17T11:47:50.689 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-17T11:47:50.892 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] listxattr 2023-05-17T11:47:51.069 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dio-interleaved 2023-05-17T11:47:51.266 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_dir_type 2023-05-17T11:47:51.456 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] dio-invalidate-cache 2023-05-17T11:47:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:dio-invalidate-cache.c: In function 'main': 2023-05-17T11:47:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:51.598 INFO:teuthology.orchestra.run.smithi003.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-05-17T11:47:51.599 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:51.698 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] stat_test 2023-05-17T11:47:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_encrypted_d_revalidate 2023-05-17T11:47:52.231 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] attr_replace_test 2023-05-17T11:47:52.431 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] swapon 2023-05-17T11:47:52.633 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] mkswap 2023-05-17T11:47:52.819 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_attr_corruption 2023-05-17T11:47:53.002 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_open_tmpfiles 2023-05-17T11:47:53.219 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fscrypt-crypt-util 2023-05-17T11:47:53.939 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] bulkstat_null_ocount 2023-05-17T11:47:54.133 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] splice-test 2023-05-17T11:47:54.352 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] chprojid_fail 2023-05-17T11:47:54.551 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] detached_mounts_propagation 2023-05-17T11:47:54.776 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] ext4_resize 2023-05-17T11:47:54.960 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_readdir_3 2023-05-17T11:47:55.192 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] splice2pipe 2023-05-17T11:47:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-05-17T11:47:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:splice2pipe.c:56:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:55.331 INFO:teuthology.orchestra.run.smithi003.stderr: 56 | write(p[1], buffer, n); 2023-05-17T11:47:55.332 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:splice2pipe.c:64:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:55.332 INFO:teuthology.orchestra.run.smithi003.stderr: 64 | read(p[0], buffer, n); 2023-05-17T11:47:55.332 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:55.389 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] uuid_ioctl 2023-05-17T11:47:55.581 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fiemap-tester 2023-05-17T11:47:55.892 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_stripealign 2023-05-17T11:47:56.082 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] open_by_handle 2023-05-17T11:47:56.370 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] t_mmap_dio 2023-05-17T11:47:56.568 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] xfsfind 2023-05-17T11:47:56.801 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] fssum 2023-05-17T11:47:57.285 INFO:teuthology.orchestra.run.smithi003.stdout:Building log-writes 2023-05-17T11:47:57.293 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] replay-log 2023-05-17T11:47:57.683 INFO:teuthology.orchestra.run.smithi003.stdout:Building perf 2023-05-17T11:47:57.689 INFO:teuthology.orchestra.run.smithi003.stdout:Building aio-dio-regress 2023-05-17T11:47:57.699 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aiocp 2023-05-17T11:47:57.973 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-17T11:47:58.188 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-append-write-read-race 2023-05-17T11:47:58.407 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-cow-race 2023-05-17T11:47:58.605 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-cycle-write 2023-05-17T11:47:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-05-17T11:47:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:47:58.747 INFO:teuthology.orchestra.run.smithi003.stderr: 83 | ftruncate(fd, buf_size); 2023-05-17T11:47:58.747 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:47:58.838 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-eof-race 2023-05-17T11:47:59.068 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-extend-stat 2023-05-17T11:47:59.276 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-fcntl-race 2023-05-17T11:47:59.481 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-hole-filling-race 2023-05-17T11:47:59.674 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-invalidate-failure 2023-05-17T11:47:59.876 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-invalidate-readahead 2023-05-17T11:48:00.087 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aiodio_sparse2 2023-05-17T11:48:00.228 INFO:teuthology.orchestra.run.smithi003.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-05-17T11:48:00.229 INFO:teuthology.orchestra.run.smithi003.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:48:00.229 INFO:teuthology.orchestra.run.smithi003.stderr: 111 | ftruncate(fd, filesize); 2023-05-17T11:48:00.229 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-17T11:48:00.229 INFO:teuthology.orchestra.run.smithi003.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-05-17T11:48:00.229 INFO:teuthology.orchestra.run.smithi003.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-17T11:48:00.230 INFO:teuthology.orchestra.run.smithi003.stderr: 274 | ftruncate(fd, size); 2023-05-17T11:48:00.230 INFO:teuthology.orchestra.run.smithi003.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-05-17T11:48:00.353 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-subblock-eof-read 2023-05-17T11:48:00.540 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-dio-write-verify 2023-05-17T11:48:00.779 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-17T11:48:00.952 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-17T11:48:01.125 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] aio-last-ref-held-by-io 2023-05-17T11:48:01.346 INFO:teuthology.orchestra.run.smithi003.stdout:Building vfs 2023-05-17T11:48:01.354 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] vfstest 2023-05-17T11:48:03.691 INFO:teuthology.orchestra.run.smithi003.stdout: [CC] mount-idmapped 2023-05-17T11:48:04.149 INFO:teuthology.orchestra.run.smithi003.stdout:Building m4 2023-05-17T11:48:04.155 INFO:teuthology.orchestra.run.smithi003.stdout:Building common 2023-05-17T11:48:04.161 INFO:teuthology.orchestra.run.smithi003.stdout:Building tests 2023-05-17T11:48:04.170 INFO:teuthology.orchestra.run.smithi003.stdout:Building btrfs 2023-05-17T11:48:04.179 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/btrfs/group.list 2023-05-17T11:48:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:Building ceph 2023-05-17T11:48:04.308 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ceph/group.list 2023-05-17T11:48:04.338 INFO:teuthology.orchestra.run.smithi003.stdout:Building cifs 2023-05-17T11:48:04.346 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/cifs/group.list 2023-05-17T11:48:04.372 INFO:teuthology.orchestra.run.smithi003.stdout:Building ext4 2023-05-17T11:48:04.381 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ext4/group.list 2023-05-17T11:48:04.460 INFO:teuthology.orchestra.run.smithi003.stdout:Building f2fs 2023-05-17T11:48:04.468 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/f2fs/group.list 2023-05-17T11:48:04.503 INFO:teuthology.orchestra.run.smithi003.stdout:Building generic 2023-05-17T11:48:04.514 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/generic/group.list 2023-05-17T11:48:04.718 INFO:teuthology.orchestra.run.smithi003.stdout:Building nfs 2023-05-17T11:48:04.727 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/nfs/group.list 2023-05-17T11:48:04.756 INFO:teuthology.orchestra.run.smithi003.stdout:Building ocfs2 2023-05-17T11:48:04.764 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ocfs2/group.list 2023-05-17T11:48:04.791 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:48:04.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:48:04.795 INFO:teuthology.orchestra.run.smithi003.stdout:Building overlay 2023-05-17T11:48:04.802 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/overlay/group.list 2023-05-17T11:48:04.882 INFO:teuthology.orchestra.run.smithi003.stdout:Building perf 2023-05-17T11:48:04.890 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/perf/group.list 2023-05-17T11:48:04.914 INFO:teuthology.orchestra.run.smithi003.stdout:Building selftest 2023-05-17T11:48:04.922 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/selftest/group.list 2023-05-17T11:48:04.948 INFO:teuthology.orchestra.run.smithi003.stdout:Building shared 2023-05-17T11:48:04.956 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/shared/group.list 2023-05-17T11:48:04.992 INFO:teuthology.orchestra.run.smithi003.stdout:Building tmpfs 2023-05-17T11:48:05.000 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/tmpfs/group.list 2023-05-17T11:48:05.028 INFO:teuthology.orchestra.run.smithi003.stdout:Building udf 2023-05-17T11:48:05.036 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/udf/group.list 2023-05-17T11:48:05.060 INFO:teuthology.orchestra.run.smithi003.stdout:Building xfs 2023-05-17T11:48:05.070 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/xfs/group.list 2023-05-17T11:48:05.278 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo make install) 2023-05-17T11:48:05.318 INFO:teuthology.orchestra.run.smithi003.stdout:Building include 2023-05-17T11:48:05.324 INFO:teuthology.orchestra.run.smithi003.stdout:Building lib 2023-05-17T11:48:05.330 INFO:teuthology.orchestra.run.smithi003.stdout:Building ltp 2023-05-17T11:48:05.337 INFO:teuthology.orchestra.run.smithi003.stdout:Building src 2023-05-17T11:48:05.390 INFO:teuthology.orchestra.run.smithi003.stdout:Building log-writes 2023-05-17T11:48:05.396 INFO:teuthology.orchestra.run.smithi003.stdout:Building perf 2023-05-17T11:48:05.402 INFO:teuthology.orchestra.run.smithi003.stdout:Building aio-dio-regress 2023-05-17T11:48:05.409 INFO:teuthology.orchestra.run.smithi003.stdout:Building vfs 2023-05-17T11:48:05.415 INFO:teuthology.orchestra.run.smithi003.stdout:Building m4 2023-05-17T11:48:05.421 INFO:teuthology.orchestra.run.smithi003.stdout:Building common 2023-05-17T11:48:05.427 INFO:teuthology.orchestra.run.smithi003.stdout:Building tests 2023-05-17T11:48:05.436 INFO:teuthology.orchestra.run.smithi003.stdout:Building btrfs 2023-05-17T11:48:05.445 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/btrfs/group.list 2023-05-17T11:48:05.562 INFO:teuthology.orchestra.run.smithi003.stdout:Building ceph 2023-05-17T11:48:05.570 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ceph/group.list 2023-05-17T11:48:05.600 INFO:teuthology.orchestra.run.smithi003.stdout:Building cifs 2023-05-17T11:48:05.608 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/cifs/group.list 2023-05-17T11:48:05.634 INFO:teuthology.orchestra.run.smithi003.stdout:Building ext4 2023-05-17T11:48:05.643 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ext4/group.list 2023-05-17T11:48:05.721 INFO:teuthology.orchestra.run.smithi003.stdout:Building f2fs 2023-05-17T11:48:05.729 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/f2fs/group.list 2023-05-17T11:48:05.765 INFO:teuthology.orchestra.run.smithi003.stdout:Building generic 2023-05-17T11:48:05.775 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/generic/group.list 2023-05-17T11:48:05.974 INFO:teuthology.orchestra.run.smithi003.stdout:Building nfs 2023-05-17T11:48:05.982 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/nfs/group.list 2023-05-17T11:48:06.012 INFO:teuthology.orchestra.run.smithi003.stdout:Building ocfs2 2023-05-17T11:48:06.021 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ocfs2/group.list 2023-05-17T11:48:06.048 INFO:teuthology.orchestra.run.smithi003.stdout:Building overlay 2023-05-17T11:48:06.057 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/overlay/group.list 2023-05-17T11:48:06.137 INFO:teuthology.orchestra.run.smithi003.stdout:Building perf 2023-05-17T11:48:06.145 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/perf/group.list 2023-05-17T11:48:06.169 INFO:teuthology.orchestra.run.smithi003.stdout:Building selftest 2023-05-17T11:48:06.177 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/selftest/group.list 2023-05-17T11:48:06.202 INFO:teuthology.orchestra.run.smithi003.stdout:Building shared 2023-05-17T11:48:06.211 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/shared/group.list 2023-05-17T11:48:06.246 INFO:teuthology.orchestra.run.smithi003.stdout:Building tmpfs 2023-05-17T11:48:06.255 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/tmpfs/group.list 2023-05-17T11:48:06.283 INFO:teuthology.orchestra.run.smithi003.stdout:Building udf 2023-05-17T11:48:06.291 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/udf/group.list 2023-05-17T11:48:06.315 INFO:teuthology.orchestra.run.smithi003.stdout:Building xfs 2023-05-17T11:48:06.325 INFO:teuthology.orchestra.run.smithi003.stdout: [GROUP] /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/xfs/group.list 2023-05-17T11:48:06.524 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-17T11:48:06.528 INFO:teuthology.orchestra.run.smithi003.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-17T11:48:06.528 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-17T11:48:06.533 INFO:teuthology.orchestra.run.smithi003.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-17T11:48:06.533 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-17T11:48:06.537 INFO:teuthology.orchestra.run.smithi003.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-17T11:48:06.556 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-17T11:48:06.705 INFO:teuthology.orchestra.run.smithi003.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-17T11:48:06.724 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-17T11:48:06.751 INFO:teuthology.orchestra.run.smithi003.stdout:Building log-writes 2023-05-17T11:48:06.757 INFO:teuthology.orchestra.run.smithi003.stdout:Building perf 2023-05-17T11:48:06.763 INFO:teuthology.orchestra.run.smithi003.stdout:Building aio-dio-regress 2023-05-17T11:48:06.770 INFO:teuthology.orchestra.run.smithi003.stdout:Building vfs 2023-05-17T11:48:06.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake -C log-writes install 2023-05-17T11:48:06.778 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-17T11:48:06.797 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-17T11:48:06.816 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake -C perf install 2023-05-17T11:48:06.820 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-17T11:48:06.838 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-17T11:48:06.883 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-17T11:48:06.887 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-17T11:48:06.906 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-05-17T11:48:07.010 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake -C vfs install 2023-05-17T11:48:07.014 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-17T11:48:07.032 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-17T11:48:07.058 INFO:teuthology.orchestra.run.smithi003.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-17T11:48:07.076 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-17T11:48:09.587 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-17T11:48:09.769 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-17T11:48:09.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-17T11:48:09.819 INFO:teuthology.orchestra.run.smithi003.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-17T11:48:09.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-17T11:48:09.823 INFO:teuthology.orchestra.run.smithi003.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-17T11:48:09.842 INFO:teuthology.orchestra.run.smithi003.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-17T11:48:10.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-17T11:48:10.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/btrfs/ install 2023-05-17T11:48:10.106 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-17T11:48:10.124 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-17T11:48:11.656 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-17T11:48:11.675 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 290.out 291.out 299.out /var/lib/xfstests/tests/btrfs 2023-05-17T11:48:13.198 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ceph/ install 2023-05-17T11:48:13.202 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-17T11:48:13.220 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-17T11:48:13.260 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-17T11:48:13.278 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-05-17T11:48:13.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/cifs/ install 2023-05-17T11:48:13.321 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-17T11:48:13.340 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-17T11:48:13.359 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-17T11:48:13.378 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-17T11:48:13.397 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ext4/ install 2023-05-17T11:48:13.401 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-17T11:48:13.420 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-17T11:48:13.785 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-17T11:48:13.803 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-05-17T11:48:14.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/f2fs/ install 2023-05-17T11:48:14.194 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-17T11:48:14.213 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-17T11:48:14.236 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-17T11:48:14.255 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-17T11:48:14.280 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/generic/ install 2023-05-17T11:48:14.287 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-17T11:48:14.306 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-17T11:48:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-17T11:48:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out /var/lib/xfstests/tests/generic 2023-05-17T11:48:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/nfs/ install 2023-05-17T11:48:22.010 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-17T11:48:22.028 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-17T11:48:22.047 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-17T11:48:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-17T11:48:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/ocfs2/ install 2023-05-17T11:48:22.088 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-17T11:48:22.107 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-17T11:48:22.125 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-17T11:48:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-17T11:48:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/overlay/ install 2023-05-17T11:48:22.167 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-17T11:48:22.186 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-17T11:48:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-17T11:48:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-05-17T11:48:23.243 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/perf/ install 2023-05-17T11:48:23.246 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-17T11:48:23.265 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-17T11:48:23.284 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-17T11:48:23.302 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-17T11:48:23.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/selftest/ install 2023-05-17T11:48:23.325 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-17T11:48:23.343 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-17T11:48:23.388 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-17T11:48:23.406 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-05-17T11:48:23.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/shared/ install 2023-05-17T11:48:23.455 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-17T11:48:23.473 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-17T11:48:23.502 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-17T11:48:23.521 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-05-17T11:48:23.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/tmpfs/ install 2023-05-17T11:48:23.555 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-17T11:48:23.573 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-17T11:48:23.593 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-17T11:48:23.611 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-17T11:48:23.630 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/udf/ install 2023-05-17T11:48:23.634 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-17T11:48:23.653 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-17T11:48:23.672 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-17T11:48:23.690 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-17T11:48:23.709 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.wZOEk1XGhTxfstests-dev/tests/xfs/ install 2023-05-17T11:48:23.716 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-17T11:48:23.735 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-17T11:48:27.347 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-17T11:48:27.366 INFO:teuthology.orchestra.run.smithi003.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-05-17T11:48:31.021 INFO:teuthology.orchestra.run.smithi003.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-17T11:48:31.040 INFO:teuthology.orchestra.run.smithi003.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-17T11:48:31.058 INFO:teuthology.orchestra.run.smithi003.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-17T11:48:31.076 INFO:teuthology.orchestra.run.smithi003.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-17T11:48:31.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T11:48:31.098 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec ls tests/generic) 2023-05-17T11:48:31.150 INFO:teuthology.orchestra.run.smithi003.stdout:001 2023-05-17T11:48:31.150 INFO:teuthology.orchestra.run.smithi003.stdout:001.out 2023-05-17T11:48:31.150 INFO:teuthology.orchestra.run.smithi003.stdout:002 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:002.out 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:003 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:003.out 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:004 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:004.out 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:005 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:005.out 2023-05-17T11:48:31.151 INFO:teuthology.orchestra.run.smithi003.stdout:006 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:006.out 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:007 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:007.out 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:008 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:008.out 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:009 2023-05-17T11:48:31.152 INFO:teuthology.orchestra.run.smithi003.stdout:009.out 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:010 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:010.out 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:011 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:011.out 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:012 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:012.out 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:013 2023-05-17T11:48:31.153 INFO:teuthology.orchestra.run.smithi003.stdout:013.out 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:014 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:014.out 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:015 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:015.out 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:016 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:016.out 2023-05-17T11:48:31.154 INFO:teuthology.orchestra.run.smithi003.stdout:017 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:017.out 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:018 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:018.out 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:019 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:019.out 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:020 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:020.out 2023-05-17T11:48:31.155 INFO:teuthology.orchestra.run.smithi003.stdout:021 2023-05-17T11:48:31.156 INFO:teuthology.orchestra.run.smithi003.stdout:021.out 2023-05-17T11:48:31.156 INFO:teuthology.orchestra.run.smithi003.stdout:022 2023-05-17T11:48:31.156 INFO:teuthology.orchestra.run.smithi003.stdout:022.out 2023-05-17T11:48:31.156 INFO:teuthology.orchestra.run.smithi003.stdout:023 2023-05-17T11:48:31.156 INFO:teuthology.orchestra.run.smithi003.stdout:023.out 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:024 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:024.out 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:025 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:025.out 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:026 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:026.out 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:027 2023-05-17T11:48:31.157 INFO:teuthology.orchestra.run.smithi003.stdout:027.out 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:028 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:028.out 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:029 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:029.out 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:030 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:030.out 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:031 2023-05-17T11:48:31.158 INFO:teuthology.orchestra.run.smithi003.stdout:031.out 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:032 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:032.out 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:033 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:033.out 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:034 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:034.out 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:035 2023-05-17T11:48:31.159 INFO:teuthology.orchestra.run.smithi003.stdout:035.cfg 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:035.out.default 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:035.out.nfs 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:036 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:036.out 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:037 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:037.out 2023-05-17T11:48:31.160 INFO:teuthology.orchestra.run.smithi003.stdout:038 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:038.out 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:039 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:039.out 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:040 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:040.out 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:041 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:041.out 2023-05-17T11:48:31.161 INFO:teuthology.orchestra.run.smithi003.stdout:042 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:042.out 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:043 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:043.out 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:044 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:044.out 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:045 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:045.out 2023-05-17T11:48:31.162 INFO:teuthology.orchestra.run.smithi003.stdout:046 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:046.out 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:047 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:047.out 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:048 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:048.out 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:049 2023-05-17T11:48:31.163 INFO:teuthology.orchestra.run.smithi003.stdout:049.out 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:050 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:050.cfg 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:050.out.default 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:050.out.nojournal 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:050.out.xfsquota 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:051 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:051.out 2023-05-17T11:48:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:052 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:052.out 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:053 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:053.out 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:054 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:054.out 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:055 2023-05-17T11:48:31.165 INFO:teuthology.orchestra.run.smithi003.stdout:055.out 2023-05-17T11:48:31.166 INFO:teuthology.orchestra.run.smithi003.stdout:056 2023-05-17T11:48:31.166 INFO:teuthology.orchestra.run.smithi003.stdout:056.out 2023-05-17T11:48:31.166 INFO:teuthology.orchestra.run.smithi003.stdout:057 2023-05-17T11:48:31.166 INFO:teuthology.orchestra.run.smithi003.stdout:057.out 2023-05-17T11:48:31.166 INFO:teuthology.orchestra.run.smithi003.stdout:058 2023-05-17T11:48:31.166 INFO:teuthology.orchestra.run.smithi003.stdout:058.out 2023-05-17T11:48:31.167 INFO:teuthology.orchestra.run.smithi003.stdout:059 2023-05-17T11:48:31.167 INFO:teuthology.orchestra.run.smithi003.stdout:059.out 2023-05-17T11:48:31.167 INFO:teuthology.orchestra.run.smithi003.stdout:060 2023-05-17T11:48:31.167 INFO:teuthology.orchestra.run.smithi003.stdout:060.out 2023-05-17T11:48:31.167 INFO:teuthology.orchestra.run.smithi003.stdout:061 2023-05-17T11:48:31.167 INFO:teuthology.orchestra.run.smithi003.stdout:061.out 2023-05-17T11:48:31.168 INFO:teuthology.orchestra.run.smithi003.stdout:062 2023-05-17T11:48:31.168 INFO:teuthology.orchestra.run.smithi003.stdout:062.out 2023-05-17T11:48:31.168 INFO:teuthology.orchestra.run.smithi003.stdout:063 2023-05-17T11:48:31.168 INFO:teuthology.orchestra.run.smithi003.stdout:063.out 2023-05-17T11:48:31.168 INFO:teuthology.orchestra.run.smithi003.stdout:064 2023-05-17T11:48:31.168 INFO:teuthology.orchestra.run.smithi003.stdout:064.out 2023-05-17T11:48:31.169 INFO:teuthology.orchestra.run.smithi003.stdout:065 2023-05-17T11:48:31.169 INFO:teuthology.orchestra.run.smithi003.stdout:065.out 2023-05-17T11:48:31.169 INFO:teuthology.orchestra.run.smithi003.stdout:066 2023-05-17T11:48:31.169 INFO:teuthology.orchestra.run.smithi003.stdout:066.out 2023-05-17T11:48:31.169 INFO:teuthology.orchestra.run.smithi003.stdout:067 2023-05-17T11:48:31.169 INFO:teuthology.orchestra.run.smithi003.stdout:067.out 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:068 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:068.out 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:069 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:069.out 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:070 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:070.out 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:071 2023-05-17T11:48:31.170 INFO:teuthology.orchestra.run.smithi003.stdout:071.out 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:072 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:072.out 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:073 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:073.out 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:074 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:074.out 2023-05-17T11:48:31.171 INFO:teuthology.orchestra.run.smithi003.stdout:075 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:075.out 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:076 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:076.out 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:077 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:077.out 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:078 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:078.out 2023-05-17T11:48:31.172 INFO:teuthology.orchestra.run.smithi003.stdout:079 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:079.out 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:080 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:080.out 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:081 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:081.out 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:082 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:082.out 2023-05-17T11:48:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:083 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:083.out 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:084 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:084.out 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:085 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:085.out 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:086 2023-05-17T11:48:31.174 INFO:teuthology.orchestra.run.smithi003.stdout:086.out 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:087 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:087.out 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:088 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:088.out 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:089 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:089.out 2023-05-17T11:48:31.175 INFO:teuthology.orchestra.run.smithi003.stdout:090 2023-05-17T11:48:31.176 INFO:teuthology.orchestra.run.smithi003.stdout:090.out 2023-05-17T11:48:31.176 INFO:teuthology.orchestra.run.smithi003.stdout:091 2023-05-17T11:48:31.176 INFO:teuthology.orchestra.run.smithi003.stdout:091.out 2023-05-17T11:48:31.176 INFO:teuthology.orchestra.run.smithi003.stdout:092 2023-05-17T11:48:31.176 INFO:teuthology.orchestra.run.smithi003.stdout:092.out 2023-05-17T11:48:31.176 INFO:teuthology.orchestra.run.smithi003.stdout:093 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:093.out 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:094 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:094.out 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:095 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:095.out 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:096 2023-05-17T11:48:31.177 INFO:teuthology.orchestra.run.smithi003.stdout:096.out 2023-05-17T11:48:31.178 INFO:teuthology.orchestra.run.smithi003.stdout:097 2023-05-17T11:48:31.178 INFO:teuthology.orchestra.run.smithi003.stdout:097.out 2023-05-17T11:48:31.178 INFO:teuthology.orchestra.run.smithi003.stdout:098 2023-05-17T11:48:31.178 INFO:teuthology.orchestra.run.smithi003.stdout:098.out 2023-05-17T11:48:31.178 INFO:teuthology.orchestra.run.smithi003.stdout:099 2023-05-17T11:48:31.178 INFO:teuthology.orchestra.run.smithi003.stdout:099.out 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:100 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:100.out 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:101 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:101.out 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:102 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:102.out 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:103 2023-05-17T11:48:31.179 INFO:teuthology.orchestra.run.smithi003.stdout:103.out 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:104 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:104.out 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:105 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:105.out 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:106 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:106.out 2023-05-17T11:48:31.180 INFO:teuthology.orchestra.run.smithi003.stdout:107 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:107.out 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:108 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:108.out 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:109 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:109.out 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:110 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:110.out 2023-05-17T11:48:31.181 INFO:teuthology.orchestra.run.smithi003.stdout:111 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:111.out 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:112 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:112.out 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:113 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:113.out 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:114 2023-05-17T11:48:31.182 INFO:teuthology.orchestra.run.smithi003.stdout:114.out 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:115 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:115.out 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:116 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:116.out 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:117 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:117.out 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:118 2023-05-17T11:48:31.183 INFO:teuthology.orchestra.run.smithi003.stdout:118.out 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:119 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:119.out 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:120 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:120.out 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:121 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:121.out 2023-05-17T11:48:31.184 INFO:teuthology.orchestra.run.smithi003.stdout:122 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:122.out 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:123 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:123.out 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:124 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:124.out 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:125 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:125.out 2023-05-17T11:48:31.185 INFO:teuthology.orchestra.run.smithi003.stdout:126 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:126.out 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:127 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:127.out 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:128 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:128.out 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:129 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:129.out 2023-05-17T11:48:31.186 INFO:teuthology.orchestra.run.smithi003.stdout:130 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:130.out 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:131 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:131.out 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:132 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:132.out 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:133 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:133.out 2023-05-17T11:48:31.187 INFO:teuthology.orchestra.run.smithi003.stdout:134 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:134.out 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:135 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:135.out 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:136 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:136.out 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:137 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:137.out 2023-05-17T11:48:31.188 INFO:teuthology.orchestra.run.smithi003.stdout:138 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:138.out 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:139 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:139.out 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:140 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:140.out 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:141 2023-05-17T11:48:31.189 INFO:teuthology.orchestra.run.smithi003.stdout:141.out 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:142 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:142.out 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:143 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:143.out 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:144 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:144.out 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:145 2023-05-17T11:48:31.190 INFO:teuthology.orchestra.run.smithi003.stdout:145.out 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:146 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:146.out 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:147 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:147.out 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:148 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:148.out 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:149 2023-05-17T11:48:31.191 INFO:teuthology.orchestra.run.smithi003.stdout:149.out 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:150 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:150.out 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:151 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:151.out 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:152 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:152.out 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:153 2023-05-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi003.stdout:153.out 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:154 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:154.out 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:155 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:155.out 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:156 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:156.out 2023-05-17T11:48:31.193 INFO:teuthology.orchestra.run.smithi003.stdout:157 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:157.out 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:158 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:158.out 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:159 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:159.out 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:160 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:160.out 2023-05-17T11:48:31.194 INFO:teuthology.orchestra.run.smithi003.stdout:161 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:161.out 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:162 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:162.out 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:163 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:163.out 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:164 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:164.out 2023-05-17T11:48:31.195 INFO:teuthology.orchestra.run.smithi003.stdout:165 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:165.out 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:166 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:166.out 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:167 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:167.out 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:168 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:168.out 2023-05-17T11:48:31.196 INFO:teuthology.orchestra.run.smithi003.stdout:169 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:169.out 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:170 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:170.out 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:171 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:171.out 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:172 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:172.out 2023-05-17T11:48:31.197 INFO:teuthology.orchestra.run.smithi003.stdout:173 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:173.out 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:174 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:174.out 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:175 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:175.out 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:176 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:176.out 2023-05-17T11:48:31.198 INFO:teuthology.orchestra.run.smithi003.stdout:177 2023-05-17T11:48:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:177.out 2023-05-17T11:48:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:178 2023-05-17T11:48:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:178.out 2023-05-17T11:48:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:179 2023-05-17T11:48:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:179.out 2023-05-17T11:48:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:180 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:180.out 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:181 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:181.out 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:182 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:182.out 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:183 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:183.out 2023-05-17T11:48:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:184 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:184.out 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:185 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:185.out 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:186 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:186.out 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:187 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:187.out 2023-05-17T11:48:31.201 INFO:teuthology.orchestra.run.smithi003.stdout:188 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:188.out 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:189 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:189.out 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:190 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:190.out 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:191 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:191.out 2023-05-17T11:48:31.202 INFO:teuthology.orchestra.run.smithi003.stdout:192 2023-05-17T11:48:31.203 INFO:teuthology.orchestra.run.smithi003.stdout:192.out 2023-05-17T11:48:31.203 INFO:teuthology.orchestra.run.smithi003.stdout:193 2023-05-17T11:48:31.203 INFO:teuthology.orchestra.run.smithi003.stdout:193.out 2023-05-17T11:48:31.203 INFO:teuthology.orchestra.run.smithi003.stdout:194 2023-05-17T11:48:31.203 INFO:teuthology.orchestra.run.smithi003.stdout:194.out 2023-05-17T11:48:31.203 INFO:teuthology.orchestra.run.smithi003.stdout:195 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:195.out 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:196 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:196.out 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:197 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:197.out 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:198 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:198.out 2023-05-17T11:48:31.204 INFO:teuthology.orchestra.run.smithi003.stdout:199 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:199.out 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:200 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:200.out 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:201 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:201.out 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:202 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:202.out 2023-05-17T11:48:31.205 INFO:teuthology.orchestra.run.smithi003.stdout:203 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:203.out 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:204 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:204.out 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:205 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:205.out 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:206 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:206.out 2023-05-17T11:48:31.206 INFO:teuthology.orchestra.run.smithi003.stdout:207 2023-05-17T11:48:31.207 INFO:teuthology.orchestra.run.smithi003.stdout:207.out 2023-05-17T11:48:31.207 INFO:teuthology.orchestra.run.smithi003.stdout:208 2023-05-17T11:48:31.207 INFO:teuthology.orchestra.run.smithi003.stdout:208.out 2023-05-17T11:48:31.207 INFO:teuthology.orchestra.run.smithi003.stdout:209 2023-05-17T11:48:31.207 INFO:teuthology.orchestra.run.smithi003.stdout:209.out 2023-05-17T11:48:31.207 INFO:teuthology.orchestra.run.smithi003.stdout:210 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:210.out 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:211 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:211.out 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:212 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:212.out 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:213 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:213.out 2023-05-17T11:48:31.208 INFO:teuthology.orchestra.run.smithi003.stdout:214 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:214.out 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:215 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:215.out 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:216 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:216.out 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:217 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:217.out 2023-05-17T11:48:31.209 INFO:teuthology.orchestra.run.smithi003.stdout:218 2023-05-17T11:48:31.210 INFO:teuthology.orchestra.run.smithi003.stdout:218.out 2023-05-17T11:48:31.210 INFO:teuthology.orchestra.run.smithi003.stdout:219 2023-05-17T11:48:31.210 INFO:teuthology.orchestra.run.smithi003.stdout:219.out 2023-05-17T11:48:31.210 INFO:teuthology.orchestra.run.smithi003.stdout:220 2023-05-17T11:48:31.210 INFO:teuthology.orchestra.run.smithi003.stdout:220.out 2023-05-17T11:48:31.210 INFO:teuthology.orchestra.run.smithi003.stdout:221 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:221.out 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:222 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:222.out 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:223 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:223.out 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:224 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:224.out 2023-05-17T11:48:31.211 INFO:teuthology.orchestra.run.smithi003.stdout:225 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:225.out 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:226 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:226.out 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:227 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:227.out 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:228 2023-05-17T11:48:31.212 INFO:teuthology.orchestra.run.smithi003.stdout:228.out 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:229 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:229.out 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:230 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:230.out 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:231 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:231.out 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:232 2023-05-17T11:48:31.213 INFO:teuthology.orchestra.run.smithi003.stdout:232.out 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:233 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:233.out 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:234 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:234.out 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:235 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:235.out 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:236 2023-05-17T11:48:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:236.out 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:237 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:237.out 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:238 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:238.out 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:239 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:239.out 2023-05-17T11:48:31.215 INFO:teuthology.orchestra.run.smithi003.stdout:240 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:240.out 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:241 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:241.out 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:242 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:242.out 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:243 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:243.out 2023-05-17T11:48:31.216 INFO:teuthology.orchestra.run.smithi003.stdout:244 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:244.out 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:245 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:245.out 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:246 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:246.out 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:247 2023-05-17T11:48:31.217 INFO:teuthology.orchestra.run.smithi003.stdout:247.out 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:248 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:248.out 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:249 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:249.out 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:250 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:250.out 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:251 2023-05-17T11:48:31.218 INFO:teuthology.orchestra.run.smithi003.stdout:251.out 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:252 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:252.out 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:253 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:253.out 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:254 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:254.out 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:255 2023-05-17T11:48:31.219 INFO:teuthology.orchestra.run.smithi003.stdout:255.out 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:256 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:256.out 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:257 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:257.out 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:258 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:258.out 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:259 2023-05-17T11:48:31.220 INFO:teuthology.orchestra.run.smithi003.stdout:259.out 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:260 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:260.out 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:261 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:261.out 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:262 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:262.out 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:263 2023-05-17T11:48:31.221 INFO:teuthology.orchestra.run.smithi003.stdout:263.out 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:264 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:264.out 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:265 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:265.out 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:266 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:266.out 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:267 2023-05-17T11:48:31.222 INFO:teuthology.orchestra.run.smithi003.stdout:267.out 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:268 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:268.out 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:269 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:269.out 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:270 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:270.out 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:271 2023-05-17T11:48:31.223 INFO:teuthology.orchestra.run.smithi003.stdout:271.out 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:272 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:272.out 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:273 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:273.out 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:274 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:274.out 2023-05-17T11:48:31.224 INFO:teuthology.orchestra.run.smithi003.stdout:275 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:275.out 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:276 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:276.out 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:277 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:277.out 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:278 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:278.out 2023-05-17T11:48:31.225 INFO:teuthology.orchestra.run.smithi003.stdout:279 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:279.out 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:280 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:280.out 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:281 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:281.out 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:282 2023-05-17T11:48:31.226 INFO:teuthology.orchestra.run.smithi003.stdout:282.out 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:283 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:283.out 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:284 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:284.out 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:285 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:285.out 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:286 2023-05-17T11:48:31.227 INFO:teuthology.orchestra.run.smithi003.stdout:286.out 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:287 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:287.out 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:288 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:288.out 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:289 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:289.out 2023-05-17T11:48:31.228 INFO:teuthology.orchestra.run.smithi003.stdout:290 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:290.out 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:291 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:291.out 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:292 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:292.out 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:293 2023-05-17T11:48:31.229 INFO:teuthology.orchestra.run.smithi003.stdout:293.out 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:294 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:294.out 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:295 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:295.out 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:296 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:296.out 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:297 2023-05-17T11:48:31.230 INFO:teuthology.orchestra.run.smithi003.stdout:297.out 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:298 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:298.out 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:299 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:299.out 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:300 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:300.out 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:301 2023-05-17T11:48:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:301.out 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:302 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:302.out 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:303 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:303.out 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:304 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:304.out 2023-05-17T11:48:31.232 INFO:teuthology.orchestra.run.smithi003.stdout:305 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:305.out 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:306 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:306.out 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:307 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:307.out 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:308 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:308.out 2023-05-17T11:48:31.233 INFO:teuthology.orchestra.run.smithi003.stdout:309 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:309.out 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:310 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:310.out 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:311 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:311.out 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:312 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:312.out 2023-05-17T11:48:31.234 INFO:teuthology.orchestra.run.smithi003.stdout:313 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:313.out 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:314 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:314.out 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:315 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:315.out 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:316 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:316.out 2023-05-17T11:48:31.235 INFO:teuthology.orchestra.run.smithi003.stdout:317 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:317.out 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:318 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:318.out 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:319 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:319.out 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:320 2023-05-17T11:48:31.236 INFO:teuthology.orchestra.run.smithi003.stdout:320.out 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:321 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:321.out 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:322 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:322.out 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:323 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:323.out 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:324 2023-05-17T11:48:31.237 INFO:teuthology.orchestra.run.smithi003.stdout:324.out 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:325 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:325.out 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:326 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:326.out 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:327 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:327.out 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:328 2023-05-17T11:48:31.238 INFO:teuthology.orchestra.run.smithi003.stdout:328.out 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:329 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:329.out 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:330 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:330.out 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:331 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:331.out 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:332 2023-05-17T11:48:31.239 INFO:teuthology.orchestra.run.smithi003.stdout:332.out 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:333 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:333.out 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:334 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:334.out 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:335 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:335.out 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:336 2023-05-17T11:48:31.240 INFO:teuthology.orchestra.run.smithi003.stdout:336.out 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:337 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:337.out 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:338 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:338.out 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:339 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:339.out 2023-05-17T11:48:31.241 INFO:teuthology.orchestra.run.smithi003.stdout:340 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:340.out 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:341 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:341.out 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:342 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:342.out 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:343 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:343.out 2023-05-17T11:48:31.242 INFO:teuthology.orchestra.run.smithi003.stdout:344 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:344.out 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:345 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:345.out 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:346 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:346.out 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:347 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:347.out 2023-05-17T11:48:31.243 INFO:teuthology.orchestra.run.smithi003.stdout:348 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:348.out 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:349 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:349.out 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:350 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:350.out 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:351 2023-05-17T11:48:31.244 INFO:teuthology.orchestra.run.smithi003.stdout:351.out 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:352 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:352.out 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:353 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:353.out 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:354 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:354.out 2023-05-17T11:48:31.245 INFO:teuthology.orchestra.run.smithi003.stdout:355 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:355.out 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:356 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:356.out 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:357 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:357.out 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:358 2023-05-17T11:48:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:358.out 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:359 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:359.out 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:360 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:360.out 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:361 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:361.out 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:362 2023-05-17T11:48:31.247 INFO:teuthology.orchestra.run.smithi003.stdout:362.out 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:363 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:363.out 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:364 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:364.out 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:365 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:365.out 2023-05-17T11:48:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:366 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:366.out 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:367 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:367.out 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:368 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:368.out 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:369 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:369.out 2023-05-17T11:48:31.249 INFO:teuthology.orchestra.run.smithi003.stdout:370 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:370.out 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:371 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:371.out 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:372 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:372.out 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:373 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:373.out 2023-05-17T11:48:31.250 INFO:teuthology.orchestra.run.smithi003.stdout:374 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:374.out 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:375 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:375.out 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:376 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:376.out 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:377 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:377.out 2023-05-17T11:48:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:378 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:378.out 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:379 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:379.out 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:380 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:380.out 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:381 2023-05-17T11:48:31.252 INFO:teuthology.orchestra.run.smithi003.stdout:381.out 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:382 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:382.out 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:383 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:383.out 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:384 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:384.out 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:385 2023-05-17T11:48:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:385.out 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:386 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:386.out 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:387 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:387.out 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:388 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:388.out 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:389 2023-05-17T11:48:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:389.out 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:390 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:390.out 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:391 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:391.out 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:392 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:392.out 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:393 2023-05-17T11:48:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:393.out 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:394 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:394.out 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:395 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:395.out 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:396 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:396.out 2023-05-17T11:48:31.256 INFO:teuthology.orchestra.run.smithi003.stdout:397 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:397.out 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:398 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:398.out 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:399 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:399.out 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:400 2023-05-17T11:48:31.257 INFO:teuthology.orchestra.run.smithi003.stdout:400.out 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:401 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:401.out 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:402 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:402.out 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:403 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:403.out 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:404 2023-05-17T11:48:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:404.out 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:405 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:405.out 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:406 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:406.out 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:407 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:407.out 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:408 2023-05-17T11:48:31.259 INFO:teuthology.orchestra.run.smithi003.stdout:408.out 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:409 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:409.out 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:410 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:410.out 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:411 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:411.out 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:412 2023-05-17T11:48:31.260 INFO:teuthology.orchestra.run.smithi003.stdout:412.out 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:413 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:413.out 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:414 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:414.out 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:415 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:415.out 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:416 2023-05-17T11:48:31.261 INFO:teuthology.orchestra.run.smithi003.stdout:416.out 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:417 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:417.out 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:418 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:418.out 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:419 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:419.out 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:420 2023-05-17T11:48:31.262 INFO:teuthology.orchestra.run.smithi003.stdout:420.out 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:421 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:421.out 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:422 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:422.out 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:423 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:423.out 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:424 2023-05-17T11:48:31.263 INFO:teuthology.orchestra.run.smithi003.stdout:424.out 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:425 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:425.out 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:426 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:426.out 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:427 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:427.out 2023-05-17T11:48:31.264 INFO:teuthology.orchestra.run.smithi003.stdout:428 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:428.out 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:429 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:429.out 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:430 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:430.out 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:431 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:431.out 2023-05-17T11:48:31.265 INFO:teuthology.orchestra.run.smithi003.stdout:432 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:432.out 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:433 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:433.out 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:434 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:434.out 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:435 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:435.out 2023-05-17T11:48:31.266 INFO:teuthology.orchestra.run.smithi003.stdout:436 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:436.out 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:437 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:437.out 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:438 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:438.out 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:439 2023-05-17T11:48:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:439.out 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:440 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:440.out 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:441 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:441.out 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:442 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:442.out 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:443 2023-05-17T11:48:31.268 INFO:teuthology.orchestra.run.smithi003.stdout:443.out 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:444 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:444.out 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:445 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:445.out 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:446 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:446.out 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:447 2023-05-17T11:48:31.269 INFO:teuthology.orchestra.run.smithi003.stdout:447.out 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:448 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:448.out 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:449 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:449.out 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:450 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:450.out 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:451 2023-05-17T11:48:31.270 INFO:teuthology.orchestra.run.smithi003.stdout:451.out 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:452 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:452.out 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:453 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:453.out 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:454 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:454.out 2023-05-17T11:48:31.271 INFO:teuthology.orchestra.run.smithi003.stdout:455 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:455.out 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:456 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:456.out 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:457 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:457.out 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:458 2023-05-17T11:48:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:458.out 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:459 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:459.out 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:460 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:460.out 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:461 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:461.out 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:462 2023-05-17T11:48:31.273 INFO:teuthology.orchestra.run.smithi003.stdout:462.out 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:463 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:463.out 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:464 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:464.out 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:465 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:465.out 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:466 2023-05-17T11:48:31.274 INFO:teuthology.orchestra.run.smithi003.stdout:466.out 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:467 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:467.out 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:468 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:468.out 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:469 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:469.out 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:470 2023-05-17T11:48:31.275 INFO:teuthology.orchestra.run.smithi003.stdout:470.out 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:471 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:471.out 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:472 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:472.out 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:473 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:473.out 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:474 2023-05-17T11:48:31.276 INFO:teuthology.orchestra.run.smithi003.stdout:474.out 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:475 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:475.out 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:476 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:476.out 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:477 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:477.out 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:478 2023-05-17T11:48:31.277 INFO:teuthology.orchestra.run.smithi003.stdout:478.out 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:479 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:479.out 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:480 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:480.out 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:481 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:481.out 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:482 2023-05-17T11:48:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:482.out 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:483 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:483.out 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:484 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:484.out 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:485 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:485.out 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:486 2023-05-17T11:48:31.279 INFO:teuthology.orchestra.run.smithi003.stdout:486.out 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:487 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:487.out 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:488 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:488.out 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:489 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:489.out 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:490 2023-05-17T11:48:31.280 INFO:teuthology.orchestra.run.smithi003.stdout:490.out 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:491 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:491.out 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:492 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:492.out 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:493 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:493.out 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:494 2023-05-17T11:48:31.281 INFO:teuthology.orchestra.run.smithi003.stdout:494.out 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:495 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:495.out 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:496 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:496.out 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:497 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:497.out 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:498 2023-05-17T11:48:31.282 INFO:teuthology.orchestra.run.smithi003.stdout:498.out 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:499 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:499.out 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:500 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:500.out 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:501 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:501.out 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:502 2023-05-17T11:48:31.283 INFO:teuthology.orchestra.run.smithi003.stdout:502.out 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:503 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:503.out 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:504 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:504.out 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:505 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:505.out 2023-05-17T11:48:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:506 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:506.out 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:507 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:507.out 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:508 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:508.out 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:509 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:509.out 2023-05-17T11:48:31.285 INFO:teuthology.orchestra.run.smithi003.stdout:510 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:510.out 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:511 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:511.out 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:512 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:512.out 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:513 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:513.out 2023-05-17T11:48:31.286 INFO:teuthology.orchestra.run.smithi003.stdout:514 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:514.out 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:515 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:515.out 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:516 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:516.out 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:517 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:517.out 2023-05-17T11:48:31.287 INFO:teuthology.orchestra.run.smithi003.stdout:518 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:518.out 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:519 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:519.out 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:520 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:520.out 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:521 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:521.out 2023-05-17T11:48:31.288 INFO:teuthology.orchestra.run.smithi003.stdout:522 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:522.out 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:523 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:523.out 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:524 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:524.out 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:525 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:525.out 2023-05-17T11:48:31.289 INFO:teuthology.orchestra.run.smithi003.stdout:526 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:526.out 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:527 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:527.out 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:528 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:528.out 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:529 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:529.out 2023-05-17T11:48:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:530 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:530.out 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:531 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:531.out 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:532 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:532.out 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:533 2023-05-17T11:48:31.291 INFO:teuthology.orchestra.run.smithi003.stdout:533.out 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:534 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:534.out 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:535 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:535.out 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:536 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:536.out 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:537 2023-05-17T11:48:31.292 INFO:teuthology.orchestra.run.smithi003.stdout:537.out 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:538 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:538.out 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:539 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:539.out 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:540 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:540.out 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:541 2023-05-17T11:48:31.293 INFO:teuthology.orchestra.run.smithi003.stdout:541.out 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:542 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:542.out 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:543 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:543.out 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:544 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:544.out 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:545 2023-05-17T11:48:31.294 INFO:teuthology.orchestra.run.smithi003.stdout:545.out 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:546 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:546.out 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:547 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:547.out 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:548 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:548.out 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:549 2023-05-17T11:48:31.295 INFO:teuthology.orchestra.run.smithi003.stdout:549.out 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:550 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:550.out 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:551 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:551.out 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:552 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:552.out 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:553 2023-05-17T11:48:31.296 INFO:teuthology.orchestra.run.smithi003.stdout:553.out 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:554 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:554.out 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:555 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:555.out 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:556 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:556.out 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:557 2023-05-17T11:48:31.297 INFO:teuthology.orchestra.run.smithi003.stdout:557.out 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:558 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:558.out 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:559 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:559.out 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:560 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:560.out 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:561 2023-05-17T11:48:31.298 INFO:teuthology.orchestra.run.smithi003.stdout:561.out 2023-05-17T11:48:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:562 2023-05-17T11:48:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:562.out 2023-05-17T11:48:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:563 2023-05-17T11:48:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:563.out 2023-05-17T11:48:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:564 2023-05-17T11:48:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:564.out 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:565 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:565.out 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:566 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:566.out 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:567 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:567.out 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:568 2023-05-17T11:48:31.300 INFO:teuthology.orchestra.run.smithi003.stdout:568.out 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:569 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:569.out 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:570 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:570.out 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:571 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:571.out 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:572 2023-05-17T11:48:31.301 INFO:teuthology.orchestra.run.smithi003.stdout:572.out 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:573 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:573.out 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:574 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:574.out 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:575 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:575.out 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:576 2023-05-17T11:48:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:576.out 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:577 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:577.out 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:578 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:578.out 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:579 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:579.out 2023-05-17T11:48:31.303 INFO:teuthology.orchestra.run.smithi003.stdout:580 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:580.out 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:581 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:581.out 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:582 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:582.out 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:583 2023-05-17T11:48:31.304 INFO:teuthology.orchestra.run.smithi003.stdout:583.out 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:584 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:584.out 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:585 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:585.out 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:586 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:586.out 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:587 2023-05-17T11:48:31.305 INFO:teuthology.orchestra.run.smithi003.stdout:587.out 2023-05-17T11:48:31.306 INFO:teuthology.orchestra.run.smithi003.stdout:588 2023-05-17T11:48:31.306 INFO:teuthology.orchestra.run.smithi003.stdout:588.out 2023-05-17T11:48:31.306 INFO:teuthology.orchestra.run.smithi003.stdout:589 2023-05-17T11:48:31.306 INFO:teuthology.orchestra.run.smithi003.stdout:589.out 2023-05-17T11:48:31.306 INFO:teuthology.orchestra.run.smithi003.stdout:590 2023-05-17T11:48:31.306 INFO:teuthology.orchestra.run.smithi003.stdout:590.out 2023-05-17T11:48:31.307 INFO:teuthology.orchestra.run.smithi003.stdout:591 2023-05-17T11:48:31.307 INFO:teuthology.orchestra.run.smithi003.stdout:591.out 2023-05-17T11:48:31.307 INFO:teuthology.orchestra.run.smithi003.stdout:592 2023-05-17T11:48:31.307 INFO:teuthology.orchestra.run.smithi003.stdout:592.out 2023-05-17T11:48:31.307 INFO:teuthology.orchestra.run.smithi003.stdout:593 2023-05-17T11:48:31.307 INFO:teuthology.orchestra.run.smithi003.stdout:593.out 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:594 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:594.out 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:595 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:595.out 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:596 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:596.out 2023-05-17T11:48:31.308 INFO:teuthology.orchestra.run.smithi003.stdout:597 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:597.out 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:598 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:598.out 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:599 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:599.out 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:600 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:600.out 2023-05-17T11:48:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:601 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:601.out 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:602 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:602.out 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:603 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:603.out 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:604 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:604.out 2023-05-17T11:48:31.310 INFO:teuthology.orchestra.run.smithi003.stdout:605 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:605.out 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:606 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:606.out 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:607 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:607.out 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:608 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:608.out 2023-05-17T11:48:31.311 INFO:teuthology.orchestra.run.smithi003.stdout:609 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:609.out 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:610 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:610.out 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:611 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:611.out 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:612 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:612.out 2023-05-17T11:48:31.312 INFO:teuthology.orchestra.run.smithi003.stdout:613 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:613.out 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:614 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:614.out 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:615 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:615.out 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:616 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:616.out 2023-05-17T11:48:31.313 INFO:teuthology.orchestra.run.smithi003.stdout:617 2023-05-17T11:48:31.314 INFO:teuthology.orchestra.run.smithi003.stdout:617.out 2023-05-17T11:48:31.314 INFO:teuthology.orchestra.run.smithi003.stdout:618 2023-05-17T11:48:31.315 INFO:teuthology.orchestra.run.smithi003.stdout:618.out 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:619 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:619.out 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:620 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:620.out 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:621 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:621.out 2023-05-17T11:48:31.316 INFO:teuthology.orchestra.run.smithi003.stdout:622 2023-05-17T11:48:31.317 INFO:teuthology.orchestra.run.smithi003.stdout:622.out 2023-05-17T11:48:31.317 INFO:teuthology.orchestra.run.smithi003.stdout:623 2023-05-17T11:48:31.317 INFO:teuthology.orchestra.run.smithi003.stdout:623.out 2023-05-17T11:48:31.317 INFO:teuthology.orchestra.run.smithi003.stdout:624 2023-05-17T11:48:31.317 INFO:teuthology.orchestra.run.smithi003.stdout:624.out 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:625 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:625.out 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:626 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:626.out 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:627 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:627.out 2023-05-17T11:48:31.318 INFO:teuthology.orchestra.run.smithi003.stdout:628 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:628.out 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:629 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:629.out 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:630 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:630.out 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:631 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:631.out 2023-05-17T11:48:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:632 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:632.out 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:633 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:633.out 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:634 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:634.out 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:635 2023-05-17T11:48:31.320 INFO:teuthology.orchestra.run.smithi003.stdout:635.out 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:636 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:636.out 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:637 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:637.out 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:638 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:638.out 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:639 2023-05-17T11:48:31.321 INFO:teuthology.orchestra.run.smithi003.stdout:639.out 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:640 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:640.out 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:641 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:641.out 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:642 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:642.out 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:643 2023-05-17T11:48:31.322 INFO:teuthology.orchestra.run.smithi003.stdout:643.out 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:644 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:644.out 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:645 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:645.out 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:646 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:646.out 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:647 2023-05-17T11:48:31.323 INFO:teuthology.orchestra.run.smithi003.stdout:647.out 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:648 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:648.out 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:649 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:649.out 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:650 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:650.out 2023-05-17T11:48:31.324 INFO:teuthology.orchestra.run.smithi003.stdout:651 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:651.out 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:652 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:652.out 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:653 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:653.out 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:654 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:654.out 2023-05-17T11:48:31.325 INFO:teuthology.orchestra.run.smithi003.stdout:655 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:655.out 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:656 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:656.out 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:657 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:657.out 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:658 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:658.out 2023-05-17T11:48:31.326 INFO:teuthology.orchestra.run.smithi003.stdout:659 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:659.out 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:660 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:660.out 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:661 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:661.out 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:662 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:662.out 2023-05-17T11:48:31.327 INFO:teuthology.orchestra.run.smithi003.stdout:663 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:663.out 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:664 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:664.out 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:665 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:665.out 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:666 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:666.out 2023-05-17T11:48:31.328 INFO:teuthology.orchestra.run.smithi003.stdout:667 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:667.out 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:668 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:668.out 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:669 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:669.out 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:670 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:670.out 2023-05-17T11:48:31.329 INFO:teuthology.orchestra.run.smithi003.stdout:671 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:671.out 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:672 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:672.out 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:673 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:673.out 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:674 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:674.out 2023-05-17T11:48:31.330 INFO:teuthology.orchestra.run.smithi003.stdout:675 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:675.out 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:676 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:676.out 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:677 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:677.out 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:678 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:678.out 2023-05-17T11:48:31.331 INFO:teuthology.orchestra.run.smithi003.stdout:679 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:679.out 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:680 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:680.out 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:681 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:681.out 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:682 2023-05-17T11:48:31.332 INFO:teuthology.orchestra.run.smithi003.stdout:682.out 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:683 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:683.out 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:684 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:684.out 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:685 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:685.out 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:686 2023-05-17T11:48:31.333 INFO:teuthology.orchestra.run.smithi003.stdout:686.out 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:687 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:687.out 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:688 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:688.out 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:689 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:689.out 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:690 2023-05-17T11:48:31.334 INFO:teuthology.orchestra.run.smithi003.stdout:690.out 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:691 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:691.out 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:692 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:692.out 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:693 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:693.out 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:694 2023-05-17T11:48:31.335 INFO:teuthology.orchestra.run.smithi003.stdout:694.out 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:695 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:695.out 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:696 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:696.out 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:697 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:697.out 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:698 2023-05-17T11:48:31.336 INFO:teuthology.orchestra.run.smithi003.stdout:698.out 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:699 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:699.out 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:700 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:700.out 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:701 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:701.out 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:702 2023-05-17T11:48:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:702.out 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:703 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:703.out 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:704 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:704.out 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:705 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:705.out 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:706 2023-05-17T11:48:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:706.out 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:707 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:707.out 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:708 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:708.out 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:709 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:709.out 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:710 2023-05-17T11:48:31.339 INFO:teuthology.orchestra.run.smithi003.stdout:710.out 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:711 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:711.out 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:712 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:712.out 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:713 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:713.out 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:714 2023-05-17T11:48:31.340 INFO:teuthology.orchestra.run.smithi003.stdout:714.out 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:715 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:715.out 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:716 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:716.out 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:717 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:717.out 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:718 2023-05-17T11:48:31.341 INFO:teuthology.orchestra.run.smithi003.stdout:718.out 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:719 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:719.out 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:720 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:720.out 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:721 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:721.out 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:722 2023-05-17T11:48:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:722.out 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:723 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:723.out 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:724 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:724.out 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:725 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:725.out 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:726 2023-05-17T11:48:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:726.out 2023-05-17T11:48:31.344 INFO:teuthology.orchestra.run.smithi003.stdout:727 2023-05-17T11:48:31.344 INFO:teuthology.orchestra.run.smithi003.stdout:727.out 2023-05-17T11:48:31.344 INFO:teuthology.orchestra.run.smithi003.stdout:group.list 2023-05-17T11:48:31.344 INFO:teuthology.orchestra.run.smithi003.stdout:Makefile 2023-05-17T11:48:31.345 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-17T11:48:31.731 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:48:31.740 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:48:31.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:34.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:48:34.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:48:35.762 INFO:teuthology.orchestra.run.smithi003.stdout:generic/001 4s 2023-05-17T11:48:35.774 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/001 2023-05-17T11:48:35.774 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:48:35.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:35.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[47720]: fuse finished with error 0 and tester_r 0 2023-05-17T11:48:35.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:48:35.799 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-17T11:48:36.154 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:48:36.163 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:48:36.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:36.917 INFO:teuthology.orchestra.run.smithi003.stdout:generic/002 0s 2023-05-17T11:48:36.929 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/002 2023-05-17T11:48:36.929 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:48:36.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:36.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:48:36.954 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-17T11:48:37.378 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:48:37.387 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:48:37.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:37.679 INFO:teuthology.orchestra.run.smithi003.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T11:48:37.687 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/003 2023-05-17T11:48:37.687 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/003 2023-05-17T11:48:37.687 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:48:37.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:37.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:48:37.711 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-17T11:48:38.074 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:48:38.084 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:48:38.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:38.392 INFO:teuthology.orchestra.run.smithi003.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-17T11:48:38.400 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/004 2023-05-17T11:48:38.400 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/004 2023-05-17T11:48:38.400 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:48:38.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:38.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:48:38.423 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-17T11:48:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:48:38.767 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:48:38.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:39.718 INFO:teuthology.orchestra.run.smithi003.stdout:generic/005 1s 2023-05-17T11:48:39.729 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/005 2023-05-17T11:48:39.729 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:48:39.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:48:39.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:48:39.754 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-17T11:48:40.198 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:48:40.207 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:48:40.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:49:04.925 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:49:04.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:49:14.428 INFO:teuthology.orchestra.run.smithi003.stdout:generic/006 34s 2023-05-17T11:49:14.440 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/006 2023-05-17T11:49:14.440 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:49:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:49:14.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:49:14.465 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-17T11:49:14.887 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:49:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:49:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:49:34.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:49:34.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:50:06.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:50:06.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:50:37.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:50:37.009 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:50:37.954 INFO:teuthology.orchestra.run.smithi003.stdout:generic/007 83s 2023-05-17T11:50:37.966 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/007 2023-05-17T11:50:37.966 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:50:37.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:37.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:50:37.991 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-17T11:50:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:50:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:50:38.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:40.048 INFO:teuthology.orchestra.run.smithi003.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-17T11:50:40.055 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/008 2023-05-17T11:50:40.056 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/008 2023-05-17T11:50:40.056 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:50:40.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:40.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:50:40.081 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-17T11:50:40.457 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:50:40.466 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:50:40.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:41.895 INFO:teuthology.orchestra.run.smithi003.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-17T11:50:41.902 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/009 2023-05-17T11:50:41.902 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/009 2023-05-17T11:50:41.902 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:50:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:41.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:50:41.927 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-17T11:50:42.300 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:50:42.309 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:50:42.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:42.612 INFO:teuthology.orchestra.run.smithi003.stdout:generic/010 [not run] /tmp/tmp.wZOEk1XGhTxfstests-dev/src/dbtest not built 2023-05-17T11:50:42.619 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/010 2023-05-17T11:50:42.620 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/010 2023-05-17T11:50:42.620 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:50:42.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:50:42.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:50:42.643 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-17T11:50:43.027 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:50:43.036 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:50:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:51:07.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:51:07.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:51:24.004 INFO:teuthology.orchestra.run.smithi003.stdout:generic/011 40s 2023-05-17T11:51:24.015 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/011 2023-05-17T11:51:24.015 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:51:24.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:51:24.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:51:24.110 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-17T11:51:24.485 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:51:24.494 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:51:24.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:51:26.110 INFO:teuthology.orchestra.run.smithi003.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T11:51:26.118 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/012 2023-05-17T11:51:26.118 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/012 2023-05-17T11:51:26.118 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:51:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:51:26.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:51:26.152 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-17T11:51:26.585 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:51:26.594 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:51:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:51:37.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:51:37.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:52:07.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:52:07.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:52:37.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:52:37.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:53:08.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:53:08.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:53:16.749 INFO:teuthology.orchestra.run.smithi003.stdout:generic/013 110s 2023-05-17T11:53:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/013 2023-05-17T11:53:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:53:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:53:18.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:53:18.559 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-17T11:53:19.144 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:53:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:53:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:53:38.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:53:38.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:53:38.235 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-05-17T11:53:38.230+0000 7ff70d89d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86998) UID: 0 2023-05-17T11:53:38.236 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-05-17T11:53:38.226+0000 7f2ebcdde640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86998) UID: 0 2023-05-17T11:57:25.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:57:25.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:57:55.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:57:55.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:58:12.736 INFO:teuthology.orchestra.run.smithi003.stdout:generic/014 293s 2023-05-17T11:58:12.750 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/014 2023-05-17T11:58:12.750 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:12.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:12.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:12.841 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-17T11:58:13.340 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:13.354 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:13.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:13.762 INFO:teuthology.orchestra.run.smithi003.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T11:58:13.775 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/015 2023-05-17T11:58:13.775 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/015 2023-05-17T11:58:13.775 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:13.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:13.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:13.810 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-17T11:58:14.333 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:16.933 INFO:teuthology.orchestra.run.smithi003.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T11:58:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/016 2023-05-17T11:58:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/016 2023-05-17T11:58:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:16.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:16.982 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-17T11:58:17.812 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:17.827 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T11:58:18.237 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/017 2023-05-17T11:58:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/017 2023-05-17T11:58:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:18.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:18.276 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-17T11:58:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T11:58:19.227 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/018 2023-05-17T11:58:19.229 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/018 2023-05-17T11:58:19.229 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:19.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:19.266 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-17T11:58:19.798 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:19.816 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:20.211 INFO:teuthology.orchestra.run.smithi003.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T11:58:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/019 2023-05-17T11:58:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/019 2023-05-17T11:58:20.220 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:20.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:20.257 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-17T11:58:20.780 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:27.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:58:27.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:58:41.720 INFO:teuthology.orchestra.run.smithi003.stdout:generic/020 - output mismatch (see /tmp/tmp.wZOEk1XGhTxfstests-dev/results//generic/020.out.bad) 2023-05-17T11:58:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: --- tests/generic/020.out 2023-05-17 11:46:51.370447835 +0000 2023-05-17T11:58:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: +++ /tmp/tmp.wZOEk1XGhTxfstests-dev/results//generic/020.out.bad 2023-05-17 11:58:41.714112096 +0000 2023-05-17T11:58:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: @@ -39,27 +39,6 @@ 2023-05-17T11:58:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: user.snrub="fish2\012" 2023-05-17T11:58:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: *** add lots of attributes 2023-05-17T11:58:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: -*** check 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: - *** MAX_ATTRS attribute(s) 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: -*** remove lots of attributes 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: - *** print attributes 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: -# file: 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: -user.snrub="fish2\012" 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: - 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: -*** really long value 2023-05-17T11:58:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: -0000000 00 2023-05-17T11:58:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: -* 2023-05-17T11:58:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: -ATTRSIZE 2023-05-17T11:58:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: -*** set/get/remove really long names (expect failure) 2023-05-17T11:58:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: -attr_set: Invalid argument 2023-05-17T11:58:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-17T11:58:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: -attr_get: Invalid argument 2023-05-17T11:58:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-17T11:58:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: -attr_remove: Invalid argument 2023-05-17T11:58:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-17T11:58:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: -*** check final 2023-05-17T11:58:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: - *** print attributes 2023-05-17T11:58:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: -# file: 2023-05-17T11:58:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: -user.snrub="fish2\012" 2023-05-17T11:58:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: - 2023-05-17T11:58:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: -*** delete 2023-05-17T11:58:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: +attr_set: No space left on device 2023-05-17T11:58:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: +Could not set "attribute_2335" for /tmp/tmp.byg0vFAYA5test/attribute_89402 2023-05-17T11:58:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: +!!! failed to add "attribute_2335" 2023-05-17T11:58:41.737 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/020 2023-05-17T11:58:41.737 INFO:teuthology.orchestra.run.smithi003.stdout:Failures: generic/020 2023-05-17T11:58:41.737 INFO:teuthology.orchestra.run.smithi003.stdout:Failed 1 of 1 tests 2023-05-17T11:58:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:42.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T11:58:42.034 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T11:58:42.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T11:58:42.035 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-17T11:58:42.624 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:42.636 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:42.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:45.187 INFO:teuthology.orchestra.run.smithi003.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T11:58:45.198 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/021 2023-05-17T11:58:45.198 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/021 2023-05-17T11:58:45.199 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:45.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:45.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:45.261 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-17T11:58:46.042 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:46.055 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:46.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:48.582 INFO:teuthology.orchestra.run.smithi003.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T11:58:48.592 INFO:teuthology.orchestra.run.smithi003.stdout:Ran: generic/022 2023-05-17T11:58:48.592 INFO:teuthology.orchestra.run.smithi003.stdout:Not run: generic/022 2023-05-17T11:58:48.592 INFO:teuthology.orchestra.run.smithi003.stdout:Passed all 1 tests 2023-05-17T11:58:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:48.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T11:58:48.629 DEBUG:teuthology.orchestra.run.smithi003:> (cd /tmp/tmp.wZOEk1XGhTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-17T11:58:49.447 INFO:teuthology.orchestra.run.smithi003.stdout:FSTYP -- ceph-fuse 2023-05-17T11:58:49.463 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM -- Linux/x86_64 smithi003 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 05:56:38 UTC 2023 2023-05-17T11:58:49.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-05-17T11:58:57.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:58:57.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:59:27.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:59:27.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:59:57.484 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T11:59:57.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:00:27.536 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:00:27.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:00:57.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:00:57.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:01:27.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:01:27.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:01:57.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:01:57.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:02:27.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:02:27.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:02:57.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:02:57.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:03:27.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:03:27.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:03:57.974 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:03:57.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:04:28.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:04:28.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:04:58.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:04:58.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:05:28.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:05:28.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:05:58.212 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:05:58.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:06:28.270 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:06:28.274 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:06:58.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:06:58.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:07:28.382 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:07:28.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:07:58.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:07:58.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:08:28.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:08:28.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:08:58.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:08:58.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:09:28.625 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:09:28.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:09:58.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:09:58.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:10:28.755 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:10:28.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:10:58.825 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:10:58.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:11:28.885 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:11:28.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:11:58.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:11:58.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:12:29.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:12:29.009 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:12:59.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:12:59.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:13:29.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:13:29.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:13:59.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:13:59.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:14:29.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:14:29.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:14:59.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:14:59.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:15:29.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:15:29.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:15:59.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:15:59.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:16:29.524 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:16:29.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:16:59.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:16:59.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:17:29.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:17:29.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:17:59.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:17:59.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:18:29.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:18:29.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:18:59.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:18:59.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:19:29.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:19:29.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:19:59.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:19:59.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:20:30.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:20:30.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:21:00.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:21:00.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:21:30.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:21:30.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:22:00.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:22:00.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:22:30.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:22:30.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:00.374 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:00.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:30.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:30.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:00.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:00.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:30.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:31.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:01.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:01.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:31.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:31.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:01.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:01.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:31.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:31.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:01.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:01.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:31.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:31.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:01.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:01.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:31.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:31.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:01.762 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:01.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:31.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:31.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:01.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:01.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:31.947 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:31.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:31:02.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:31:02.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:31:32.085 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:31:32.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:02.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:02.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:32.206 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:32.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:02.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:02.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:32.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:32.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:02.442 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:02.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:32.515 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:32.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:35:02.572 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:35:02.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:35:32.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:35:32.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:36:02.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:36:02.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:36:32.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:36:32.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:37:02.816 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:37:02.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:37:32.878 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:37:32.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:02.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:02.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:33.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:33.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:03.082 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:03.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:33.138 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:33.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:03.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:03.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:33.257 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:33.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:03.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:03.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:33.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:33.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:03.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:03.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:33.491 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:33.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:43:03.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:43:03.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:43:33.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:43:33.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:03.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:03.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:33.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:33.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:03.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:03.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:33.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:33.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:03.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:03.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:34.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:34.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:04.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:04.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:34.129 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:34.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:04.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:04.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:34.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:34.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:49:04.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:49:04.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:49:34.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:49:34.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:50:04.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:50:04.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:50:34.502 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:50:34.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:51:04.603 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:51:04.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:51:34.655 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:51:34.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:52:04.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:52:04.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:52:34.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:52:34.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:53:04.859 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:53:04.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:53:35.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:53:35.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:54:05.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:54:05.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:54:35.163 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:54:35.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:55:05.218 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:55:05.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:55:35.282 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:55:35.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:56:05.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:56:05.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:56:35.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:56:35.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:57:05.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:57:05.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:57:35.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:57:35.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:58:05.824 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:58:05.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:58:35.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:58:35.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:59:05.946 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:59:05.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:59:36.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:59:36.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:00:06.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:00:06.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:00:36.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:00:36.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:01:06.193 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:01:06.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:01:36.252 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:01:36.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:02:06.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:02:06.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:02:36.381 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:02:36.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:03:06.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:03:06.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:03:36.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:03:36.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:04:06.576 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:04:06.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:04:36.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:04:36.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:05:06.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:05:06.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:05:36.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:05:36.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:06:06.833 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:06:06.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:06:36.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:06:36.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:07:06.952 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:07:06.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:07:37.014 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:07:37.018 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:08:07.111 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:08:07.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:08:37.169 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:08:37.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:09:07.224 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:09:07.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:09:37.282 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:09:37.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:10:07.339 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:10:07.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:10:37.404 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:10:37.409 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:11:07.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:11:07.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:11:37.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:11:37.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:12:07.591 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:12:07.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:12:37.646 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:12:37.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:13:07.836 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:13:07.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:13:38.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:13:38.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:14:08.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:14:08.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:14:38.129 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:14:38.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:15:08.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:15:08.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:15:38.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:15:38.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:16:08.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:16:08.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:16:38.388 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:16:38.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:17:08.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:17:08.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:17:38.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:17:38.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:18:08.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:18:08.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:18:38.730 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:18:38.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:19:08.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:19:08.784 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:19:38.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:19:38.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:20:08.900 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:20:08.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:20:38.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:20:38.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:09.037 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:09.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:39.101 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:39.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:22:09.156 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:22:09.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:22:39.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:22:39.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:23:09.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:23:09.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:23:39.382 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:23:39.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:24:09.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:24:09.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:24:39.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:24:39.959 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:10.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:10.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:40.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:40.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:10.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:10.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:40.198 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:40.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:27:10.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:27:10.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:27:40.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:27:40.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:28:10.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:28:10.404 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:28:40.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:28:40.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:29:10.509 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:29:10.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:29:40.572 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:29:40.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:10.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:10.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:40.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:40.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:11.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:11.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:41.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:41.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:32:11.163 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:32:11.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:32:41.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:32:41.223 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:33:11.293 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:33:11.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:33:41.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:33:41.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:34:11.433 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:34:11.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:34:41.505 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:34:41.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:11.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:11.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:41.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:41.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:11.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:11.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:41.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:41.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:11.908 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:11.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:41.969 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:41.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:38:12.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:38:12.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:38:42.142 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:38:42.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:39:12.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:39:12.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:39:42.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:39:42.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:40:12.325 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:40:12.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:40:42.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:40:42.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:12.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:12.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:42.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:42.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:12.572 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:12.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:42.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:42.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:12.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:12.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:42.787 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:42.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:12.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:12.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:42.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:42.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:13.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:13.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:43.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:43.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:13.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:13.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:43.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:43.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:13.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:13.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:43.505 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:43.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:13.579 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:13.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:43.643 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:43.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:13.708 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:13.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:43.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:43.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:13.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:13.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:43.929 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:43.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:14.010 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:14.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:44.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:44.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:14.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:14.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:44.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:44.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:14.260 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:14.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:44.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:44.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:14.389 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:14.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:44.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:44.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:14.518 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:14.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:44.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:44.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:14.659 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:14.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:44.721 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:44.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:14.778 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:14.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:44.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:44.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:58:14.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:58:14.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:58:44.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:58:44.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:59:15.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:59:15.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:59:45.092 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:59:45.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:15.149 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:15.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:45.227 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:45.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:15.301 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:15.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:45.359 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:45.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:15.431 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:15.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:45.488 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:45.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:15.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:15.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:45.660 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:45.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:15.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:15.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:45.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:45.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:15.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:15.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:45.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:45.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:15.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:15.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:46.057 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:46.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:16.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:16.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:46.195 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:46.199 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:16.276 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:16.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:46.345 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:16.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:16.402 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:46.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:46.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:16.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:16.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:46.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:46.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:16.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:16.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:46.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:46.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:16.826 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:16.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:46.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:46.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:13:16.973 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:13:16.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:13:47.037 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:13:47.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:14:17.102 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:14:17.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:14:47.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:14:47.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:17.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:17.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:47.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:47.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:17.392 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:17.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:47.484 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:47.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:17:17.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:17:17.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:17:47.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:17:47.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:18:17.687 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:18:17.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:18:47.791 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:18:47.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:19:17.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:19:17.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:19:47.926 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:19:47.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:20:17.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:20:17.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:20:48.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:20:48.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:21:18.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:21:18.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:21:48.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:21:48.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:22:18.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:22:18.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:22:48.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:22:48.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:23:18.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:23:18.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:23:48.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:23:48.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:18.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:18.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:48.620 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:48.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:18.684 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:18.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:48.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:48.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:18.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:18.826 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:48.887 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:48.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:27:18.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:27:18.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:27:49.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:27:49.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:28:19.082 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:28:19.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:28:49.139 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:28:49.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:29:19.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:29:19.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:29:49.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:29:49.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:19.332 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:19.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:49.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:49.401 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:19.469 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:19.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:49.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:49.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:19.583 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:19.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:49.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:49.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:19.803 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:19.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:49.864 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:49.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:19.916 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:19.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:49.981 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:49.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:20.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:20.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:50.095 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:50.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:20.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:20.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:50.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:50.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:20.304 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:20.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:50.360 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:50.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:20.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:20.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:50.614 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:50.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:20.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:20.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:50.736 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:50.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:20.825 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:20.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:50.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:50.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:21.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:21.075 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:51.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:51.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:21.276 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:21.279 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:51.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:51.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:21.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:21.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:51.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:51.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:21.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:21.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:51.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:51.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:21.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:21.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:51.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:51.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:21.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:21.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:51.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:51.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:21.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:21.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:52.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:52.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:22.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:22.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:52.193 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:52.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:22.275 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:22.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:52.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:52.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:22.522 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:22.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:52.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:52.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:22.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:22.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:52.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:52.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:22.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:22.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:52.947 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:52.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:23.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:23.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:53.085 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:53.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:23.149 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:23.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:53.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:53.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:55:23.266 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:55:23.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:55:53.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:55:53.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:23.441 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:23.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:53.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:53.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:23.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:23.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:53.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:53.631 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:23.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:23.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:53.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:53.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:23.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:23.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:53.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:53.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:23.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:24.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:54.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:54.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:24.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:24.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:54.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:54.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:24.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:24.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:54.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:54.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:24.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:24.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:54.605 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:54.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:24.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:24.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:54.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:54.736 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:24.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:24.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:54.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:54.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:24.941 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:24.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:54.997 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:55.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:25.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:25.065 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:55.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:55.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:25.206 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:25.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:55.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:55.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:25.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:25.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:55.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:55.404 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:25.461 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:25.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:55.522 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:55.525 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:25.597 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:25.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:55.667 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:55.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:25.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:25.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:55.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:55.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:25.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:25.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:55.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:55.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:26.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:26.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:56.096 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:56.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:26.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:26.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:56.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:56.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:26.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:26.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:56.405 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:56.409 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:26.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:26.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:56.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:56.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:26.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:26.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:56.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:56.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:26.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:26.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:56.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:56.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:26.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:26.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:56.925 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:56.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:27.004 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:27.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:57.105 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:57.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:27.170 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:27.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:57.227 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:57.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:27.308 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:27.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:57.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:57.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:27.437 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:27.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:57.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:57.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:27.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:27.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:57.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:57.616 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:27.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:27.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:57.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:57.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:27.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:27.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:57.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:57.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:27.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:27.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:58.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:58.015 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:28.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:28.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:58.149 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:58.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:28.229 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:28.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:58.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:58.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:31:28.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:31:28.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:31:58.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:31:58.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:32:28.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:32:28.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:32:58.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:32:58.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:28.635 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:28.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:58.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:58.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:28.758 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:28.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:58.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:58.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:28.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:28.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:58.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:58.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:29.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:29.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:59.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:59.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:29.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:29.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:59.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:59.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:29.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:29.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:59.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:59.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:29.435 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:29.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:59.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:59.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:29.549 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:29.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:59.605 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:59.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:29.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:29.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:59.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:59.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:29.816 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:29.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:59.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:59.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:30.073 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:30.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:44:00.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:44:00.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:44:30.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:44:30.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:45:00.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:45:00.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:45:30.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:45:30.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:46:00.488 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:46:00.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:46:30.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:46:30.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:00.634 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:00.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:30.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:30.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:00.755 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:00.759 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:30.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:30.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:49:00.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:49:00.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:49:30.976 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:49:30.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:50:01.032 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:50:01.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:50:31.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:50:31.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:01.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:01.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:31.223 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:31.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:01.287 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:01.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:31.351 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:31.355 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:01.407 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:01.411 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:31.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:31.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:01.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:01.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:31.624 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:31.627 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:01.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:01.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:31.746 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:31.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:01.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:01.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:31.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:31.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:01.949 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:01.952 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:32.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:32.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:02.086 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:02.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:32.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:32.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:02.224 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:02.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:32.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:32.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:02.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:02.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:32.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:32.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:02.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:02.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:32.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:32.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:02.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:02.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:32.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:32.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:03:02.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:03:02.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:03:32.923 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:03:32.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:04:02.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:04:03.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:04:33.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:04:33.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:05:03.110 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:05:03.114 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:05:33.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:05:33.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:06:03.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:06:03.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:06:33.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:06:33.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:07:03.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:07:03.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:07:33.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:07:33.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:03.528 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:03.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:33.615 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:33.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:03.680 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:03.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:33.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:33.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:10:03.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:10:03.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:10:33.966 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:10:33.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:04.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:04.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:34.160 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:34.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:04.218 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:04.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:34.278 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:34.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:04.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:04.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:34.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:34.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:04.554 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:04.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:34.600 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:34.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:04.667 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:04.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:34.733 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:34.736 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:04.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:04.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:34.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:34.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:17:04.953 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:17:04.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:17:35.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:17:35.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:18:05.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:18:05.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:18:35.166 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:18:35.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:19:05.222 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:19:05.226 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:19:35.287 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:19:35.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:05.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:05.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:35.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:35.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:05.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:05.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:35.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:35.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:05.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:05.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:35.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:35.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:05.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:05.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:35.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:35.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:05.939 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:05.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:36.003 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:36.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:06.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:06.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:36.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:36.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:06.207 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:06.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:36.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:36.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:06.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:06.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:36.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:36.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:06.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:06.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:36.538 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:36.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:06.602 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:06.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:36.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:36.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:06.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:06.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:36.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:36.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:06.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:06.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:36.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:36.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:07.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:07.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:37.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:37.075 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:07.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:07.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:37.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:37.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:07.257 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:07.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:37.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:37.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:07.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:07.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:37.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:37.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:07.482 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:07.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:37.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:37.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:07.626 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:07.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:37.684 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:37.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:07.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:07.736 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:37.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:37.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:07.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:07.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:37.920 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:37.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:07.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:07.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:38.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:38.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:08.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:08.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:38.178 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:38.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:08.233 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:08.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:38.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:38.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:08.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:08.357 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:38.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:38.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:08.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:08.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:38.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:38.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:08.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:08.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:38.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:38.755 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:08.812 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:08.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:38.934 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:38.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:08.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:09.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:39.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:39.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:09.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:09.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:39.206 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:39.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:09.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:09.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:39.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:39.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:09.406 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:09.410 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:39.472 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:39.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:09.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:09.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:39.606 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:39.610 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:09.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:09.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:39.734 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:39.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:09.791 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:09.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:39.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:39.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:09.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:09.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:39.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:40.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:55:10.055 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:55:10.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:55:40.119 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:55:40.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:56:10.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:56:10.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:56:40.248 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:56:40.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:10.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:10.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:40.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:40.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:10.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:10.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:40.515 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:40.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:10.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:10.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:40.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:40.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:00:10.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:00:10.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:00:40.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:00:40.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:01:10.826 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:01:10.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:01:40.907 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:01:40.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:02:11.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:02:11.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:02:41.081 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:02:41.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:03:11.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:03:11.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:03:41.260 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:03:41.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:04:11.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:04:11.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:04:41.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:04:41.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:11.472 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:11.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:41.536 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:41.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:06:11.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:06:11.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:06:41.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:06:41.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:07:11.718 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:07:11.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:07:41.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:07:41.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:08:11.846 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:08:11.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:08:41.923 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:08:41.926 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:09:11.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:09:11.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:09:42.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:09:42.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:10:12.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:10:12.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:10:42.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:10:42.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:12.229 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:12.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:42.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:42.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:12.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:12.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:42.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:42.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:12.478 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:12.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:42.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:42.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:12.615 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:12.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:42.680 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:42.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:12.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:12.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:42.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:42.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:12.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:12.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:42.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:42.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:12.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:12.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:43.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:43.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:13.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:13.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:43.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:43.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:13.229 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:13.234 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:43.290 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:43.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:13.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:13.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:43.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:43.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:13.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:13.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:43.527 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:43.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:13.586 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:13.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:43.639 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:43.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:13.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:13.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:43.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:43.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:13.859 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:13.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:43.939 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:43.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:13.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:13.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:44.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:44.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:14.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:14.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:44.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:44.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:14.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:14.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:44.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:44.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:14.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:14.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:44.458 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:44.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:14.514 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:14.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:44.579 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:44.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:14.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:14.640 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:44.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:44.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:14.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:14.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:44.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:44.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:14.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:14.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:44.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:44.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:14.994 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:14.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:45.196 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:45.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:15.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:15.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:45.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:45.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:15.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:15.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:45.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:45.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:15.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:15.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:45.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:45.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:15.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:15.626 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:45.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:45.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:15.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:15.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:45.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:45.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:15.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:15.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:45.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:45.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:16.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:16.009 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:46.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:46.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:16.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:16.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:46.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:46.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:16.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:16.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:46.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:46.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:16.382 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:16.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:46.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:46.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:16.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:16.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:46.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:46.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:45:16.637 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:45:16.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:45:46.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:45:46.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:16.749 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:16.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:46.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:46.826 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:16.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:16.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:46.934 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:46.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:16.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:16.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:47.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:47.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:17.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:17.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:47.179 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:47.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:17.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:17.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:47.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:47.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:17.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:17.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:47.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:47.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:17.502 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:17.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:47.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:47.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:17.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:17.627 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:47.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:47.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:17.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:17.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:47.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:47.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:17.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:17.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:47.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:47.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:17.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:17.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:48.057 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:48.060 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:18.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:18.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:48.165 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:48.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:18.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:18.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:48.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:48.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:18.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:18.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:48.423 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:48.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:18.471 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:18.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:48.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:48.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:18.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:18.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:48.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:48.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:18.695 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:18.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:48.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:48.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:18.826 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:18.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:48.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:48.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:19.012 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:19.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:49.077 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:49.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:19.133 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:19.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:49.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:49.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:19.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:19.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:49.308 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:49.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:19.355 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:19.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:49.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:49.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:19.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:19.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:49.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:49.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:19.625 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:19.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:49.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:49.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:19.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:19.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:49.802 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:49.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:19.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:19.870 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:49.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:49.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:19.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:19.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:50.052 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:50.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:20.103 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:20.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:50.191 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:50.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:20.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:20.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:50.304 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:50.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:20.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:20.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:50.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:50.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:20.469 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:20.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:50.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:50.537 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:20.586 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:20.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:50.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:50.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:20.708 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:20.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:50.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:50.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:20.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:20.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:50.916 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:50.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:20.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:20.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:51.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:51.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:21.078 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:21.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:51.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:51.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:21.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:21.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:51.321 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:51.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:21.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:21.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:51.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:51.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:21.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:21.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:51.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:51.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:21.615 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:21.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:51.680 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:51.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:21.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:21.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:51.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:51.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:21.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:21.858 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:51.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:51.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:21.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:21.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:52.043 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:52.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:22.092 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:22.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:52.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:52.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:22.204 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:22.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:52.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:52.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:22.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:22.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:52.369 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:52.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:22.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:22.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:52.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:52.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:22.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:22.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:52.605 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:52.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:22.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:22.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:52.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:52.730 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:22.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:22.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:52.847 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:52.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:22.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:22.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:52.966 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:52.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:23.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:23.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:53.081 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:53.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:23.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:23.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:53.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:53.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:23.260 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:23.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:53.323 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:53.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:23.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:23.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:53.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:53.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:23.509 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:23.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:53.591 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:53.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:23.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:23.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:53.704 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:53.707 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:23.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:23.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:53.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:53.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:23.896 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:23.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:53.961 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:53.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:24.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:24.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:54.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:54.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:24.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:24.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:54.211 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:54.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:47:24.275 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:47:24.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:47:54.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:47:54.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:24.394 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:24.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:54.478 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:54.482 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:24.538 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:24.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:54.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:54.604 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:24.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:24.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:54.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:54.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:24.774 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:24.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:54.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:54.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:24.903 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:24.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:54.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:54.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:25.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:25.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:55.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:55.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:25.163 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:25.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:55.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:55.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:25.277 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:25.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:55.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:55.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:25.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:25.391 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:55.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:55.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:25.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:25.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:55.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:55.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:25.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:25.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:55.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:55.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:25.917 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:25.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:55.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:55.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:26.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:26.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:56.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:56.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:26.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:26.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:56.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:56.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:26.269 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:26.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:56.437 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:56.441 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:26.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:26.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:56.567 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:56.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:26.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:26.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:56.687 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:56.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:26.743 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:26.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:56.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:56.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:26.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:26.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:56.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:56.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:27.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:27.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:57.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:57.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:27.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:27.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:57.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:57.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:27.279 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:27.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:57.343 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:57.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:27.406 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:27.410 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:57.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:57.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:27.535 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:27.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:57.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:57.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:27.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:27.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:57.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:57.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:27.773 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:27.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:57.832 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:57.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:27.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:27.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:57.948 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:57.952 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:28.002 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:28.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:58.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:58.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:28.124 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:28.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:58.195 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:58.199 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:28.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:28.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:58.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:58.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:28.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:28.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:58.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:58.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:28.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:28.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:58.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:58.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:28.625 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:28.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:58.680 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:58.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:28.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:28.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:58.808 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:58.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:28.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:28.890 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:58.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:58.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:28.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:29.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:59.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:59.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:29.178 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:29.181 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:59.231 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:59.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:29.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:29.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:59.355 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:59.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:29.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:29.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:59.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:59.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:29.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:29.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:59.596 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:59.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:29.653 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:29.656 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:59.733 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:59.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:29.790 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:29.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:59.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:59.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:29.894 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:29.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:59.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:59.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:31:30.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:31:30.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:00.076 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:00.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:30.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:30.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:00.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:00.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:30.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:30.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:00.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:00.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:30.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:30.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:00.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:00.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:30.482 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:30.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:00.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:00.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:30.592 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:30.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:00.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:00.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:30.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:30.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:00.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:00.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:30.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:30.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:00.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:00.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:30.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:30.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:01.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:01.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:31.093 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:31.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:01.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:01.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:31.204 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:31.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:01.276 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:01.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:31.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:31.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:01.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:01.401 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:31.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:31.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:01.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:01.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:31.586 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:31.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:01.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:01.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:31.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:31.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:01.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:01.755 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:31.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:31.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:01.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:01.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:31.944 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:31.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:01.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:02.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:32.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:32.067 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:02.133 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:02.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:32.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:32.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:02.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:02.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:32.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:32.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:02.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:02.380 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:32.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:32.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:52:02.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:52:02.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:52:32.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:52:32.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:02.622 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:02.627 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:32.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:32.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:02.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:02.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:32.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:32.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:02.894 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:02.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:32.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:32.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:03.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:03.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:33.086 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:33.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:03.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:03.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:33.252 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:33.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:03.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:03.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:33.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:33.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:03.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:03.537 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:33.616 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:33.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:03.724 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:03.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:33.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:33.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:03.896 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:03.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:33.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:33.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:04.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:04.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:34.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:34.114 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:04.172 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:04.176 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:34.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:34.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:04.315 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:04.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:34.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:34.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:04.435 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:04.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:34.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:34.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:04.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:04.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:34.622 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:34.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:04.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:04.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:34.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:34.756 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:04.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:04.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:34.871 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:34.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:04.953 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:04.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:35.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:35.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:05.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:05.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:35.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:35.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:05.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:05.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:35.250 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:35.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:05.316 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:05.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:35.379 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:35.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:05.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:05.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:35.491 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:35.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:05.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:05.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:35.655 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:35.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:05.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:05.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:35.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:35.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:05.832 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:05.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:35.898 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:35.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:05.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:05.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:36.033 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:36.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:06.081 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:06.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:36.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:36.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:06.228 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:06.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:36.292 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:36.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:06.348 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:06.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:36.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:36.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:06.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:06.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:36.535 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:36.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:06.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:06.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:36.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:36.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:06.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:06.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:36.789 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:36.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:06.858 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:06.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:36.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:36.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:07.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:07.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:37.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:37.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:07.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:07.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:37.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:37.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:07.264 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:07.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:37.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:37.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:07.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:07.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:37.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:37.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:07.520 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:07.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:37.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:37.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:07.650 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:07.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:37.714 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:37.718 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:07.766 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:07.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:37.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:37.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:07.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:07.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:37.962 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:37.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:08.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:08.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:38.092 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:38.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:08.165 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:08.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:38.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:38.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:08.294 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:08.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:38.359 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:38.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:08.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:08.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:38.481 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:38.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:08.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:08.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:38.619 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:38.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:08.666 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:08.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:38.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:38.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:08.787 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:08.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:38.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:38.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:08.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:08.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:38.973 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:38.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:09.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:09.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:39.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:39.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:09.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:09.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:39.215 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:39.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:09.280 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:09.284 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:39.345 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:39.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:09.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:09.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:39.482 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:39.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:09.539 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:09.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:39.600 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:39.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:09.646 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:09.651 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:39.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:39.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:09.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:09.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:39.853 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:39.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:09.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:09.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:39.976 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:39.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:10.057 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:10.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:40.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:40.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:10.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:10.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:40.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:40.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:10.323 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:10.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:40.388 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:40.391 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:10.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:10.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:40.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:40.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:10.573 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:10.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:40.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:40.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:10.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:10.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:40.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:40.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:10.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:10.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:40.913 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:40.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:10.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:10.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:41.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:41.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:11.101 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:11.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:41.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:41.168 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:11.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:11.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:41.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:41.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:11.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:11.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:41.389 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:41.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:00:11.467 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:00:11.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:00:41.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:00:41.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:11.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:11.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:41.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:41.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:11.764 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:11.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:41.837 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:41.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:11.894 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:11.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:41.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:41.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:12.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:12.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:42.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:42.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:12.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:12.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:42.211 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:42.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:12.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:12.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:42.321 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:42.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:12.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:12.390 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:42.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:42.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:12.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:12.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:42.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:42.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:12.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:12.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:42.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:42.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:12.746 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:12.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:42.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:42.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:12.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:12.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:42.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:42.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:13.001 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:13.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:43.060 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:43.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:13.116 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:13.120 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:43.181 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:43.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:13.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:13.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:43.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:43.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:13.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:13.380 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:43.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:43.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:13.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:13.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:43.568 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:43.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:13.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:13.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:43.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:43.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:13.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:13.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:43.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:43.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:13.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:13.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:44.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:44.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:14.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:14.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:44.138 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:44.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:14.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:14.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:44.264 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:44.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:14.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:14.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:44.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:44.390 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:14.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:14.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:44.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:44.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:14.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:14.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:44.626 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:44.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:14.695 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:14.700 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:44.764 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:44.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:14.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:14.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:44.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:44.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:14.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:14.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:45.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:45.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:15.086 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:15.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:45.151 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:45.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:15.232 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:15.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:45.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:45.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:15.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:15.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:45.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:45.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:15.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:15.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:45.532 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:45.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:15.597 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:15.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:45.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:45.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:15.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:15.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:45.789 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:45.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:15.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:15.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:45.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:45.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:15.981 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:15.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:46.044 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:46.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:16.099 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:16.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:46.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:46.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:16.246 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:16.250 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:46.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:46.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:16.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:16.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:46.426 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:46.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:16.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:16.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:46.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:46.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:16.611 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:16.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:46.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:46.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:16.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:16.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:46.788 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:46.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:16.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:16.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:46.906 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:46.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:16.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:16.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:47.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:48.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:18.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:18.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:48.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:48.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:18.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:18.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:48.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:48.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:18.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:18.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:48.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:48.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:18.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:18.627 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:48.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:48.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:18.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:18.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:48.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:48.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:18.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:18.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:48.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:48.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:19.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:19.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:49.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:49.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:19.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:19.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:49.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:49.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:19.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:19.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:49.327 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:49.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:19.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:19.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:49.441 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:49.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:19.513 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:19.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:49.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:49.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:19.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:19.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:49.708 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:49.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:19.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:19.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:49.836 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:49.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:19.916 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:19.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:49.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:49.986 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:20.026 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:20.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:50.105 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:50.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:20.227 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:20.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:50.301 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:50.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:20.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:20.355 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:50.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:50.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:20.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:20.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:50.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:50.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:20.597 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:20.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:50.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:50.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:20.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:20.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:50.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:50.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:20.844 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:20.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:50.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:50.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:21.014 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:21.018 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:51.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:51.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:06:21.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:06:21.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:06:51.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:06:51.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:21.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:21.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:51.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:51.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:21.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:21.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:51.441 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:51.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:21.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:21.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:51.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:51.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:21.802 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:21.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:51.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:51.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:21.925 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:21.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:51.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:51.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:22.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:22.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:52.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:52.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:22.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:22.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:52.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:52.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:22.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:22.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:52.384 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:52.388 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:22.435 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:22.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:52.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:52.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:22.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:22.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:52.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:52.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:22.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:22.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:52.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:52.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:22.868 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:22.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:52.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:52.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:23.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:23.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:53.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:53.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:23.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:23.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:53.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:53.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:23.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:23.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:53.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:53.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:23.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:23.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:53.442 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:53.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:23.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:23.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:53.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:53.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:23.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:23.631 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:53.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:53.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:23.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:23.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:53.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:53.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:23.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:23.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:53.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:53.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:23.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:23.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:54.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:54.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:24.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:24.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:54.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:54.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:24.232 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:24.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:54.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:54.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:24.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:24.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:54.426 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:54.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:24.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:24.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:54.546 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:54.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:24.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:24.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:54.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:54.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:24.756 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:24.759 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:54.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:54.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:24.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:24.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:55.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:55.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:25.048 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:25.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:55.112 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:55.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:25.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:25.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:55.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:55.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:25.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:25.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:55.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:55.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:25.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:25.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:55.508 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:55.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:25.574 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:25.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:55.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:55.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:25.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:25.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:55.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:55.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:25.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:26.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:56.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:56.360 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:26.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:26.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:56.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:56.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:26.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:26.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:56.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:56.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:26.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:26.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:56.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:56.730 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:26.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:26.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:56.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:56.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:26.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:26.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:56.969 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:56.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:27.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:27.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:57.098 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:57.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:27.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:27.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:57.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:57.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:27.275 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:27.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:57.339 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:57.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:27.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:27.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:57.460 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:57.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:27.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:27.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:57.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:57.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:27.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:27.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:57.710 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:57.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:27.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:27.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:57.815 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:57.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:27.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:27.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:57.944 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:57.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:27.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:28.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:58.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:58.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:28.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:28.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:58.179 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:58.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:28.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:28.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:58.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:58.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:28.374 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:28.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:58.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:58.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:28.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:28.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:58.574 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:58.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:28.631 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:28.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:58.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:58.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:28.883 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:28.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:58.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:58.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:29.002 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:29.005 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:59.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:59.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:29.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:29.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:59.191 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:59.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:29.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:29.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:59.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:59.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:29.368 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:29.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:59.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:59.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:29.481 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:29.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:59.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:59.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:29.616 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:29.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:59.683 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:59.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:29.734 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:29.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:59.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:59.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:29.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:29.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:59.934 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:59.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:10:29.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:10:29.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:00.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:00.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:30.118 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:30.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:12:00.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:12:00.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:12:30.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:12:30.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:00.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:00.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:30.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:30.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:00.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:00.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:30.501 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:30.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:00.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:00.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:30.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:30.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:00.685 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:00.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:30.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:30.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:00.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:00.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:30.874 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:30.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:00.935 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:00.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:31.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:31.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:01.115 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:01.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:31.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:31.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:01.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:01.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:31.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:31.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:01.364 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:01.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:31.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:31.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:01.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:01.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:31.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:31.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:01.614 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:01.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:31.666 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:31.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:01.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:01.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:31.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:31.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:01.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:01.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:25.751 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-17T23:25:25.767 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2023-05-17T23:25:25.768 DEBUG:teuthology.task.console_log:Killing console logger for smithi060 2023-05-17T23:25:25.768 DEBUG:teuthology.exit:Finished running handlers